YOLOV7-BASED MOVING OBJECT DETECTION IN DENSE FOG CONDITIONS

Authors:

Sharmistha Puhan,Sambit Kumar Mishra,

DOI NO:

https://doi.org/10.26782/jmcms.2024.12.00008

Keywords:

Moving Object Detection,Bad Weather,Foggy Environment,YOLO,YOLOv7,Profound Learning,Neural Network,

Abstract

Detecting moving objects in dense foggy conditions is a challenging problem in computer vision, with critical applications in smart transportation systems, surveillance, and autonomous driving. Fog particles scatter and absorb light, significantly reducing visibility and making it difficult for traditional computer vision algorithms to accurately detect moving objects. To address this challenge, researchers have proposed learning-based approaches that leverage deep neural networks to recognize moving objects and adapt to the unique characteristics of foggy environments. In this study, we present a learning-based method utilizing the YOLOv7 framework to effectively detect moving objects in dense fog conditions. The proposed approach involves four key stages: feature extraction, feature fusion, object detection, and non-maximum suppression. The results achieved are highly promising when compared to state-of-the-art techniques.

Refference:

I. Ahmed, Muhammad, et al. “Survey and performance analysis of deep learning based object detection in challenging environments.” Sensors 21.15 (2021): 5116. 10.3390/s21155116

II. Bijelic, Mario, et al. “Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020. 10.1109/CVPR42600.2020.01170

III. Bochkovskiy, Alexey, Chien-Yao Wang, and Hong-Yuan Mark Liao. “Yolov4: Optimal speed and accuracy of object detection.” arXiv preprint arXiv:2004.10934 (2020). 10.48550/arXiv.2004.10934

IV. Chaturvedi, Saket S., Lan Zhang, and Xiaoyong Yuan. “Pay” Attention” to Adverse Weather: Weather-aware Attention-based Object Detection.” 2022 26th International Conference on Pattern Recognition (ICPR). IEEE, 2022. 10.1109/ICPR56361.2022.9956149

V. Dong, Nan, Zhen Jia, Jie Shao, Zhipeng Li, Fuqiang Liu, Jianwei Zhao, and Pei-Yuan Peng. “Adaptive Object Detection and Visibility Improvement in Foggy Image.” Journal of Multimedia, vol.6, no. 1, 2011. doi:10.4304/jmm.6.1.14-21
VI. Farhadi, Ali, and Joseph Redmon. “Yolov3: An incremental improvement.” Computer vision and pattern recognition. Vol. 1804. Berlin/Heidelberg, Germany: Springer, 2018. 10.48550/arXiv.1804.02767

VII. Horvat, Marko, Ljudevit Jelečević, and Gordan Gledec. “A comparative study of YOLOv5 models performance for image localization and classification.” Central European Conference on Information and Intelligent Systems. Faculty of Organization and Informatics Varazdin, 2022.

VIII. Hsu, Han-Kai, et al. “Progressive domain adaptation for object detection.” Proceedings of the IEEE/CVF winter conference on applications of computer vision. 2020. 10.1109/WACV45572.2020.9093358

IX. Huang, Shih-Chia, Trung-Hieu Le, and Da-Wei Jaw. “DSNet: Joint semantic learning for object detection in inclement weather conditions.” IEEE transactions on pattern analysis and machine intelligence 43.8 (2020): 2623-2633. 10.1109/tpami.2020.2977911
X. Krišto, Mate, Marina Ivasic-Kos, and Miran Pobar. “Thermal object detection in difficult weather conditions using YOLO.” IEEE access 8 (2020): 125459-125476. 10.1109/ACCESS.2020.3007481

XI. Kumar, Prashant, et al. “Detection of video objects in dynamic scene using local binary pattern subtraction method.” Intelligent Computing, Communication and Devices: Proceedings of ICCD 2014, Volume 2. Springer India, 2015.

XII. Li, Chuyi, et al. “YOLOv6: A single-stage object detection framework for industrial applications.” arXiv preprint arXiv:2209.02976 (2022). 10.48550/arXiv.2209.02976

XIII. Liu, Wenyu, et al. “Image-adaptive YOLO for object detection in adverse weather conditions.” Proceedings of the AAAI conference on artificial intelligence. Vol. 36. No. 2. 2022. 10.1609/aaai.v36i2.20072

XIV. Nie, Xin, Meifang Yang, and Ryan Wen Liu. “Deep neural network-based robust ship detection under different weather conditions.” 2019 IEEE Intelligent Transportation Systems Conference (ITSC). IEEE, 2019. 10.1109/ITSC.2019.8917475

XV. Nithyanandham, Lalithamani. “Obstacle Detection of Vehicles under Fog.” International Journal of Simulation–Systems, Science & Technology 20.1 (2019).

XVI. Redmon, J. “You only look once: Unified, real-time object detection.” Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. 10.1109/CVPR.2016.91

XVII. Rout, Deepak Kumar, and Sharmistha Puhan. “A spatio-temporal framework for moving object detection in outdoor scene.” International Conference on Computing and Communication Systems. Berlin, Heidelberg: Springer Berlin Heidelberg, 2011. https://doi.org/10.1007/978-3-642-29216-3_54

XVIII. Rout, Deepak Kumar, and Sharmistha Puhan. “Video object detection using inter-frame correlation based background subtraction.” 2013 IEEE Recent Advances in Intelligent Computational Systems (RAICS). IEEE, 2013. 10.5120/14255-2364

XIX. Sen, Prithwish, Anindita Das, and Nilkanta Sahu. “Object detection in foggy weather conditions.” International Conference on Intelligent Computing & Optimization. Cham: Springer International Publishing, 2021. 10.1007/978-3-030-93247-3_70

XX. Sindagi, Vishwanath A., et al. “Prior-based domain adaptive object detection for hazy and rainy conditions.” Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XIV 16. Springer International Publishing, 2020. 10.1007/978-3-030-58568-6_45

XXI. Sharma, Teena, et al. “Deep learning-based object detection and scene perception under bad weather conditions.” Electronics 11.4 (2022): 563. 10.3390/electronics11040563

XXII. Walambe, Rahee, et al. “Lightweight object detection ensemble framework for autonomous vehicles in challenging weather conditions.” Computational Intelligence and Neuroscience 2021.1 (2021): 5278820. 10.1155/2021/5278820

XXIII. Zou, Zhengxia, et al. “Object detection in 20 years: A survey.” Proceedings of the IEEE 111.3 (2023): 257-276. 10.48550/arXiv.1905.05055

XXIV. Zhao, Zhong-Qiu, et al. “Object detection with deep learning: A review.” IEEE transactions on neural networks and learning systems 30.11 (2019): 3212-3232. 10.1109/TNNLS.2018.2876865

View Download