Authors:
Sharmistha Puhan,Sambit Kumar Mishra,Deepak Kumar Rout,DOI NO:
https://doi.org/10.26782/jmcms.2025.04.00007Keywords:
Cosine Transform,DCT,Bad weather video,Background subtraction,Five-frame difference,Multi-frame feature space,Object detection,Visual surveillance,Abstract
This article addresses the problem of visual detection of moving objects in bad weather conditions. A multi-frame semantic information-based background subtraction scheme is proposed here. The camera is static, hence, the viewpoint is assumed to be fixed. It exploits the spatial as well as temporal neighbourhood at the pixel level by using motion parameters to detect the position of the objects in the field of view. A local attribute map is generated by analyzing the Discrete Cosine Transform coefficients. Further, a spatio-contextual framework is used to obtain the global attributes. Then, the local and global attributes are combined using an entropy-based fusion strategy to get the moving objects in bad weather sequences. The efficacy of the scheme is evaluated using the benchmark bad-weather dataset of CDNet. To check the stand of the proposal among seven recent state-of-the-art schemes, qualitative as well as quantitative analyses are carried out. The results are found to be encouraging.Refference:
I. Ahmad, Naeem, Mattias O’Nils, and Najeem Lawal. A taxonomy of visual surveillance systems. 2013.
II. Blin, Rachel, et al. “Road scenes analysis in adverse weather conditions by polarization-encoded images and adapted deep learning.” 2019 IEEE Intelligent Transportation Systems Conference (ITSC). IEEE, 2019. 10.1109/ITSC.2019.8916853
III. Boussakta, Said, and Hamoud O. Alshibami. “Fast algorithm for the 3-D DCT-II.” IEEE Transactions on Signal Processing 52.4 (2004): 992-1001. 10.1109/TSP.2004.823472
IV. Chaturvedi, Saket S., Lan Zhang, and Xiaoyong Yuan. “Pay” Attention” to Adverse Weather: Weather-aware Attention-based Object Detection.” 2022 26th International Conference on Pattern Recognition (ICPR). IEEE, 2022. 10.1109/ICPR56361.2022.9956149
V. Chen, Y., Zhou, R., Guo, B., Shen, Y., Wang, W., Wen, X., Suo, X.: Discrete cosine transform for filter pruning. Applied Intelligence,1–17(2022). 10.1007/s10489-022-03604-
VI. Cioppa, Anthony, Marc Van Droogenbroeck, and Marc Braham. “Real-time semantic background subtraction.” 2020 IEEE International Conference on Image Processing (ICIP). IEEE, 2020. 10.48550/arXiv.2002.04993
VII. El-Khoreby, Mohamed A., and Syed Abd Rahman Abu-Bakar. “Vehicle detection and counting for complex weather conditions.” 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA). IEEE, 2017. 10.1109/ICSIPA.2017.8120648
VIII. Gao, Fei, Yunyang Li, and Shufang Lu. “Extracting moving objects more accurately: a CDA contour optimizer.” IEEE Transactions on Circuits and Systems for Video Technology 31.12 (2021): 4840-4849. 10.1109/TCSVT.2021.3055539
IX. Garcia-Garcia, Belmar, Thierry Bouwmans, and Alberto Jorge Rosales Silva. “Background subtraction in real applications: Challenges, current models and future directions.” Computer Science Review 35 (2020): 100204. 10.1016/j.cosrev.2019.100204.
X. Jegham, Imen, and Anouar Ben Khalifa. “Pedestrian detection in poor weather conditions using moving camera.” 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA). IEEE, 2017. 10.1109/AICCSA.2017.35.
XI. Jia, Zhen, et al. “A two-step approach to see-through bad weather for surveillance video quality enhancement.” Machine Vision and Applications 23 (2012): 1059-1082. 10.26906/SUNZ.2023.1.040
XII. Kalsotra, Rudrika, and Sakshi Arora. “Background subtraction for moving object detection: explorations of recent developments and challenges.” The Visual Computer 38.12 (2022):4151-4178. 10.1007/s00371-021-02286-0
XIII. Krišto, Mate, Marina Ivasic-Kos, and Miran Pobar. “Thermal object detection in difficult weather conditions using YOLO.” IEEE access 8 (2020): 125459-125476. 10.1109/ACCESS.2020.3007481
XIV. Leroux, Sam, Bo Li, and Pieter Simoens. “Multi-branch neural networks for video anomaly detection in adverse lighting and weather conditions.” Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2022. 10.1109/WACV51458.2022.00308
XV. Levine, Martin D., Xiangjing An, and Hangen He. “Saliency detection based on frequency and spatial domain analysis.” Neuroscience 8.8 (2005): 975-977.
XVI. Lim, Long Ang, and Hacer Yalim Keles. “Foreground segmentation using convolutional neural networks for multiscale feature encoding.” Pattern Recognition Letters 112 (2018): 256-262. 10.1016/j.patrec.2018.08.002
XVII. Liu, Wenyu, et al. “Image-adaptive YOLO for object detection in adverse weather conditions.” Proceedings of the AAAI conference on artificial intelligence. Vol. 36. No. 2. 2022. 10.1609/aaai.v36i2.20072
XVIII. Otsu, Nobuyuki. “A threshold selection method from gray-level histograms.” IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, 1979. 10.1109/TSMC.1979.4310076
XIX. Rahmon, Gani, et al. “Motion U-Net: Multi-cue encoder-decoder network for motion segmentation.” 25th IEEE International conference on pattern recognition, 2021. 10.1109/ICPR48806.2021.9413211
XX. Rout, Deepak Kumar, et al. “A novel five-frame difference scheme for local change detection in underwater video.” Fourth IEEE International Conference on Image Information Processing, pp. 1-6, 2017. 10.1109/ICIIP.2017.8313727
XXI. Rout, Deepak Kumar, and Sharmistha Puhan. “Video object detection using inter-frame correlation based background subtraction.” IEEE Recent Advances in Intelligent Computational Systems, pp. 1-6, 2013. 10.1109/RAICS.2013.6745467
XXII. Rout, Deepak Kumar, et al. “Walsh–Hadamard-kernel-based features in particle filter framework for underwater object tracking.” IEEE Transactions on Industrial Informatics 16.9 (2019): 5712-5722. 10.1109/TII.2019.2937902
XXIII. Sajid, Hasan, and Sen-Ching Samson Cheung. “Universal multimode background subtraction.” IEEE Transactions on Image Processing 26.7 (2017): 3249-3260. 10.1109/TIP.2017.2695882
XXIV. Singha, Anu, and Mrinal Kanti Bhowmik. “Salient features for moving object detection in adverse weather conditions during night time.” IEEE Transactions on circuits and systems for video technology 30.10 (2019): 3317-3331. DOI: 10.1109/TCSVT.2019.2926164
XXV. St-Charles, Pierre-Luc, Guillaume-Alexandre Bilodeau, and Robert Bergevin. “SuBSENSE: A universal change detection method with local adaptive sensitivity.” IEEE Transactions on Image Processing 24.1 (2014): 359-373. 10.1109/TIP.2014.2378053
XXVI. Strang, Gilbert. “The discrete cosine transform.” SIAM review 41.1 (1999): 135-147.
XXVII. Sun, Dayang, Binbin Li, and Zhihong Qian. “Research of vehicle counting based on DBSCAN in video analysis.” IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, pp.1523-1527,2013. 10.1109/GreenCom-iThings CPSCom.2013.270
XXVIII. Tezcan, M. Ozan, Prakash Ishwar, and Janusz Konrad. “BSUV-Net 2.0: Spatio-temporal data augmentations for video-agnostic supervised background subtraction.” IEEE Access 9 (2021): 53849-53860. 10.1109/ACCESS.2021.3071163
XXIX. Walambe, Rahee, et al. “Lightweight object detection ensemble framework for autonomous vehicles in challenging weather conditions.” Computational Intelligence and Neuroscience 2021.1 (2021): 5278820. 10.1155/2021/5278820
XXX. Wang, Kunfeng, Chao Gou, and Fei-Yue Wang. “$ M^{4} CD $: A robust change detection method for intelligent visual surveillance.” IEEE Access 6 (2018): 15505-15520. 10.1109/ACCESS.2018.2812880
XXXI. Yaghoobi Ershadi, Nastaran, José Manuel Menéndez, and David Jiménez. “Robust vehicle detection in different weather conditions: UsingMIPM.” PloSone 13.3(2018):e0191355. 10.1371/journal.pone.0191355
XXXII. Zhong, Yijie, et al. “Detecting camouflaged object in frequency domain.” Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. Pp. 1-6, 2022. 10.1109/WACV57701.2024.00146