Sparse codes fusion for context enhancement of night video surveillance
- 231 Downloads
Fusion-based method for video enhancement has been playing a basic but significant role, which is also proved high-efficiency. Still, there are some open questions, such as lamp-off problem, over-enhanced moving objects and night shadow. To resolve the problems, a novel method—sparse codes fusion (SCF) is proposed. With plenty of samples from daytime videos and nighttime videos of the same scene, we learn and obtain a daytime dictionary and a nighttime dictionary using the proposed mutual coherence learning (MCL) algorithm. These two dictionaries are utilized for fusion and extracting context enhanced background. Moreover, we reconstruct the nighttime dictionary to get nighttime background that would be applied in motion extraction. Then the moving objects are added into the enhanced background. Extensive experimental results show a highly comprehensive description of video frames that leads to improvements over the state of the art on many usual public video datasets.
KeywordsVideo enhancement Sparse codes fusion (SCF) Daytime dictionary Nighttime dictionary Mutual coherence learning (MCL) Enhanced background Motion extraction
The authors would like to thank the anonymous reviewers for their helpful comments. This work is partly supported by National Science Foundation of China (Grant No. 61300092), Fundamental Research Funds for the Central Universities (Grant No. ZYGX2013J068), and Sichuan Province Science and Technology Support Program Project (Grant No. 2013GZ0151).
- 4.Cai YH et al (2006) Context enhancement of nighttime surveillance by image fusion. Proc. ICPR 2006, vol.1, pp 980–983Google Scholar
- 7.Harandi M (2012) Sparse coding and dictionary learning for symmetric positive definite matrices: a Kernel approach. European Conference on Computer Vision, pp 216–229Google Scholar
- 9.Ji Q, Yu S (2013) Motion object detection based on adaptive mixture Gaussian model and four-frame subtraction. International Conference on Computational and Information Sciences, pp 1202–1205Google Scholar
- 12.Paris S, Halkias X, Glotin H (2012) Sparse coding for histograms of local binary patterns applied for image categorization: toward a bag-of-scenes analysis. International Conference on Pattern Recognition, pp 2817–2820Google Scholar
- 13.Rao YB, Chen LT (2012) A survey of video enhancement techniques. Int J Electr Eng Inform 3(1):71–99Google Scholar
- 16.Raskar R, Ilie A, Yu JY (2005) Image fusion for context enhancement and video surrealism. Proc. SIGGRAPH 2005. ACM, New YorkGoogle Scholar
- 20.Vollmer C, Gross HM, Eggert JP (2013) Learning features for activity recognition with shift-invariant sparse coding. Artif Neural Netw Mach Learn 8131:367–374Google Scholar
- 22.Yamasaki A et al (2008) Denighting: enhancement of nighttime image for a surveillance camera. 19th Int. Conf. Pattern RecogGoogle Scholar
- 23.Zhu QD, Jing LQ, Bi RS (2010) Exploration and improvement of Ostu threshold segmentation algorithm. IEEE World Congress on Intelligent Control and Automation, pp 6183–6188Google Scholar