Abstract
Video cameras are deployed in large numbers for surveillance. Video is compressed and transmitted over bandwidth limited communication channels. Researches have increasingly focused on automated analysis algorithms to understand video. This raises the question “Does compression have an effect on automated analysis algorithms?”. This is a vital question in understanding the reliability of automated analysis algorithms. In this paper, we evaluated background subtraction algorithm’s performance on videos acquired using a typical surveillance camera under different scenarios. The videos in the dataset are collected from an IP-based surveillance camera and compressed using different bitrates and quantization levels. The experimental results provide insights on the different compression settings and their impact on the expected performance of background subtraction algorithms. Furthermore, we train a classifier that utilizes video quality to predict the performance of an algorithm.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aqqa, M., Mantini, P., Shah, S.K.: Understanding how video quality affects object detection algorithms. In: 14th International Conference on Computer Vision Theory and Applications VISAPP (2019)
Barnich, O., Van Droogenbroeck, M.: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20(6), 1709–1724 (2011)
Bradski, G.: Computer vision face tracking as a component of a perceptural user interface. In: Proceedings of the IEEE Workshop Applications of Computer Vision, pp. 214–219 (1998)
Brandão, T., Queluz, M.P.: No-reference quality assessment of H.264/AVC encoded video. IEEE Trans. Circ. Syst. Video Technol. 20(11), 1437–1447 (2010)
Chaabouni, A., Gaudeau, Y., Lambert, J., Moureaux, J.M., Gallet, P.: Subjective and objective quality assessment for H264 compressed medical video sequences. In: 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1–5. IEEE (2014)
Choi, M.G., Jung, J.H., Jeon, J.W.: No-reference image quality assessment using blur and noise. Int. J. Comput. Sci. Eng. 3(2), 76–80 (2009)
Cozzolino, A., Flammini, F., Galli, V., Lamberti, M., Poggi, G., Pragliola, C.: Evaluating the effects of MJPEG compression on motion tracking in metro railway surveillance. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P., Zemčík, P. (eds.) ACIVS 2012. LNCS, vol. 7517, pp. 142–154. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33140-4_13
Delac, K., Grgic, M., Grgic, S.: Effects of JPEG and JPEG2000 compression on face recognition. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds.) ICAPR 2005. LNCS, vol. 3687, pp. 136–145. Springer, Heidelberg (2005). https://doi.org/10.1007/11552499_16
Dosselmann, R., Yang, X.D.: A prototype no-reference video quality system. In: Fourth Canadian Conference on Computer and Robot Vision, pp. 411–417. IEEE (2007)
Farias, M.C., Mitra, S.K.: No-reference video quality metric based on artifact measurements. In: IEEE International Conference on Image Processing, ICIP 2005, vol. 3, pp. III–141. IEEE (2005)
Hofmann, M., Tiefenbacher, P., Rigoll, G.: Background segmentation with feedback: the pixel-based adaptive segmenter. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 38–43. IEEE (2012)
Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In: Workshop on faces in ‘Real-Life’ Images: Detection, Alignment, and Recognition (2008)
Khan, A., Sun, L., Ifeachor, E.: Impact of video content on video quality for video over wireless networks. In: Fifth International Conference on Autonomic and Autonomous Systems, ICAS 2009, pp. 277–282. IEEE (2009)
Klare, B., Burge, M.: Assessment of H.264 video compression on automated face recognition performance in surveillance and mobile video scenarios. In: Biometric Technology for Human Identification VII, vol. 7667, p. 76670X. International Society for Optics and Photonics (2010)
Korshunov, P., Ooi, W.T.: Critical video quality for distributed automated video surveillance. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, pp. 151–160. ACM (2005)
Korshunov, P., Ooi, W.T.: Video quality for face detection, recognition, and tracking. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 7(3), 14 (2011)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Regularized discriminant analysis for the small sample size problem in face recognition. Pattern Recogn. Lett. 24(16), 3079–3087 (2003)
Romaniak, P., Janowski, L., Leszczuk, M., Papir, Z.: Perceptual quality assessment for H.264/AVC compression. In: 2012 IEEE Consumer Communications and Networking Conference (CCNC), pp. 597–602. IEEE (2012)
Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1), 23–38 (1998)
Saravanakumar, S., Vadivel, A., Ahmed, C.S.: Multiple human object tracking using background subtraction and shadow removal techniques. In: 2010 International Conference on Signal and Image Processing, pp. 79–84. IEEE (2010)
Sobral, A.: BGSLibrary: an OpenCV C++ background subtraction library. In: IX Workshop de Visão Computacional (WVC 2013), Rio de Janeiro, Brazil, June 2013. https://github.com/andrewssobral/bgslibrary
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Sig. Process. Image Commun. 19(2), 121–132 (2004)
Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 7, 780–785 (1997)
Acknowledgment
This work was performed in part through the financial assistance award, Multi-tiered Video Analytics for Abnormality Detection and Alerting to Improve Response Time for First Responder Communications and Operations (Grant No. 60NANB17D178), from U.S. Department of Commerce, National Institute of Standards and Technology.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Beniwal, P., Mantini, P., Shah, S.K. (2020). Assessing the Impact of Video Compression on Background Subtraction. In: Palaiahnakote, S., Sanniti di Baja, G., Wang, L., Yan, W. (eds) Pattern Recognition. ACPR 2019. Lecture Notes in Computer Science(), vol 12046. Springer, Cham. https://doi.org/10.1007/978-3-030-41404-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-41404-7_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41403-0
Online ISBN: 978-3-030-41404-7
eBook Packages: Computer ScienceComputer Science (R0)