Abstract
In the modern world, where multimedia is predicted to form 86% of traffic transmitted over the telecommunication networks in the near future, content providers are looking to shift towards Quality of Experience, rather than Quality of Service in multimedia delivery. Thus, no-reference image quality assessment and the related video quality assessment remaining open research problem, with significant market potential. In this paper we describe a study focused on evaluating the applicability of Local Binary Patterns (LBP) as features and neural networks as estimators for image quality assessment. We focus on blockiness artifacts, as a prominent effect in all block-based coding approaches and the dominant artifact in occurring in videos coded with state-of-the-art video codecs (MPEG-4, H.264, HVEC). In this initial study we show how an LBP-inspired approach, tuned to this particular effect, can be efficiently used to predict the MOS of JPEG coded images. The proposed approach is evaluated on a well-known public database and against widely-used features. The results presented in the paper show that the approach achieves superior performance, which forms a sound basis for future research aimed at video quality assessment and precise blocking artifact detection with sub-frame precision.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)
Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools (2000)
Culibrk, D., Mirkovic, M., Zlokolica, V., Pokric, M., Crnojevic, V., Kukolj, D.: Salient Motion Features for Video Quality Assessment. IEEE Trans. on Image Processing 20, 948–958 (2010)
Dennis, J.E., Schnabel, R.B.: Numerical methods for unconstrained optimization and nonlinear equations. Society for Industrial and Applied Mathematics, vol. 16 (1987)
Ferzli, R., Karam, L.: A no-reference objective image sharpness metric based on just-noticeable blur and probability summation. In: Proceedings of IEEE 2007 International Conference on Image Processing 3, October 16-19, pp. III–445–III–448 (2007)
Haykin, S.: Neural Networks: A Comprehensive Foundation. Macmillan, New York (1994)
Index, C.: Forecast and methodology, 2011-2016. White paper, CISCO (December 2012)
ITU-R BT.500: Methodology for the Subjective Assessment of the Quality of Television Pictures. Video Quality Experts Group (2002)
Kirenko, I.: Reduction of coding artifacts using chrominance and luminance spatial analysis. In: International Conference on Consumer Electronics, ICCE 2006. 2006 Digest of Technical Papers, pp. 209–210 (January 2006)
Mäenpää, T.: The Local Binary Pattern Approach to Texture Analysis: Extenxions and Applications. Oulun yliopisto (2003)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(7), 971–987 (2002)
Seshadrinathan, K., Bovik, A.C.: An information theoretic video quality metric based on motion models. In: Third International Workshop on Video Processing and Quality Metrics for Consumer Electronics, pp. 25–26. Citeseer (2007)
Seshadrinathan, K., Soundararajan, R., Bovik, A., Cormack, L.: Study of subjective and objective quality assessment of video. IEEE Transactions on Image Processing 19(6), 1427–1441 (2010)
Seshadrinathan, K., Soundararajan, R., Bovik, A., Cormack, L.: A subjective study to evaluate video quality assessment algorithms. In: SPIE Proceedings Human Vision and Electronic Imaging, vol. 7527. Citeseer (2010)
Wang, X., Han, T., Yan, S.: An hog-lbp human detector with partial occlusion handling. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 32–39. IEEE (2009)
Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of jpeg compressed images. In: Proceedings of IEEE 2002 International Conferencing on Image Processing, pp. 477–480 (2002)
Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann, San Francisco (2005)
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 915–928 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Panić, M., Ćulibrk, D., Sladojević, S., Crnojević, V. (2013). Local Binary Patterns and Neural Networks for No-Reference Image and Video Quality Assessment. In: Iliadis, L., Papadopoulos, H., Jayne, C. (eds) Engineering Applications of Neural Networks. EANN 2013. Communications in Computer and Information Science, vol 383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41013-0_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-41013-0_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41012-3
Online ISBN: 978-3-642-41013-0
eBook Packages: Computer ScienceComputer Science (R0)