A Just Noticeable Difference-Based Video Quality Assessment Method with Low Computational Complexity
A Just Noticeable Difference (JND)-based video quality assessment (VQA) method is proposed. This method, termed as JVQ, applies JND concept to structural similarity (SSIM) index to measure the spatial quality. JVQ incorporates three features, i.e. luminance adaptation, contrast masking, and texture masking. In JVQ, the concept of JND is refined and more features are considered. For the spatial part, minor distortions in the distorted frames are ignored and considered imperceptible. For the temporal part, SSIM index is simplified and used to measure the temporal video quality. Then, a similar JND concept which comprises of temporal masking is also applied in the temporal quality evaluation. Pixels with large variation over time are considered as not distorted because the distortions in these pixels are hardly perceivable. The final JVQ index is the arithmetic mean of both spatial and temporal quality indices. JVQ is found to achieve good correlation with subjective scores. In addition, this method has low computational cost as compared to existing state-of-the-art metrics.
KeywordsVideo quality Just noticeable difference Temporal Computational complexity
This work was supported by Ministry of Education Malaysia through the provision of Fundamental Research Grant Scheme, Grant Number F02/FRGS/1492/2016.
- 2.Chen, Z., & Liu, H. (2014). JND modeling: Approaches and applications. In 2014 19th International conference on digital signal processing (DSP) (pp. 827–830). IEEE. https://doi.org/10.1109/icdsp.2014.6900782.
- 4.Wang, Z., Simon, S., Baroud, Y., & Najmabadi, S. M. (2015). Visually lossless image compression extension for JPEG based on just-noticeable distortion evaluation. In 2015 International conference on systems, signals and image processing (IWSSIP) (pp. 237–240). IEEE. https://doi.org/10.1109/iwssip.2015.7314220.
- 6.Shang, X., Wang, Y., Luo, L., & Zhang, Z. (2013). Perceptual multiview video coding based on foveated just noticeable distortion profile in DCT domain. In 2013 20th IEEE international conference on image processing (ICIP) (pp. 1914–1917). IEEE. https://doi.org/10.1109/icip.2013.6738394.
- 7.Zheng, M., Su, K., Wang, W., Lan, C., & Yang, X. (2013). Enhanced subband JND model with textural image. In 2013 IEEE international conference on signal processing, communication and computing (ICSPCC) (pp. 1–4). IEEE. https://doi.org/10.1109/icspcc.2013.6663953.
- 8.Ma, L., Zhang, F., Li, S., & Ngan, K. N. (2010). Video quality assessment based on adaptive block-size transform just-noticeable difference model. In 2010 17th IEEE international conference on image processing (ICIP), (pp. 2501–2504). IEEE. https://doi.org/10.1109/icip.2010.5649188.
- 19.Loh, W. T., & Bong, D. B. L. (2016). Temporal video quality assessment method involving structural similarity index. In 2016 IEEE international conference on consumer electronics-Taiwan (ICCE-TW) (pp. 1–2). IEEE. https://doi.org/10.1109/icce-tw.2016.7520921.
- 21.Vu, C., & Deshpande, S. (2012). ViMSSIM: From image to video quality assessment. In Proceedings of the 4th workshop on mobile video (pp. 1-6). ACM. https://doi.org/10.1145/2151677.2151679.
- 22.Cardoso, J. V. M., Alencar, M. S., Regis, C. D. M., & Oliveira, Í. P. (2014). Temporal analysis and perceptual weighting for objective video quality measurement. In 2014 IEEE southwest symposium on image analysis and interpretation (SSIAI) (pp. 57–60). IEEE. https://doi.org/10.1109/ssiai.2014.6806028.
- 23.Oliveira, Í. P., Cardoso, J. V. M., Regis, C. D. M., & Alencar, M. S. (2013). Spatial and temporal analysis considering relevant regions applied to video quality assessment. In XXXI Brazilian telecommunications symposium (SBrT2013) (pp. 1–4). SBrT. https://doi.org/10.14209/sbrt.2013.222.
- 25.Sheikh, H. R., Wang, Z., Cormack, L., & Bovik, A. C. (2005). LIVE image quality assessment database release 2. Laboratory for Image and Video Engineering (LIVE) at The University of Texas at Austin. http://live.ece.utexas.edu/research/quality. Accessed 28 September 2016.
- 27.Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., & Chen, C. W. (2017). Blind quality assessment based on pseudo reference image. IEEE Transactions on Multimedia. PP(99), 1–14. https://doi.org/10.1109/tmm.2017.2788206.
- 30.Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2003). Multiscale structural similarity for image quality assessment. In signals, systems and computers, 2004. Conference record of the thirty-seventh asilomar conference on (Vol. 2, pp. 1398–1402). IEEE. https://doi.org/10.1109/acssc.2003.1292216.
- 33.Mitchell, J. L., Pennebaker, W. B., Fogg, C. E., & LeGall, D. J. (1996). Aspects of visual perception. In MPEG video: Compression standard (pp. 51–80). USA: Kluwer Academic Publishers. https://doi.org/10.1007/b115884.
- 34.Girod. B. (1989). the information theoretical significance of spatial and temporal masking in video signals. In Proceeding SPIE 1077, human vision, visual processing, and digital display (pp. 178–187). SPIE. https://doi.org/10.1117/12.952716.
- 37.Hands, D. S. (1997). Mental processes in the evaluation of digitally-coded television pictures. Doctoral dissertation, University of Essex, Essex, England.Google Scholar
- 38.Wandell, B. A. (1995). Foundations of vision. Sunderland, MA: Sinauer Associates.Google Scholar
- 40.Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010). A subjective study to evaluate video quality assessment algorithms. In Human vision and electronic imaging (pp. 75270H–75270H). https://doi.org/10.1117/12.845382.
- 42.Zhang, F., Li, S., Ma, L., Wong, Y. C., & Ngan, K. N. (2011). IVP subjective quality video database. The Chinese University of Hong Kong. http://ivp.ee.cuhk.edu.hk/research/database/subjective. Accessed 15 January 2016.
- 44.Vu, P. V., Vu, C. T., & Chandler, D. M. (2011). A spatiotemporal most-apparent-distortion model for video quality assessment. In 2011 18th IEEE international conference on image processing (ICIP) (pp. 2505–2508). IEEE. https://doi.org/10.1109/icip.2011.6116171.
- 46.Choi, L. K., & Bovik, A. C. (2016). Flicker sensitive motion tuned video quality assessment. In 2016 IEEE southwest symposium on image analysis and interpretation (SSIAI) (pp. 29–32). IEEE. https://doi.org/10.1109/ssiai.2016.7459167.
- 47.Loh, W. T., & Bong, D. B. L. (2015). Video quality assessment method: MD-SSIM. In 2015 IEEE international conference on consumer electronics-Taiwan (ICCE-TW) (pp. 290–291). IEEE. https://doi.org/10.1109/icce-tw.2015.7216904.
- 48.Video Quality Expert Group. (2003). Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment, phase II (FR-TV2) 2003. Video Quality Expert Group. https://www.itu.int/md/T01-SG09-C-0060. Accessed 4 June 2015.
- 50.Mu, M., Gostner, R., Mauthe, A., Tyson, G., & Garcia, F. (2009). Visibility of individual packet loss on H. 264 encoded video stream: A user study on the impact of packet loss on perceived video quality. In Multimedia computing and networking 2009 (pp. 725302-1–725302-12). SPIE. https://doi.org/10.1117/12.815538.