Skip to main content

Quality Assessment of Virtual Reality Videos

  • Conference paper
  • First Online:
Digital TV and Multimedia Communication (IFTC 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1009))

  • 924 Accesses

Abstract

360-degree spherical images/videos, also called virtual reality (VR) images/videos, can provide an immersive experience of real scenes in some specific systems. This makes it widely used in VR games, sporting events and VR movies. However, due to its high resolution, it is so difficult to transmit, compress or store VR images/videos. Therefore, it is significant to study how noise affects the quality of VR images. To this end, this paper builds a VR video database, and carries out subjective and objective experiments on them. Specifically, first, six standard panoramic videos are processed by inputting three kinds of distorted types to establish a VR video database which comprises 96 videos. Second, we utilize the Double Stimulus Injury Scale (DSIS) for subjective experiments. All subjective scores are from 20 non-professional viewers. Third, we utilize 6 existing objective metrics to validate our database. Finally, experimental results demonstrate that the established VR database is suitable for subjective and objective quality evaluation of VR video. Our work has alleviated the problem of missing VR databases.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. HTC Valve (2018). https://www.vive.com/us/product/vive-virtual-reality-system/

  2. Oculus Rift (2018). https://www.oculus.com/rift/#oui-csl-rift-games=mages-tale/

  3. Sheikh, H.R., Wang, Z., Cormack, L., Bovik, A.C.: Live image quality assessment database release 2 (2005)

    Google Scholar 

  4. Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F.: Tid 2008-a database for evaluation of full-reference visual quality assessment metrics. Adv. Mod. Radioelectron. 10(4), 30–45 (2009)

    Google Scholar 

  5. Larson, E.C., Chandler, D.M.: Categorical image quality (CSIQ) database (2010). http://vision.okstate.edu/csiq

  6. Sun, W., Gu, K., Zhai, G.G.: Subjective quality evaluation of compressed virtual reality images. In: ICIP (2017)

    Google Scholar 

  7. Zhang, B., Zhao, J.Z., Yang, S., Zhang, Y.: Subjective and objective quality assessment of panoramic videos in virtual reality environments. In: Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW) (2017)

    Google Scholar 

  8. Beijing Institute of Technology, Study of a subjective quality evaluation methodology on panoramic video based on SAMVIQ. IEEE 1857.9 (2016)

    Google Scholar 

  9. Yue, G.H., Hou, C.P., Gu, K.: Subjective quality assessment of animation images. In: VCIP (2017)

    Google Scholar 

  10. ITU-R BT Recommendation, The subjective evaluation method of television image quality, ITU Telecom. Standardization Sector of ITU (2012)

    Google Scholar 

  11. I.-R. R. BT.500-11, Methodology for the subjective assessment of the quality of television pictures (2002)

    Google Scholar 

  12. Fang, Y., Yan, J., Liu, J., Wang, S., Li, Q., Guo, Z.: Objective quality assessment of screen content images by structure information. In: Chen, E., Gong, Y., Tie, Y. (eds.) PCM 2016. LNCS, vol. 9917, pp. 609–616. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48896-7_60

    Chapter  Google Scholar 

  13. Gu, K., Zhai, G.G., Lin, W.S., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016)

    Article  Google Scholar 

  14. Mittal, A., Moorthy, A.K., Bovik, A.C.: Noreference image quality assessment in the spatial domain. IEEE TIP 21(12), 4695–4708 (2012)

    MATH  Google Scholar 

  15. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE TIP 13(4), 600–612 (2004)

    Google Scholar 

  16. Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: Proceedings of IEEE 37th Asilomar Conference Signals Systems & Computers, Pacific Grove, CA, USA, November 2003, pp. 1398–1402 (2003)

    Google Scholar 

  17. Xue, W.F., Zhang, L., Mou, X.Q., Bovik, A.C.: Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE TIP 23(2), 684–695 (2014)

    MathSciNet  MATH  Google Scholar 

  18. Hore, A., Ziou, D.: Image quality metrics: PSNR vs SSIM. In: ICPR pp. 2366–2369 (2010)

    Google Scholar 

  19. Zhang, L., Zhang, L., Mou, X.Q., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE TIP 20(8), 2378–2386 (2011)

    MathSciNet  MATH  Google Scholar 

  20. Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19(1), 011006-1–011006-21 (2010)

    Article  Google Scholar 

  21. Pearson, K.: Note on regression and inheritance in the case of two parents. Proc. R. Soc. Lond. 58, 240–242 (1895)

    Article  Google Scholar 

  22. Yang, J.C., Lin, Y.C., Gao, Z.Q., Lv, Z.H., Wei, W., Song, H.B.: Quality index for stereoscopic images by separately evaluating adding and subtracting. PLoS ONE 10(12), e0145800 (2015)

    Article  Google Scholar 

  23. Kim, S.J., Chae, C.B., Lee, J.S.: Subjective and objective quality assessment of videos in error-prone network environments. Multimed. Tools Appl. 75(12), 6849–6870 (2016)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported in part by the National Natural Science Foundation of China, under Grants 61571285, and Shanghai Science and Technology Commission under Grant 17DZ2292400 and 18XD1423900.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ping An .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, P., An, P., Ma, J. (2019). Quality Assessment of Virtual Reality Videos. In: Zhai, G., Zhou, J., An, P., Yang, X. (eds) Digital TV and Multimedia Communication. IFTC 2018. Communications in Computer and Information Science, vol 1009. Springer, Singapore. https://doi.org/10.1007/978-981-13-8138-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-8138-6_23

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-8137-9

  • Online ISBN: 978-981-13-8138-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics