Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 1, pp 1081–1101 | Cite as

An efficient coding algorithm for 360-degree video based on improved adaptive QP Compensation and early CU partition termination

  • Mengmeng ZhangEmail author
  • Jing Zhang
  • Zhi Liu
  • Changzhi An
Article
  • 76 Downloads

Abstract

Virtual reality technology enables people to experience the video content immersively. In order to provide realistic presence and dynamic view, the virtual reality video requires higher resolution (4 K or 8 K) image and more data to display relative to traditional video. Therefore, to improve the coding efficiency of 360-degree video becomes a key consideration. In the coding of 360-degree video, the spherical image is projected to a 2D image (such as ERP projection) and the standard video coding framework is utilized to accomplish the rest work. However, such a projection introduces much different levels of distortion according to coordinates, which degrades performance of rate distortion optimization in video encoding process. In this paper, we propose a compression optimization algorithm by using adaptive QP compensation based on coordinates to improve compression efficiency, and utilizing early termination of CU partition based on spatial correlation to reduce encoding time. To further reduce encoding complexity, the prewitt operator and the adaptive mode selection are adopted to reduce unnecessary intra prediction modes. Experimental results show that compared with HM-16.16, the proposed algorithm can reduce time by 42.4%, increase WSPSNR by 0.03 and decrease BD-rate by 0.3%.

Keywords

360-degree video encoding CU partition Mode selection Adaptive QP compensation 

Notes

Acknowledgements

This work is supported by the National Natural Science Foundation of China (No.61370111), Beijing Municipal Natural Science Foundation (No.4172020), Great Wall Scholar Project of Beijing Municipal Education Commission (CIT&TCD20180304), Beijing Youth Talent Project (CIT&TCD 201504001), and Beijing Municipal Education Commission General Program (KM201610009003).

References

  1. 1.
    A Abbas, B Adsumilli (2016) (GoPro), "New GoPro Test Sequences for Virtual Reality Video Coding", Joint Video Exploration Team of lTU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JVET-D0026 ChengduGoogle Scholar
  2. 2.
    E Alshina, J Boyce, A Abbas, Y Ye (2017) (editors), "JVET common test conditions and evaluation procedures for 360° video", Joint Video Exploration Team of lTU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JVET-H1030 MacauGoogle Scholar
  3. 3.
    E Asbun, Y He, Y He, Y Ye (2016) (InterDigital), AHG8: InterDigital Test Sequences for Virtual Reality Video Coding. Joint Video Exploration Team of lTU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JVET-D0039 ChengduGoogle Scholar
  4. 4.
    Bai C, Yuan C (2014) Fast coding tree unit decision for HEVC intra coding[C]// Icce-China Workshop. IEEE 28–31Google Scholar
  5. 5.
    Chen ZY, Chang PC (2016) Rough mode cost–based fast intra coding for high-efficiency video coding[J]. J Vis Commun Image Represent 43:77–88CrossRefGoogle Scholar
  6. 6.
    Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding[J]. IEEE transactions on Circuits & Systems for video. Technology 23(9):1555–1564Google Scholar
  7. 7.
    K Choi, E Alshina, C Kim (2016) (Samsung), "AHG5: Fast encoding setting for JEM", Joint Video Exploration Team of lTU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JVET-D0053 ChengduGoogle Scholar
  8. 8.
    Goswami K, Kim BG, Jun D et al (2014) Early coding unit-splitting termination algorithm for high efficiency video coding (HEVC)[J]. ETRI J 36(3):407–417CrossRefGoogle Scholar
  9. 9.
    Gu J, Tang M, Wen J, et al. (2017) Adaptive Intra Candidate Selection with Early Depth Decision for Fast Intra Prediction In HEVC[J]. IEEE Sign Proc Lett (99): 1–1Google Scholar
  10. 10.
    Hu J, He G, Li Y (2016) Fast algorithm based on the sole- and multi-depth texture measurements for HEVC intra coding[J]. J Vis Commun Image Represent 40:671–681CrossRefGoogle Scholar
  11. 11.
    Kim BG (2017) Fast coding unit (CU) determination algorithm for high-efficiency video coding (HEVC) in smart surveillance application[M]. Kluwer Academic PublishersGoogle Scholar
  12. 12.
    Lee D, Jeong J (2017) Fast intra coding unit decision for high efficiency video coding based on statistical information[J]. Signal processing image. Communication 55:121–129Google Scholar
  13. 13.
    Lee J, Kim S, Lim K et al (2015) A fast CU size decision algorithm for HEVC[J]. Circuit Syst Video Technol IEEE Trans 25(3):411–421CrossRefGoogle Scholar
  14. 14.
    Y Li, J Xu, Z Chen (2017) Spherical domain rate-distortion optimization for 360 video coding. IEEE Int Conf Multimed Expo (ICME), Hong Kong 709–714Google Scholar
  15. 15.
    Liu X, Liu Y, Wang P, et al. (2016) An Adaptive Mode Decision Algorithm Based on Video Texture Characteristics for HEVC Intra Prediction[J]. IEEE Trans Circuit Syst Video Technol (99): 1–1Google Scholar
  16. 16.
    Min B, Cheung RCCA (2015) Fast CU size decision algorithm for the HEVC intra encoder[J]. IEEE transactions on Circuits & Systems for video. Technology 25(5):892–896Google Scholar
  17. 17.
    Nishikori T, Nakamura T, Yoshitome T, et al. (2014) A fast CU decision using image variance in HEVC intra coding[C]// Industrial Electronics and Applications. IEEE 52–56Google Scholar
  18. 18.
    Ohm JR, Sullivan GJ, Tan TK et al (2013) Comparison of the coding efficiency of video coding standards—including high efficiency video coding (HEVC)[J]. IEEE transactions on Circuits & Systems for video. Technology 22(12):1669–1684Google Scholar
  19. 19.
    Ruiz D, Fernández-Escribano G, Martínez JL et al (2016) Fast intra mode decision algorithm based on texture orientation detection in HEVC[J]. Signal Process Image Commun 44(C):12–28CrossRefGoogle Scholar
  20. 20.
    Shen L, Liu Z, Zhang X et al (2013) An effective CU size decision method for HEVC encoders[J]. IEEE Trans Multimed 15(2):465–470CrossRefGoogle Scholar
  21. 21.
    Shen L, Zhang Z, Liu Z (2014) Effective CU size decision for HEVC intracoding[J]. IEEE transactions on image processing a publication of the IEEE signal processing Society 23(10):4232MathSciNetCrossRefGoogle Scholar
  22. 22.
    Sullivan GJ, Ohm JR, Han WJ et al (2012) Overview of the high efficiency video coding (HEVC) standard[J]. IEEE transactions on Circuits & Systems for video Technology 22(12):1649–1668CrossRefGoogle Scholar
  23. 23.
    Y Sun, A Lu, L Yu (2016) AHG8: WS-PSNR for 360 video objective qualityevaluation. Joint Video Exploration Team of lTU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JVET-D0040 ChengduGoogle Scholar
  24. 24.
    HTT Tran, NP Ngoc, CM Bui, MH Pham, TC Thang (2017) An evaluation of quality metrics for 360 videos. 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN), Milan, , pp. 7–11Google Scholar
  25. 25.
    Tseng CF, Lai YT (2016) Fast coding unit decision and mode selection for intra-frame coding in high-efficiency video coding[J]. IET Image Process 10(3):215–221CrossRefGoogle Scholar
  26. 26.
    Wang T, Men Y, Zhang Y, et al. (2017) A fast intra-prediction decision algorithm in inter-frame based on a novel feature of HEVC[C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE 1532–1536Google Scholar
  27. 27.
    Yang M, Grecos C (2014) Fast intra encoding decisions for high efficiency video coding standard[J]. J Real-Time Image Proc 1–10Google Scholar
  28. 28.
    Zhang H, Ma Z (2014) Fast intra mode decision for high efficiency video coding (HEVC)[J]. IEEE transactions on Circuits & Systems for video Technology 24(4):660–668CrossRefGoogle Scholar
  29. 29.
    Zhang M, Zhao C, Xu J (2012) An adaptive fast intra mode decision in HEVC[C]// IEEE International Conference on Image Processing. IEEE 221–224Google Scholar
  30. 30.
    Zhang M, Bai H, Lin C, et al. (2015) Texture Characteristics Based Fast Coding Unit Partition in HEVC Intra Coding[C]// Data Compression Conference. IEEE 477–477Google Scholar
  31. 31.
    Zhang T, Sun MT, Zhao D et al. (2016) Fast Intra Mode and CU Size Decision for HEVC[J]. IEEE Trans Circuits Syst Video Technol (99):1–1Google Scholar
  32. 32.
    Zhu S, Zhang C (2016) A fast algorithm of intra prediction modes pruning for HEVC based on decision trees and a new three-step search[J]. Multimed Tools Appl 76(20):1–22Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Mengmeng Zhang
    • 1
    Email author
  • Jing Zhang
    • 1
  • Zhi Liu
    • 1
  • Changzhi An
    • 2
  1. 1.North China University of TechnologyBeijingChina
  2. 2.Beijing China Electronic IntelligentCommunication Technology Co., Ltd.BeijingChina

Personalised recommendations