Advertisement

3D-HEVC Neighboring Block Based Disparity Vector (NBDV) Derivation Architecture: Complexity and Implementation Analysis

  • Waqar AhmadEmail author
  • Naveed Khan Baloch
  • Fawad Hussain
  • Muhammad Asif Khan
  • Maurizio Martina
Conference paper
  • 12 Downloads
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 627)

Abstract

HEVC (High Efficiency Video Coding), the state-of-the-art video coding standard has 3D extension known as 3D-HEVC, which is established by JCT-3V. In current design of 3D-HEVC, to exploit the redundancies of the 3D video signal, various tools are integrated. In 3D-HEVC, the neighboring block disparity vector (NBDV) mode is used to replace the original predicted depth map (PDM) for inter-view motion prediction. A new estimated disparity vector depth oriented neighboring block disparity vector (DoNBDV) is used to enhance the accuracy of the NBDV by utilizing the coded depth map. In this paper, the complexity and implementation analysis of the NBDV and DoNBDV architectures are analyzed in terms of performance, complexity, and other design considerations. It is hence concluded that NBDV and DoNBDV for 3D-HEVC video signals provide attractive coding gains with comparable complexity as traditional motion/disparity compensation.

References

  1. 1.
    Tanimoto M (2006) Overview of free viewpoint television. Signal Process Image Commun 21(6):454–461Google Scholar
  2. 2.
    Vetro A, Matusik W, Pfister H, Xin J (2016) Coding approaches for end-to-end 3D TV systems. In: Proceedings of the 23rd picture coding symposium (PCS’04), San Francisco, California, USA, Dec 2004, pp 319–324 Google Scholar
  3. 3.
    Urey H, Chellappan KV, Erden E, Surman P (2011) State of the art in stereoscopic and autostereoscopic displays. Proc IEEE 99(4). https://doi.org/10.1109/JPROC.2010.2098351
  4. 4.
    Dodgson NA (2005) Autostereoscopic 3D displays. IEEE Comput 38(8):31–36CrossRefGoogle Scholar
  5. 5.
    Fehn C (2004) Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Proceedings of SPIE, stereoscopic displays and virtual reality systems XI, vol 5291, May 2004, p 93Google Scholar
  6. 6.
    Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47(1):7–42CrossRefGoogle Scholar
  7. 7.
    Foix S, Alenya G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. IEEE Sensors J 11(9):1917–1926ADSCrossRefGoogle Scholar
  8. 8.
    Salvi J, Pagès J, Batlle J (2004) Pattern codification strategies in structured light systems. Pattern Recognit 37(4):827–849CrossRefGoogle Scholar
  9. 9.
    Call for proposals on 3D video coding technology, N12036, MPEG of ISO/IEC JTC1/SC29/WG11, Geneva, Switzerland, Mar 2011Google Scholar
  10. 10.
    Kauff P, Atzpadin N, Fehn C, Müller M, Schreer O, Smolic A, Tanger R (2007) Depth map creation and image based rendering for advanced 3DTV services providing interoperability and scalability. Signal Processing: Image Communication. Special Issue on 3DTV, Feb 2007Google Scholar
  11. 11.
    Advanced video coding for generic audiovisual services, Rec. ITU-T H.264 and ISO/IEC 14496-10 (MPEG-4 AVC), 2012Google Scholar
  12. 12.
    High efficiency video coding, Rec. ITU-T H.265 and ISO/IEC 23008-2, Jan 2013Google Scholar
  13. 13.
    Sullivan GJ, Ohm J-R, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668CrossRefGoogle Scholar
  14. 14.
    Hannuksela MM, Chen Y, Suzuki T, Ohm J-R, Sullivan G (2013) 3D-AVC draft text 8. Presented at the 6th meeting joint collaborative team on 3D video coding extension development, Geneva, Switzerland, 25 Oct–1 Nov, 2013, Doc. JCT3V-F1002Google Scholar
  15. 15.
    Tech G, Wegner K, Chen Y, Yea S (2013) 3D-HEVC Draft Text 2. Presented at the 6th meeting joint collaborative team on 3D video coding extension development, Geneva, Switzerland, 25 Oct–1 Nov 2013, Doc. JCT3V-F1001Google Scholar
  16. 16.
    Applications and requirements on 3D video coding, N12035, MPEG of ISO/IEC JTC1/SC29/WG11, Geneva, Switzerland, Mar 2011Google Scholar
  17. 17.
    Schwarz H, Wiegand T (2012) Inter-view prediction of motion data in multiview video coding. In: Proceedings of picture coding symposium, May 2012, pp 101–104Google Scholar
  18. 18.
    Zhang L, Chen Y, Karczewicz M (2012) CE5.h: disparity vector generation results. Presented at the 1st meeting joint collaborative team on 3D video coding extension development, Stockholm, Sweden, 16–20 July 2012, Doc. JCT3V-A0097Google Scholar
  19. 19.
    Zhang L, Chen Y, Karczewicz M (2013) Disparity vector based advanced inter-view prediction in 3D-HEVC. In: Proceedings of IEEE international symposium circuits system, May 2013, pp 1632–1635Google Scholar
  20. 20.
    Tech G, Müller K, Ohm J-R, Vetro A, Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans Circuits Syst Video Technol 26(1)Google Scholar
  21. 21.
    Chen Y et al (2014) Test model 10 of 3D-HEVC and MV-HEVC. Joint collaborative team on 3D video coding extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JCT3V-J1003. 10th meeting, StrasbourgGoogle Scholar
  22. 22.
    Gerhard Tech et al (2012) 3D-HEVC Test Model 1. Joint collaborative team on 3D video coding extension development of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCT3V-A1005, July 2012, StockholmGoogle Scholar
  23. 23.
    Ahmad W et al (2016) High level synthesis based FPGA implementation of H. 264/AVC sub-pixel luma interpolation filters. In: Modelling symposium (EMS), 2016, European. IEEEGoogle Scholar
  24. 24.
    Ahmad W, Martina M, Masera G (2015) Complexity and implementation analysis of synthesized view distortion estimation architecture in 3D High Efficiency Video Coding. In: 2015 International conference on 3D imaging (IC3D). IEEEGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Waqar Ahmad
    • 1
    Email author
  • Naveed Khan Baloch
    • 1
  • Fawad Hussain
    • 1
  • Muhammad Asif Khan
    • 1
  • Maurizio Martina
    • 2
  1. 1.University of Engineering and Technology TaxilaTaxilaPakistan
  2. 2.Politecnico di TorinoTurinItaly

Personalised recommendations