Skip to main content
SpringerLink
Log in
Book cover

3D-TV System with Depth-Image-Based Rendering pp 3–35Cite as

An Overview of 3D-TV System Using Depth-Image-Based Rendering

  • Chapter
  • First Online:

Abstract

The depth-based 3D system is considered a strong candidate of the second-generation 3D-TV, preceded by the stereoscopic 3D-TV. The data formats involve one or several pairs of coupled texture images and depth maps, often known as image-plus-depth (2D + Z), multi-view video plus depth (MVD), and layered depth video (LDV). With the depth information, novel views at arbitrary viewpoints can be synthesized with a depth-image-based rendering (DIBR) technique. In such a way, the depth-based 3D-TV system can provide stereoscopic pairs with an adjustable baseline or multiple views for autostereoscopic displays. This chapter overviews key technologies involved in this depth-based 3D-TV system, including content generation, data compression and transmission, 3D visualization, and quality evaluation. We will also present some challenges that hamper the commercialization of the depth-based 3D video broadcast. Finally, some international research cooperation and standardization efforts are briefly discussed as well.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Television Invention Timeline Available: http://www.history-timelines.org.uk/events-timelines/08-television-invention-timeline.htm

  2. Ito T (2010) Future television—super hi-vision and beyond. In: Proceedings of IEEE Asian solid-state circuits conference, Nov 2010, Beijing, China, pp 1–4

    Google Scholar 

  3. Kubota A, Smolic A, Magnor M, Tanimoto M, Chen T, Zhang C (2007) Multiview imaging and 3DTV. IEEE Signal Process Mag 24(6):10–21

    Article  Google Scholar 

  4. Onural L (2010) Signal processing and 3DTV. IEEE Signal Process Mag 27(5):142–144

    Article  Google Scholar 

  5. Tanimoto M, Tehrani MP, Fujii T, Yendo T (2011) Free-viewpoint TV. IEEE Signal Process Mag 28(1):67–76

    Article  Google Scholar 

  6. Konrad J, Halle M (2007) 3-D displays and signal processing. IEEE Signal Process Mag 24(7):97–111

    Google Scholar 

  7. Benzie P, Watson J, Surman P, Rakkolainen I, Hopf K, Urey H, Sainov V, von Kopylow C (2007) A survey of 3DTV displays: techniques and technologies. IEEE Trans Circuits Syst Video Technol 17(11):1647–1658

    Article  Google Scholar 

  8. Holliman NS, Dodgson NA, Favalora GE, Pockett L (2011) Three-dimensional displays: a review and applications analysis. IEEE Trans Broadcast 57(2):362–371

    Article  Google Scholar 

  9. Urey H, Chellappan KV, Erden E, Surman P (2011) State of the art in stereoscopic and autostereoscopic displays. Proc IEEE 99(4):540–555

    Article  Google Scholar 

  10. Cho M, Daneshpanah M, Moon I, Javidi B (2011) Three-dimensional optical sensing and visualization using integral imaging. Proc IEEE 99(4):556–575

    Article  Google Scholar 

  11. Onural L, Yaraz F, Kang H (2011) Digital holographic three-dimensional video displays. Proc IEEE 99(4):576–589

    Article  Google Scholar 

  12. Favalora GE (2005) Volumetric 3D displays and application infrastructure. Computer 8(8):37–44

    Article  Google Scholar 

  13. Chen T, Kashiwagi Y (2010) Subjective picture quality evaluation of MVC stereo high profile for full-resolution stereoscopic high-definition 3D video applications. In: Proceedings of IASTED conference signal image processing, Maui, HI, Aug 2010

    Google Scholar 

  14. World Cup 2010 in 3D TV Available: http://www.itu.int/net/itunews/issues/2010/06/54.aspx

  15. Müller K, Merkle P, Wiegand T (2011) 3-D video representation using depth mapdepth maps. Proc IEEE 99(4):643–656

    Article  Google Scholar 

  16. Smolic A, Kauff P, Knorr S, Hornung A, Kunter M, Müller M, Lang M (2011) Three-dimensional video postproduction and processing. Proc IEEE 99(4):607–625

    Article  Google Scholar 

  17. Vetro A, Tourapis AM, Müller K, Chen T (2011) 3D-TV content storage and transmission. IEEE Trans Broadcast 57(2):384–394

    Article  Google Scholar 

  18. Fehn C (2003) A 3D-TV approach using depth-image-based rendering (DIBR). In: Proceedings of visualization, imaging and image processing (VIIP), pp 482–487

    Google Scholar 

  19. Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of stereoscopic displays virtual reality systems XI, San Jose, CA, USA, Jan 2004, pp 93–104

    Google Scholar 

  20. Merkle P, Smolic A, Müller K, Wiegand T (2007) Multi-view video plus depth representation and coding. In: Proceedings of international conference on image processing, pp I-201-I-204

    Google Scholar 

  21. Shade J, Gortler S, He L, Szeliski R (1998) Layered depth images. In: Proceedings of the 25th annual conference on computer graphics and interactive techniques, New York, NY, USA, pp 231–242

    Google Scholar 

  22. Jot JM, Larcher V, Pernaux JM (1999) A comparative study of 3-D audio encoding and rendering techniques. In: Proceedings of 16th AES international conference, Mar 1999

    Google Scholar 

  23. Poletti M (2005) Three-dimensional surround sound systems based on spherical harmonics. J Audio Eng Soc 53(11):1004–1025

    Google Scholar 

  24. Fazi F, Nelson P, Potthast R (2009) Analogies and differences between three methods for soundfield reproduction. In: Proceedings of ambisonics symposium, Graz, Austria, June 2009

    Google Scholar 

  25. Okamoto T, Cui ZL, Iwaya Y, Suzuki Y (2010) Implementation of a high-definition 3D audio-visual display based on higher order ambisonics using a 157-loudspeaker array combined with a 3D projection display. In: Proceedings of international conference on network infrastructure and digital content (IC-NIDC), pp 179–183

    Google Scholar 

  26. André C, Embrechts JJ, Verly JG (2010) Adding 3D sound to 3D cinema: identification and evaluation of different reproduction techniques. In: Proceedings of international conference on audio, language and image processing, Nov 2010, Shanghai, China, pp 130–137

    Google Scholar 

  27. Strohmeier D, Jumisko-Pyykkö S (2008) How does my 3D video sound like?—impact of loudspeaker set-ups on audiovisual quality on mid-sized autostereoscopic display. In: Proceedings of 3DTV conference, pp 73–76

    Google Scholar 

  28. Narayanan PJ, Rander P, Kanade T (1995) Synchronous capture of image sequences from multiple cameras. Technical report CMU-RI-TR-95-25, Robotics Institute, Carnegie Mellon University, Dec 1995

    Google Scholar 

  29. Wilburn B, Joshi N, Vaish V, Talvala E-V, Antunez E, Barth A, Adams A, Levoy M, Horowitz M (2005) High performance imaging using large camera arrays. In: Proceedings of ACM SIGGRAPH, Los Angeles, CA, USA

    Google Scholar 

  30. Smolic A (2011) 3D video and free viewpoint video—from capture to display. Pattern Recognit 44(9):1958–1968

    Article  MathSciNet  Google Scholar 

  31. Owens JD, Luebke D, Govindaraju N, Harris M, Krüger J, Lefohn AE, Purcell T (2007) A survey of general-purpose computation on graphics hardware. Comput Graph Forum 26(1):80–113

    Article  Google Scholar 

  32. Whitted T (1980) An improved illumination model for shaded display. Commun ACM 23(6):343–349

    Article  Google Scholar 

  33. Kanade T, Okutomi M (1994) A stereo matching algorithm with an adaptive window: theory and experiment. IEEE Trans Pattern Anal Mach Intell 16(9):920–932

    Article  Google Scholar 

  34. Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vision 47(1–3):7–42

    Article  MATH  Google Scholar 

  35. Sun J, Zheng N, Shum H (2003) Stereo matching using belief propagation. IEEE Trans Pattern Anal Mach Intell 25(7):787–800

    Article  Google Scholar 

  36. Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124–1137

    Article  Google Scholar 

  37. Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 2(60):91–110

    Article  Google Scholar 

  38. Lange R, Seitz P (2001) Solid-state time-of-flight range camera. IEEE J Quantum Electron 37(3):390–397

    Article  Google Scholar 

  39. Scharstein D, Szeliski R (2003) High-accuracy stereo depth maps using structured light. In: Proceedings of computer vision and pattern recognition, pp 195–202

    Google Scholar 

  40. Yang Q, Yang R, Davis J, Nistér D (2007) Spatial-depth super resolution for range images. In: Proceedings of international conference computer vision and pattern recognition, pp 1–8

    Google Scholar 

  41. Zhu J, Wang L, Yang R, Davis J (2008) Fusion of time-of-flight depth and stereo for high accuracy depth maps. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 231–236, June 2008

    Google Scholar 

  42. Schiller I, Beder C, Koch R (2008) Calibration of a PMD-camera using a planar calibration pattern together with a multi-camera setup. In: Proceedings of the society of photogrammetry and remote sensing, pp 297–302

    Google Scholar 

  43. Bartczak B, Koch R (2009) Dense depth maps from low resolution time-of-flight depth and high resolution color views. In: Proceedings of international symposium on advanced visual computing, pp 228–239

    Google Scholar 

  44. Harman P, Flack J, Fox S, Dowley M (2002) Rapid 2D to 3D conversion. In: Proceedings of SPIE, vol 4660. pp 78–86

    Google Scholar 

  45. Tam WJ, Zhang L (2006) 3D-TV content generation: 2D-to-3D conversion. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Toronto, Canada

    Google Scholar 

  46. Zhang L, Vazquez C, Knorr S (2011) 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans Broadcast 57(2):372–383

    Article  Google Scholar 

  47. Battiato S, Curti S, La Cascia M (2004) Depth map generation by image classification. In: Proceedings of SPIE, vol 5302. pp 95–104

    Google Scholar 

  48. Ens J, Lawrence P (1993) An investigation of methods for determining depth from focus. IEEE Trans Pattern Anal Mach Intell 15(2):97–108

    Article  Google Scholar 

  49. Moustakas K, Tzovaras D, Strintzis MG (2005) Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence. IEEE Trans Circuits Syst Video Technol 15(8):1065–1073

    Article  Google Scholar 

  50. Feng Y, Ren J, Jiang J (2011) Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications. IEEE Trans Broadcast 57(2):500–509

    Article  Google Scholar 

  51. Cheng X, Sun L, Yang S (2007) Generation of layered depth images from multi-view video. In: Proceedings of IEEE international conference on image processing (ICIP’07), San Antonio, TX, USA, vol 5. pp 225–228, Sept 2007

    Google Scholar 

  52. Jantet V, Morin L, Guillemot C (2009) Incremental-LDI for multi-view coding. In: Proceedings of 3DTV conference, Potsdam, Germany, pp 1–4, May 2009

    Google Scholar 

  53. Daribo I, Saito H (2011) A novel inpainting-based layered depth video for 3DTV. IEEE Trans Broadcast 57(2):533–541

    Article  Google Scholar 

  54. Bartczak B et al (2011) Display-independent 3D-TV production and delivery using the layered depth video format. IEEE Trans Broadcast 57(2):477–490

    Article  Google Scholar 

  55. Lou J, Cai H, Li J (2005) A real-time interactive multi-view video system. In: Proceedings of the 13th annual ACM international conference on multimedia, Hilton, Singapore, Nov 2005

    Google Scholar 

  56. Matusik WJ, Pfister H (2004) 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans Graph 23(3):814–824

    Article  Google Scholar 

  57. Cao X, Liu Y, Dai Q (2009) A flexible client-driven 3DTV system for real-time acquisition, transmission, and display of dynamic scenes. EURASIP J Adv Sig Process, vol 2009. Article ID 351452, pp 1–15

    Google Scholar 

  58. Stankowski J, Klimaszewski K, Stankiewicz O, Wegner K, Domanski M (2010) Preprocessing methods used for Poznan 3D/FTV test sequences. ISO/IEC JTC1/SC29/WG11 Doc. M17174, Jan 2010

    Google Scholar 

  59. Yamamoto K, Kitahara M, Kimata H, Yendo T, Fujii T, Tanimoto M, Shimizu S, Kamikura K, Yashima Y (2007) Multiview video coding using view interpolation and color correction. IEEE Trans Circuits Syst Video Technol 17(11):1436–1449

    Article  Google Scholar 

  60. Fecker U, Barkowsky M, Kaup A (2008) Histogram-based prefiltering for luminance and chrominance compensation of multiview video. IEEE Trans Circuits Syst Video Technol 18(9):1258–1267

    Article  Google Scholar 

  61. Doutre C, Nasiopoulos P (2009) Color correction preprocessing for multi-view video coding. IEEE Trans Circuits Syst Video Technol 19(9):1400–1405

    Article  Google Scholar 

  62. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334

    Article  Google Scholar 

  63. Hartley R, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  64. Mendiburu B (2009) 3D movie making: stereoscopic digital cinema from script to screen. Focal Press, Burlington

    Google Scholar 

  65. Varekamp C, Barenbrug B (2007) Improved depth propagation for 2D to 3D video conversion using key-frames. In: Proceedings of 4th IET European conference on visual media production, pp 1–7, Nov 2007

    Google Scholar 

  66. Roth SD (1982) Ray casting for modeling solids. Comput Graph Image Process 18(2):109–144

    Article  Google Scholar 

  67. Frick A, Bartczak B, Koch R (2010) Real-time preview for layered depth video in 3D-TV. In: Proceedings of real-time image and video processing, vol 7724. pp 77240F-1-10

    Google Scholar 

  68. Zhang L, Tam WJ (2005) Stereoscopic image generation based on depth images for 3D TV. IEEE Trans Broadcast 51(2):191–199

    Article  Google Scholar 

  69. Müller K, Smolic A, Dix K, Merkle P, Kauff P, Wiegand T (2008) View synthesis for advanced 3D video systems. EURASIP J Image Video Process, vol 2008. Article ID 438148

    Google Scholar 

  70. Tian D, Lai P, Lopez P, Gomila C (2009) View synthesis techniques for 3D video. In: Proceedings of applications of digital image processing XXXII, vol 7443. pp 74430T-1-11

    Google Scholar 

  71. Mori Y, Fukushima N, Yendo T, Fujii T, Tanimoto M (2009) View generation with 3D warping using depth information for FTV. Sig Process: Image Commun 24(1–2):65–72

    Article  Google Scholar 

  72. Zinger S, Do L, de With PHN (2010) Free-viewpoint depth image based rendering. J Vis Commun Image Represent 21:533–541

    Article  Google Scholar 

  73. Bertalmio M, Bertozzi AL, Sapiro G (2001) Navier-stokes, fluid dynamics, and image and video inpainting. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 355–362

    Google Scholar 

  74. Oh K, Yea S, Ho Y (2009) Hole-filling method using depth based in-painting for view synthesis in free viewpoint television (FTV) and 3D video. In: Picture coding symposium (PCS), Chicago, pp 233–236

    Google Scholar 

  75. Daribo I, Pesquet-Popescu B (2010) Depth-aided image inpainting for novel view synthesis. In: Proceedings of IEEE international workshop on multimedia signal processing (MMSP)

    Google Scholar 

  76. Ndjiki-Nya P, Köppel M, Doshkov D, Lakshman H, Merkle P, Müller K, Wiegand T (2011) Depth image-based rendering with advanced texture synthesis for 3-D video. IEEE Trans Multimedia 13(3):453–465

    Article  Google Scholar 

  77. Schmeing M, Jiang X (2010) Depth image based rendering: a faithful approach for the disocclusion problem. In: Proceedings of 3DTV conference, pp 1–4

    Google Scholar 

  78. Zhao Y, Zhu C, Chen Z, Tian D, Yu L (2011) Boundary artifact reduction in view synthesisview synthesis of 3D video: from perspective of texture-depth alignment. IEEE Trans Broadcast 57(2):510–522

    Article  Google Scholar 

  79. Zhao Y, Yu L (2010) A perceptual metric for evaluating quality of synthesized sequences in 3DV system. In: Proceedings of visual communications and image processing (VCIP), July 2010

    Google Scholar 

  80. Wiegand T, Sullivan GJ, Bjøntegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circuits Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  81. Vetro A, Yea S, Zwicker M, Matusik W, Pfister H (2007) Overview of multiview video coding and anti-aliasing for 3D displays. In: Proceedings of international conference on image processing, vol 1. pp I-17–I-20, Sept 2007

    Google Scholar 

  82. Merkle P, Smolic A, Müller K, Wiegand T (2007) Efficient prediction structures for multiview video coding. IEEE Trans Circuits Syst Video Technol 17(11):1461–1473

    Article  Google Scholar 

  83. Chen Y, Wang Y-K, Ugur K, Hannuksela M, Lainema J, Gabbouj M (2009) The emerging mvc standard for 3D video services. EURASIP J Adv Sig Process 2009(1), Jan 2009

    Google Scholar 

  84. Merkle P, Morvan Y, Smolic A, Farin D, Müller K, de With PHN, Wiegand T (2009) The effects of multiview depth video compression on multiview rendering. Sig Process: Image Commun 24(1–2):73–88

    Article  Google Scholar 

  85. Kim W-S, Ortega A, Lai P, Tian D, Gomila C (2010) Depth map coding with distortion estimation of rendered view. In: Proceedings of SPIE visual information processing and communication, vol 7543. pp 75430B–75430B-10

    Google Scholar 

  86. Tikanmaki A, Gotchev A, Smolic A, Muller K (2008) Quality assessment of 3D video in rate allocation experiments. In: Proceedings of IEEE international symposium on consumer electronics

    Google Scholar 

  87. Kang M-K, Ho Y-S (2010) Adaptive geometry-based intra prediction for depth video coding. In: Proceedings of IEEE international conference on multimedia and expo (ICME), July 2010, pp 1230–1235

    Google Scholar 

  88. Kim W-S, Ortega A, Lai P, Tian D, Gomila C (2009) Depth map distortion analysis for view rendering and depth coding. In: Proceedings of international conference on image processing

    Google Scholar 

  89. Oh K-J, Vetro A, Ho Y-S (2011) Depth coding using a boundary reconstruction filter for 3D video systems. IEEE Trans Circuits Syst Video Technol 21(3):350–359

    Article  Google Scholar 

  90. Zhao Y, Zhu C, Chen Z, Yu L (2011) Depth no-synthesis error model for view synthesis in 3D video. IEEE Trans Image Process 20(8):2221–2228, Aug 2011

    Google Scholar 

  91. Daribo I, Tillier C, Pesquet-Popescu B (2008) Adaptive wavelet coding of the depth map for stereoscopic view synthesis. In: Proceedings of IEEE international workshop on multimedia signal processing (MMSP’08), Cairns, Australia, pp 34–39, Oct 2008

    Google Scholar 

  92. Liu S, Lai P, Tian D, Chen CW (2011) New depth coding techniques with utilization of corresponding video. IEEE Trans Broadcast 57(2):551–561

    Article  Google Scholar 

  93. Shimizu S, Kitahara M, Kimata H, Kamikura K, Yashima Y (2007) View scalable multi-view video coding using 3-D warping with depth map. IEEE Trans Circuits Syst Video Technol 17(11):1485–1495

    Article  Google Scholar 

  94. Yea S, Vetro A (2009) View synthesis prediction for multiview video coding. Sig Process Image Commun 24(1+2):89–100

    Article  Google Scholar 

  95. Lin YH, Wu JL (2011) A depth information based fast mode decision algorithm for color plus depth-map 3D videos. IEEE Trans Broadcast 57(2):542–550

    Article  Google Scholar 

  96. Merkle P, Wang Y, Müller K, Smolic A, Wiegand T (2009) Video plus depth compression for mobile 3D services. In: Proceedings of 3DTV conference

    Google Scholar 

  97. Wang Y, Zhu Q-F (1998) Error control and concealment for video communication: a review. Proc IEEE 86(5):974–997

    Article  Google Scholar 

  98. Wang Y, Wenger S, Wen J, Katsaggelos A (2000) Error resilient video coding techniques. IEEE Signal Process Mag 17(4):61–82

    Article  Google Scholar 

  99. Stockhammer T, Hannuksela M, Wiegand T (2003) H.264/AVC in wireless environments. IEEE Trans Circuits Syst Video Tech 13(7):657–673

    Article  Google Scholar 

  100. Zhang R, Regunathan SL, Rose K (2000) Video coding with optimal inter/intra-mode switching for packet loss resilience. IEEE J Sel Areas Commun 18(6):966–976

    Article  Google Scholar 

  101. Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circuits Syst Video Technol 10(6):659–665

    Article  Google Scholar 

  102. Agrafiotis D, Bull DR, Canagarajah CN (2006) Enhanced error concealment with mode selection. IEEE Trans Circuits Syst Video Technol 16(8):960–973

    Article  Google Scholar 

  103. Xiang X, Zhao D, Wang Q, Ji X, Gao W (2007) A novel error concealment method for stereoscopic video coding. In: Proceedings of international conference on image processing (ICIP2007), pp 101–104

    Google Scholar 

  104. Akar GB, Tekalp AM, Fehn C, Civanlar MR (2007) Transport methods in 3DTV-a survey. IEEE Trans Circuits Syst Video Technol 17(11):1622–1630

    Article  Google Scholar 

  105. Tan AS, Aksay A, Akar GB, Arikan E (2009) Rate-distortion optimization for stereoscopic video streaming with unequal error protection. EURASIP J Adv Sig Process, vol 2009. Article ID 632545, Jan 2009

    Google Scholar 

  106. De Silva DVSX, Fernando WAC, Worrall ST (2010) 3D video communication scheme for error prone environments based on motion vector sharing. In: Proceedings of IEEE 3DTV-CON, Tampere, Finland

    Google Scholar 

  107. Yan B (2007) A novel H.264 based motion vector recovery method for 3D video transmission. IEEE Trans Consum Electron 53(4):1546–1552

    Article  Google Scholar 

  108. Liu Y, Wang J, Zhang H (2010) Depth image-based temporal error concealment for 3-D video transmission. IEEE Trans Circuits Syst Video Technol 20(4):600–604

    Article  Google Scholar 

  109. Chung TY, Sull S, Kim CS (2011) Frame loss concealment for stereoscopic video plus depth sequences. IEEE Trans Consum Electron 57(3):1336–1344

    Article  Google Scholar 

  110. Howard IP, Rogers BJ (1995) Binocular vision and stereopsis. Oxford University Press, Oxford

    Google Scholar 

  111. Yano S, Ide S, Mitsuhashi T, Thwaites H (2002) A study of visual fatigue and visual comfort for 3D HDTV/HDTV images. Displays 23(4):191–201

    Article  Google Scholar 

  112. Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8(3):1–30

    Article  Google Scholar 

  113. Lambooij MTM, IJsselsteijn WA, Fortuin M, Heynderickx I (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53(3):030201-030201-14. May–Jun 2009

    Google Scholar 

  114. Tam WJ, Speranza F, Yano S, Shimono K, Ono H (2011) Stereoscopic 3D-TV: visual comfort. IEEE Trans Broadcast 57(2):335–346

    Article  Google Scholar 

  115. Lang M, Hornung A, Wang O, Poulakos S, Smolic A, Gross M (2010) Nonlinear disparity mapping for stereoscopic 3D. ACM Trans Graph 29(4):75:1–75:10. July 2010

    Google Scholar 

  116. Nojiri Y, Yamanoue H, Ide S, Yano S, Okana F (2006) Parallax distribution and visual comfort on stereoscopic HDTV. In: Proceedings of IBC, pp 373–380

    Google Scholar 

  117. Gunnewiek RK, Vandewalle P (2010) How to display 3D content realistically. In: Proceedings of international workshop video processing quality metrics consumer electronics (VPQM), Jan 2010

    Google Scholar 

  118. Daly SJ, Held RT, Hoffman DM (2011) Perceptual issues in stereoscopic signal processing. IEEE Trans Broadcast 57(2):347–361

    Article  Google Scholar 

  119. Zhao Y, Yu L (2010) A perceptual metric for evaluating quality of synthesized sequences in 3DV system. In: Proceedings of visual communications and image processing (VCIP), July 2010

    Google Scholar 

  120. Yamanoue H, Okui M, Okano F (2006) Geometrical analysis of puppet-theatre and cardboard effects in stereoscopic HDTV images. IEEE Trans Circuits Syst Video Technol 16(6):744–752

    Article  Google Scholar 

  121. Wittlief K (2007) Stereoscopic 3D film and animation—getting it right. Comput Graph 41(3). Aug 2007 Avaliable: http://www.siggraph.org/publications/newsletter/volume/stereoscopic-3d-film-and-animationgetting-it-right

  122. Sheikh HR, Sabir MF, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15(11):3440–3451

    Article  Google Scholar 

  123. Engelke U, Zepernick HJ (2007) Perceptual-based quality metrics for image and video services: a survey. In: 3rd EuroNGI conference on next generation internet networks, pp 190–197

    Google Scholar 

  124. Seshadrinathan K, Soundararajan R, Bovik AC, Cormack LK (2010) Study of subjective and objective quality assessment of video. IEEE Trans Image Process 19(16):1427–1441

    Article  MathSciNet  Google Scholar 

  125. Chikkerur S, Vijay S, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans Broadcast 57(2):165–182

    Article  Google Scholar 

  126. Zhao Y, Yu L, Chen Z, Zhu C (2011) Video quality assessment based on measuring perceptual noise from spatial and temporal perspectives. IEEE Trans Circuits Syst Video Technol 21(12):1890–1902

    Article  Google Scholar 

  127. IJsselsteijn W, de Ridder H, Hamberg R, Bouwhuis D, Freeman J (1998) Perceived depth and the feeling of presence in 3DTV. Displays 18(4):207–214

    Article  Google Scholar 

  128. Yasakethu SLP, Hewage CTER, Fernando WAC, Kondoz AM (2008) Quality analysis for 3D video using 2D video quality models. IEEE Trans Consum Electron 54(4):1969–1976

    Article  Google Scholar 

  129. ITU-R Rec. BT.1438 (2000) Subjective assessment of stereoscopic television pictures. International Telecommunication Union

    Google Scholar 

  130. ITU-R Rec. BT.500-11 (2002) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union

    Google Scholar 

  131. ITU-R (2008) Digital three-dimensional (3D) TV broadcasting. Question ITU-R 128/6

    Google Scholar 

  132. Xing L, You J, Ebrahimi T, Perkis A (2010) An objective metric for assessing quality of experience on stereoscopic images. In: Proceedings of IEEE international workshop on multimedia signal processing (MMSP), pp 373–378

    Google Scholar 

  133. Goldmann L, Lee JS, Ebrahimi T (2010) Temporal synchronization in stereoscopic video: influence on quality of experience and automatic asynchrony detection. In: Proceedings of international conference on image processing (ICIP), Hong Kong, pp 3241–3244, Sept 2010

    Google Scholar 

  134. Levelt WJ (1965) Binocular brightness averaging and contour information. Brit J Psychol 56:1–13

    Article  Google Scholar 

  135. Stelmach LB, Tam WJ (1998) Stereoscopic image coding: effect of disparate image-quality in left- and right-eye views. Sig Process: Image Commun 14:111–117

    Article  Google Scholar 

  136. Zhao Y, Chen Z, Zhu C, Tan Y, Yu L (2011) Binocular just-noticeable-difference model for stereoscopic images. IEEE Signal Process Lett 18(1):19–22

    Article  Google Scholar 

  137. Hewage CTER, Worrall ST, Dogan S, Villette S, Kondoz AM (2009) Quality evaluation of color plus depth map based stereoscopic video. IEEE J Sel Top Sig Process 3(2):304–318

    Article  Google Scholar 

  138. You J, Xing L, Perkis A, Wang X (2010) Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of 5th international workshop on video processing and quality metrics for consumer electronics (VPQM), Scottsdale, AZ, USA

    Google Scholar 

  139. Benoit A, Le Callet P, Campisi P, Cousseau R (2008) Quality assessment of stereoscopic images. EURASIP J Image Video Process, vol 2008. Article ID 659024

    Google Scholar 

  140. Lambooij M (2011) Evaluation of stereoscopic images: beyond 2D quality. IEEE Trans Broadcast 57(2):432–444

    Article  Google Scholar 

  141. Julesz B (1971) Foundations of cyclopean perception. The University of Chicago Press, Chicago

    Google Scholar 

  142. Boev A, Gotchev A, Egiazarian K, Aksay A, Akar GB (2006) Towards compound stereo-video quality metric: a specific encoder-based framework. In: Proceedings of IEEE southwest symposium on image analysis and interpretation, pp 218–222

    Google Scholar 

  143. Maalouf A, Larabi M-C (2011) CYCLOP: a stereo color image quality assessment metric. In: Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1161–1164

    Google Scholar 

  144. Bosc E, Pepion R, Le Callet P, Koppel M, Ndjiki-Nya P, Pressigout M, Morin L (2011) Towards a new quality metric for 3-D synthesized view assessment. IEEE J Sel Top Sig Process 5(7):1332–1343

    Article  Google Scholar 

  145. Shao H, Cao X, Er G (2009) Objective quality assessment of depth image based rendering in 3DTV system. In: Proceedings of 3DTV conference, pp 1–4

    Google Scholar 

  146. Dimenco display Available: http://www.dimenco.eu/displays/

  147. Alioscopy display Available: http://www.alioscopy.com/3d-solutions-displays

  148. Smolic A, Muller K, Merkle P, Kauff P, Wiegand T (2009) An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution. In: Proceedings of picture coding symposium (PCS), pp 389–392

    Google Scholar 

  149. Grau O, Borel T, Kauff P, Smolic A, Tanger R (2011) 3D-TV R&D activities in Europe. IEEE Trans Broadcast 57(2):408–420

    Article  Google Scholar 

  150. Seventh Framework Programme (FP7) Available: http://cordis.europa.eu/fp7/home_en.html

  151. 3D4YOU Available: http://www.3d4you.eu/

  152. 2020 3D Media Available: http://www.20203dmedia.eu/

  153. Mobile 3DTV Available: http://sp.cs.tut.fi/mobile3dtv/

  154. 3DPHONE Available: http://www.3dphone.org/

  155. Report of SMPTE task force on 3D to the Home Available: http://store.smpte.org/product-p/tf3d.htm

  156. Video and Requirement Group (2011) Call for proposals on 3d video coding technology. ISO/IEC JTC1/SC29/WG11 Doc. N12036, Mar 2011

    Google Scholar 

  157. Video Group (2011) Standardization tracks considered in 3D video coding. ISO/IEC JTC1/SC29/WG11 Doc. N12434, Dec 2011

    Google Scholar 

  158. Video and Requirement Group (2011) Draft call for proposals on mpeg frame-compatible enhancement. ISO/IEC JTC1/SC29/WG11 Doc. N12249, Jul 2011

    Google Scholar 

  159. Tourapis AM, Pahalawatta P, Leontaris A, He Y, Ye Y, Stec K, Husak W (2010) A frame compatible system for 3D delivery. ISO/IEC JTC1/SC29/WG11 Doc. M17925, Jul 2010

    Google Scholar 

  160. Wu Y, Hirakawa S, Reimers U, Whitaker J (2006) Overview of digital television development worldwide. Proc IEEE 94(1):8–21

    Article  Google Scholar 

  161. Reimers U (2006) DVB–the family of international standards for digital video broadcasting. Proc IEEE 94(1):173–182

    Article  Google Scholar 

  162. Richer MS, Reitmeier G, Gurley T, Jones GA, Whitaker J, Rast R (2006) The ATSC digital television system. Proc IEEE 94(1):37–42

    Article  Google Scholar 

  163. European Telecommunications Standard Institute ETSI (2011) Digital video broadcasting (DVB): frame compatible plano-stereoscopic 3DTV (DVB-3DTV). DVB Document A154, Feb 2011

    Google Scholar 

  164. ATSC begins work on broadcast standard for 3D-TV transmissions Available: http://www.atsc.org/cms/index.php/communications/press-releases/257-atsc-begins-work-on-broadcast-standard-for-3d-tv-transmissions

  165. Report ITU-R BT.2160 (2010) Features of three-dimensional television video systems for broadcasting. International Telecommunication Union

    Google Scholar 

  166. Final 3-D Blu-ray specification announced Available: http://www.blu-ray.com/news/?id=3924

  167. Specification Available: http://www.hdmi.org/manufacturer/specification.aspx

  168. CEA begins standards process for 3D glasses Available: http://www.ce.org/Press/CurrentNews/press_release_detail.asp?id=12067

  169. Steering teams—overview Available: http://www.3dathome.org/steering-overview.aspx

  170. Bruls F, Gunnewiek RK, van de Walle P (2009) Philips response to new call for 3DV test material: arrive book and mobile. ISO/IEC JTC1/SC29/WG11 Doc. M16420, Apr 2009

    Google Scholar 

  171. Microsoft 3D video test sequences Available: http://research.microsoft.com/ivm/3DVideoDownload/

  172. Tanimoto M, Fujii T, Suzuki K (2009) View synthesis algorithm in view synthesis reference software 2.0 (VSRS2.0). ISO/IEC JTC1/SC29/WG11 Doc. M16090, Lausanne, Switzerland, Feb 2009

    Google Scholar 

Download references

Acknowledgment

The authors thank Philips and Microsoft for kindly providing the “Mobile” and “Ballet” sequences. They are also grateful to Dr. Vincent Jantet for preparing the LDI images in Fig. 1.4. This work is partially supported by the National Basic Research Program of China (973) under Grant No.2009CB320903 and Singapore Ministry of Education Academic Research Fund Tier 1 (AcRF Tier 1 RG7/09).

Author information

Authors and Affiliations

  1. Department of Information Science and Electronic Engineering, Zhejiang University, 310027, Hangzhou, People’s Republic of China

    Yin Zhao & Lu Yu

  2. School of Electronic Engineering, University of Electronic Science and Technology of China, 611731 , Chengdu, People’s Republic of China

    Ce Zhu

  3. Department of Electrical Engineering and Computer Science, Graduate School of Engineering, Nagoya University, Nagoya, 464-8603, Japan

    Masayuki Tanimoto

Authors
  1. Yin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ce Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lu Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Masayuki Tanimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yin Zhao .

Editor information

Editors and Affiliations

  1. , School of Electrical & Electronic, Nanyang Technological University, Nanyang Avenue 50, Singapore, 639798, Singapore

    Ce Zhu

  2. Electronic Engineering, Department of Information Science &, Zheda Road 38, Hangzhou, 310027, China, People's Republic

    Yin Zhao

  3. , Department of Information Science &, Zhejiang University, Zheda Road 38, Hangzhou, 310027, China, People's Republic

    Lu Yu

  4. Graduate School of Engineering, Department of Electrical Engineering and, Nagoya University, Nagoya, 464-8603, Japan

    Masayuki Tanimoto

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Zhao, Y., Zhu, C., Yu, L., Tanimoto, M. (2013). An Overview of 3D-TV System Using Depth-Image-Based Rendering. In: Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds) 3D-TV System with Depth-Image-Based Rendering. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9964-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-9964-1_1

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-9963-4

  • Online ISBN: 978-1-4419-9964-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation