Skip to main content

Effects of Wavelet-Based Depth Video Compression

  • Chapter
  • First Online:
3D-TV System with Depth-Image-Based Rendering

Abstract

Multi-view video (MVV) representation based on depth data, such as multi-view video plus depth (MVD), is emerging a new type of 3D video communication services. In the meantime, the problem of coding and transmitting the depth video is being raised in addition to classical texture video. Depth video is considered as key side information in novel view synthesis within MVV systems, such as three-dimensional television (3D-TV) or free viewpoint television (FTV). Nonetheless the influence of depth compression on the novel synthesized view is still a contentious issue. In this chapter, we propose to discuss and investigate the impact of the wavelet-based compression of the depth video on the quality of the view synthesis. After the analysis, different frameworks are presented to reduce the disturbing depth compression effects on the novel synthesized view.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Hysteresis is used to track the more relevant pixels along the contours. Hysteresis uses two thresholds and if the magnitude is below the first threshold, it is set to zero (made a nonedge). If the magnitude is above the high threshold, it is made an edge. And if the magnitude is between the two thresholds, then it is set to zero unless the pixel is located near a edge detected by the high threshold.

References

  1. Fehn C, Cooke E, Schreer O, Kauff P (2002) 3D analysis and image-based rendering for immersive TV applications. Signal Process Image Commun 17(9):705–715

    Article  Google Scholar 

  2. Tanimoto M (2006) Overview of free viewpoint television. Signal Process Image Commun 21:454–461

    Article  Google Scholar 

  3. McMillan L Jr (1997) An image-based approach to three-dimensional computer graphics. PhD thesis, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA

    Google Scholar 

  4. Oliveira MM (2000) Relief texture mapping. PhD thesis, University of North Carolina at Chapel Hill, NC, USA

    Google Scholar 

  5. Morvan Y, Farin D, de With PHN (2005) Novel coding technique for depth images using quadtree decomposition and plane approximation. In: Visual communications and image processing, vol 5960, Beijing, China, pp 1187–1194

    Google Scholar 

  6. Xiong Z, Ramchandran K, Orchard MT, Zhang Y-Q (1999) A comparative study of dct- and wavelet-based image coding. IEEE Trans Circuits Syst Video Technol 9(5):692–695

    Article  Google Scholar 

  7. Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693

    Article  MATH  Google Scholar 

  8. Rioul O, Duhamel P (1992) Fast algorithms for discrete and continuous wavelet transforms. IEEE Trans Inf Theory 38(2):569–586

    Article  MathSciNet  MATH  Google Scholar 

  9. Sweldens W (1995) The lifting scheme: a new philosophy in biorthogonal wavelet constructions. In: Proceedings of the SPIE, wavelet applications in signal and image processing III, vol 2569, pp 68–79

    Google Scholar 

  10. Daubechies I, Sweldens W (1998) Factoring wavelet transforms into lifting steps. J Fourier Anal Appl 4:247–269

    Article  MathSciNet  MATH  Google Scholar 

  11. Le Gall D, Tabatabai A (1988) Sub-band coding of digital images using symmetric short kernel filters and arithmetic coding techniques. In: Proceedings of the IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 761–764, 11–14 Apr 1988

    Google Scholar 

  12. Antonini M, Barlaud M, Mathieu P, Daubechies I (1992) Image coding using wavelet transform. IEEE Trans Image Process 1(2):205–220

    Article  Google Scholar 

  13. Cohen A, Daubechies I, Feauveau J-C (1992) Biorthogonal bases of compactly supported wavelets. Commun Pure Appl Math 45:485–500

    Article  MathSciNet  MATH  Google Scholar 

  14. Microsoft sequence Ballet and Breakdancers (2004) [Online] Available: http://research.microsoft.com/en-us/um/people/sbkang/3dvideodownload/

  15. Tanimoto M, Fujii T, Suzuki K, Fukushima N, Mori Y (2008) Reference softwares for depth estimation and view synthesis, M15377 doc., Archamps, France, Apr 2008

    Google Scholar 

  16. Telea A (2004) An image inpainting technique based on the fast marching method. J Graph GPU Game Tools 9(1):23–34

    Google Scholar 

  17. Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106

    Article  MathSciNet  Google Scholar 

  18. Li S, Li W (2000) Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding. IEEE Trans Circuits Syst Video Technol 10(5):725–743

    Article  Google Scholar 

  19. Peyré G, Mallat S (2000) Surface compression with geometric bandelets. In: Proceedings of the annual conference on computer graphics and interactive techniques (SIGGRAPH), New York, NY, USA, pp 601–608. ACM

    Google Scholar 

  20. Shukla R, Dragotti PL, Do MN, Vetterli M (2005) Rate-distortion optimized tree-structured compression algorithms for piecewise polynomial images. IEEE Trans Image Process 14(3):343–359

    Article  MathSciNet  Google Scholar 

  21. Daribo I, Tillier C, Pesquet-Popescu B (2008) Adaptive wavelet coding of the depth map for stereoscopic view synthesis. In: Proceedings of the IEEE workshop on multimedia signal processing (MMSP), Cairns, Queensland, Australia, pp 413–417, Oct 2008

    Google Scholar 

  22. Maitre M, Do MN (2009) Shape-adaptive wavelet encoding of depth maps. In: Proceedings of the picture coding symposium (PCS), Chicago, USA, pp 1–4, May 2009

    Google Scholar 

  23. Sanchez A, Shen G, Ortega A (2009) Edge-preserving depth-map coding using graph-based wavelets. In: Proceedings of the asilomar conference on signals, systems and computers record, Pacific Grove, CA, USA, pp 578–582, Nov 2009

    Google Scholar 

  24. Shen G, Kim W-S, Narang SK, Ortega A, Lee J, Wey H (2010) Edge-adaptive transforms for efficient depth map coding. In: Proceedings of the picture coding symposium (PCS), Nagoya, Japan, pp 566–569, Dec 2010

    Google Scholar 

  25. Freeman H (1961) On the encoding of arbitrary geometric configurations. IRE Trans Electron Comput 2:260–268

    Article  MathSciNet  Google Scholar 

  26. Eden M, Kocher M (1985) On the performance of a contour coding algorithm in the context of image coding part I: contour segment coding. Signal Process 8(4):381–386

    Article  Google Scholar 

Download references

Acknowledgments

This work is partially supported by the National Institute of Information and Communications Technology (NICT), Strategic Information and Communications R&D Promotion Programme (SCOPE) No.101710002, Grand-in-Aid for Scientific Research No.21200002 in Japan, Funding Program for Next Generation World-Leading Researchers No. LR030 (Cabinet Office, Government Of Japan) in Japan, and the Japan Society for the Promotion of Science (JSPS) Program for Foreign Researchers.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ismael Daribo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Daribo, I., Saito, H., Furukawa, R., Hiura, S., Asada, N. (2013). Effects of Wavelet-Based Depth Video Compression. In: Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds) 3D-TV System with Depth-Image-Based Rendering. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9964-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-9964-1_10

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-9963-4

  • Online ISBN: 978-1-4419-9964-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics