Abstract
Multi-view video (MVV) representation based on depth data, such as multi-view video plus depth (MVD), is emerging a new type of 3D video communication services. In the meantime, the problem of coding and transmitting the depth video is being raised in addition to classical texture video. Depth video is considered as key side information in novel view synthesis within MVV systems, such as three-dimensional television (3D-TV) or free viewpoint television (FTV). Nonetheless the influence of depth compression on the novel synthesized view is still a contentious issue. In this chapter, we propose to discuss and investigate the impact of the wavelet-based compression of the depth video on the quality of the view synthesis. After the analysis, different frameworks are presented to reduce the disturbing depth compression effects on the novel synthesized view.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Hysteresis is used to track the more relevant pixels along the contours. Hysteresis uses two thresholds and if the magnitude is below the first threshold, it is set to zero (made a nonedge). If the magnitude is above the high threshold, it is made an edge. And if the magnitude is between the two thresholds, then it is set to zero unless the pixel is located near a edge detected by the high threshold.
References
Fehn C, Cooke E, Schreer O, Kauff P (2002) 3D analysis and image-based rendering for immersive TV applications. Signal Process Image Commun 17(9):705–715
Tanimoto M (2006) Overview of free viewpoint television. Signal Process Image Commun 21:454–461
McMillan L Jr (1997) An image-based approach to three-dimensional computer graphics. PhD thesis, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
Oliveira MM (2000) Relief texture mapping. PhD thesis, University of North Carolina at Chapel Hill, NC, USA
Morvan Y, Farin D, de With PHN (2005) Novel coding technique for depth images using quadtree decomposition and plane approximation. In: Visual communications and image processing, vol 5960, Beijing, China, pp 1187–1194
Xiong Z, Ramchandran K, Orchard MT, Zhang Y-Q (1999) A comparative study of dct- and wavelet-based image coding. IEEE Trans Circuits Syst Video Technol 9(5):692–695
Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693
Rioul O, Duhamel P (1992) Fast algorithms for discrete and continuous wavelet transforms. IEEE Trans Inf Theory 38(2):569–586
Sweldens W (1995) The lifting scheme: a new philosophy in biorthogonal wavelet constructions. In: Proceedings of the SPIE, wavelet applications in signal and image processing III, vol 2569, pp 68–79
Daubechies I, Sweldens W (1998) Factoring wavelet transforms into lifting steps. J Fourier Anal Appl 4:247–269
Le Gall D, Tabatabai A (1988) Sub-band coding of digital images using symmetric short kernel filters and arithmetic coding techniques. In: Proceedings of the IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 761–764, 11–14 Apr 1988
Antonini M, Barlaud M, Mathieu P, Daubechies I (1992) Image coding using wavelet transform. IEEE Trans Image Process 1(2):205–220
Cohen A, Daubechies I, Feauveau J-C (1992) Biorthogonal bases of compactly supported wavelets. Commun Pure Appl Math 45:485–500
Microsoft sequence Ballet and Breakdancers (2004) [Online] Available: http://research.microsoft.com/en-us/um/people/sbkang/3dvideodownload/
Tanimoto M, Fujii T, Suzuki K, Fukushima N, Mori Y (2008) Reference softwares for depth estimation and view synthesis, M15377 doc., Archamps, France, Apr 2008
Telea A (2004) An image inpainting technique based on the fast marching method. J Graph GPU Game Tools 9(1):23–34
Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106
Li S, Li W (2000) Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding. IEEE Trans Circuits Syst Video Technol 10(5):725–743
Peyré G, Mallat S (2000) Surface compression with geometric bandelets. In: Proceedings of the annual conference on computer graphics and interactive techniques (SIGGRAPH), New York, NY, USA, pp 601–608. ACM
Shukla R, Dragotti PL, Do MN, Vetterli M (2005) Rate-distortion optimized tree-structured compression algorithms for piecewise polynomial images. IEEE Trans Image Process 14(3):343–359
Daribo I, Tillier C, Pesquet-Popescu B (2008) Adaptive wavelet coding of the depth map for stereoscopic view synthesis. In: Proceedings of the IEEE workshop on multimedia signal processing (MMSP), Cairns, Queensland, Australia, pp 413–417, Oct 2008
Maitre M, Do MN (2009) Shape-adaptive wavelet encoding of depth maps. In: Proceedings of the picture coding symposium (PCS), Chicago, USA, pp 1–4, May 2009
Sanchez A, Shen G, Ortega A (2009) Edge-preserving depth-map coding using graph-based wavelets. In: Proceedings of the asilomar conference on signals, systems and computers record, Pacific Grove, CA, USA, pp 578–582, Nov 2009
Shen G, Kim W-S, Narang SK, Ortega A, Lee J, Wey H (2010) Edge-adaptive transforms for efficient depth map coding. In: Proceedings of the picture coding symposium (PCS), Nagoya, Japan, pp 566–569, Dec 2010
Freeman H (1961) On the encoding of arbitrary geometric configurations. IRE Trans Electron Comput 2:260–268
Eden M, Kocher M (1985) On the performance of a contour coding algorithm in the context of image coding part I: contour segment coding. Signal Process 8(4):381–386
Acknowledgments
This work is partially supported by the National Institute of Information and Communications Technology (NICT), Strategic Information and Communications R&D Promotion Programme (SCOPE) No.101710002, Grand-in-Aid for Scientific Research No.21200002 in Japan, Funding Program for Next Generation World-Leading Researchers No. LR030 (Cabinet Office, Government Of Japan) in Japan, and the Japan Society for the Promotion of Science (JSPS) Program for Foreign Researchers.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this chapter
Cite this chapter
Daribo, I., Saito, H., Furukawa, R., Hiura, S., Asada, N. (2013). Effects of Wavelet-Based Depth Video Compression. In: Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds) 3D-TV System with Depth-Image-Based Rendering. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9964-1_10
Download citation
DOI: https://doi.org/10.1007/978-1-4419-9964-1_10
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-9963-4
Online ISBN: 978-1-4419-9964-1
eBook Packages: EngineeringEngineering (R0)