Abstract
Colour volumetric data, which is constructed from a set of multi-view images, is capable of providing realistic immersive experience. However it is not widely applicable due to its manifold increase in bandwidth. This paper presents a novel framework to achieve scalable volumetric compression. Based on wavelet transformation, data rearrangement algorithm is proposed to compact volumetric data leading to high efficiency of transformation. The colour data is rearranged using the characteristics of human visual system. A pre-processing scheme for adaptive resolution is also proposed in this paper. The low resolution overcomes the limitation of the data transmission at low bitrates, whilst the fine resolution improves the quality of the synthesised images. Results show significant improvement of the compression performance over the traditional 3D coding. Finally, effect of using residual coding is investigated in order to show a trade off between the compression and view synthesis performance.
Similar content being viewed by others
Notes
The multiview Leo and Santa sequences were captured at University of Bristol and University of Tsukuba, respectively.
The Head sequence is provided by University of Tsukuba.
References
Abousleman GP, Marcellin MW, Hunt BR (1995) Compression of hyperspectral imagery using the 3-D DCT and hybrid DPCM/DCT. IEEE Trans Geosci Remote Sens 33:26–34
Anantrasirichai N (2007) Multi-view image compression and view synthesis. Thesis. University of Bristol
Anantrasirichai N, Nishan Canagarajah C, Redmill DW, Bull DR (2006) Volumetric Representation for Sparse Multi-views. IEEE Proc Int Conf Image Proc: 1221–1224
Anantrasirichai N, Nishan Canagarajah C, Redmill DW, Bull DR (2006) Dynamic programming for multi-view disparity/depth estimation. IEEE Proc Int Conf Acoust Speech Signal Process 2:269–272
Beardsley P, Torr P, Zisserman A (1996) 3D model acquisition from extended image sequences. Proceedings of European Conference Computer Vision, UK, pp 683–695
Deering M (1995) Geometry compression. ACM Proc. Comput. Graph. 13–20
Eisert ES, Girod B (2000) Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views. IEEE Trans Circuits Syst Video Technol 10:261–277
Gao Y, Radha H (2005) Multi-view image coding using 3-D voxel model. IEEE Proc Int Conf Image Proc 2:257–260
Gargallo P, Sturm P (2005) Bayesian 3D Modeling from Images using Multiple Depth Maps. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2:885–891
ISO/IEC JTC1/SC29/WG1 15444-1 (2000) Information Technology - JPEG 2000 Image Coding System: Core Coding System
ISO/IEC JTC1/SC29/WG1 15444-2 (2004) Information Technology - JPEG 2000 Image Coding System: Extensions
Jeong-Hwan A, Chang-Su K, Yo-Sung H (2006) Predictive compression of geometry, color and normal data of 3-D mesh models. IEEE Trans Circuits Syst Video Technol 16:291–299
Kim CS, Lee S (2002) Compact encoding of 3-D voxel surfaces based on pattern code representation. IEEE Trans Image Proc 11:932–943
Kim B-J, Xiong Z, Pearlman WA (2000) Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT). IEEE Trans Circuits Syst Video Technol 10:1365–1374
Koch R, Pollefeys M, Van Gool L (1999) Robust calibration and 3D geometric modeling from large collections of uncalibrated images. Proc. DAGM Pattern Recognition Symp, pp 413–420
Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38:199–218
Magnor M, Ramanathan P, Girod B (2003) Multi-view coding for image-based rendering using 3-D scene geometry. 13:1092–1106
Rodler FF (1999) Wavelet based 3D compression with fast random access for very large volume data. IEEE Proc. 7th Pacific Conf. on Computer Graphics and Applications. 108–117. 1999
Schelkens P, Munteanu A, Barbarien J, Galca M, Giro-Nieto X, Cornelis J (2003) Wavelet coding of volumetric medical datasets. IEEE Trans Med Imag 22:441–458
Schelkens P, Munteanu A, Tzannes A, Brislawn C (2006) JPEG2000 Part 10 – volumetric data encoding. IEEE Proc Int Symp Circuit Syst: 3874–3877.
Taubin G, Rossignac J (1998) Geometry compression through topological surgery. ACM Trans Graph: 84–115
Tzannes A (2003) Compression of 3-dimensional medical image data using Part 2 of JPEG 2000. Aware, Inc
Xiong Z, Wu X, Cheng S, Hua J (2003) Lossy-to-lossless compression of medical volumetric data using three-dimentional integer wavelet transforms. IEEE Trans Med Imag 22:459–470
Xu J, Xiong Z, Li S, Zhang Y (2001) 3-D embedded subband coding with optimal truncation (3-D ESCOT), J Appl Comput Harmon Anal 10:290–315
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Anantrasirichai, N., Canagarajah, N.C., Redmill, D.W. et al. Colour volumetric compression for realistic view synthesis applications. Multimed Tools Appl 53, 25–51 (2011). https://doi.org/10.1007/s11042-010-0484-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0484-4