Skip to main content

Advertisement

Log in

Colour volumetric compression for realistic view synthesis applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Colour volumetric data, which is constructed from a set of multi-view images, is capable of providing realistic immersive experience. However it is not widely applicable due to its manifold increase in bandwidth. This paper presents a novel framework to achieve scalable volumetric compression. Based on wavelet transformation, data rearrangement algorithm is proposed to compact volumetric data leading to high efficiency of transformation. The colour data is rearranged using the characteristics of human visual system. A pre-processing scheme for adaptive resolution is also proposed in this paper. The low resolution overcomes the limitation of the data transmission at low bitrates, whilst the fine resolution improves the quality of the synthesised images. Results show significant improvement of the compression performance over the traditional 3D coding. Finally, effect of using residual coding is investigated in order to show a trade off between the compression and view synthesis performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25

Similar content being viewed by others

Notes

  1. The multiview Leo and Santa sequences were captured at University of Bristol and University of Tsukuba, respectively.

  2. The Head sequence is provided by University of Tsukuba.

References

  1. Abousleman GP, Marcellin MW, Hunt BR (1995) Compression of hyperspectral imagery using the 3-D DCT and hybrid DPCM/DCT. IEEE Trans Geosci Remote Sens 33:26–34

    Article  Google Scholar 

  2. Anantrasirichai N (2007) Multi-view image compression and view synthesis. Thesis. University of Bristol

  3. Anantrasirichai N, Nishan Canagarajah C, Redmill DW, Bull DR (2006) Volumetric Representation for Sparse Multi-views. IEEE Proc Int Conf Image Proc: 1221–1224

  4. Anantrasirichai N, Nishan Canagarajah C, Redmill DW, Bull DR (2006) Dynamic programming for multi-view disparity/depth estimation. IEEE Proc Int Conf Acoust Speech Signal Process 2:269–272

    Google Scholar 

  5. Beardsley P, Torr P, Zisserman A (1996) 3D model acquisition from extended image sequences. Proceedings of European Conference Computer Vision, UK, pp 683–695

  6. Deering M (1995) Geometry compression. ACM Proc. Comput. Graph. 13–20

  7. Eisert ES, Girod B (2000) Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views. IEEE Trans Circuits Syst Video Technol 10:261–277

    Article  Google Scholar 

  8. Gao Y, Radha H (2005) Multi-view image coding using 3-D voxel model. IEEE Proc Int Conf Image Proc 2:257–260

    Google Scholar 

  9. Gargallo P, Sturm P (2005) Bayesian 3D Modeling from Images using Multiple Depth Maps. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2:885–891

  10. ISO/IEC JTC1/SC29/WG1 15444-1 (2000) Information Technology - JPEG 2000 Image Coding System: Core Coding System

  11. ISO/IEC JTC1/SC29/WG1 15444-2 (2004) Information Technology - JPEG 2000 Image Coding System: Extensions

  12. Jeong-Hwan A, Chang-Su K, Yo-Sung H (2006) Predictive compression of geometry, color and normal data of 3-D mesh models. IEEE Trans Circuits Syst Video Technol 16:291–299

    Article  Google Scholar 

  13. Kim CS, Lee S (2002) Compact encoding of 3-D voxel surfaces based on pattern code representation. IEEE Trans Image Proc 11:932–943

    Article  Google Scholar 

  14. Kim B-J, Xiong Z, Pearlman WA (2000) Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT). IEEE Trans Circuits Syst Video Technol 10:1365–1374

    Google Scholar 

  15. Koch R, Pollefeys M, Van Gool L (1999) Robust calibration and 3D geometric modeling from large collections of uncalibrated images. Proc. DAGM Pattern Recognition Symp, pp 413–420

  16. Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38:199–218

    Article  MATH  Google Scholar 

  17. Magnor M, Ramanathan P, Girod B (2003) Multi-view coding for image-based rendering using 3-D scene geometry. 13:1092–1106

  18. Rodler FF (1999) Wavelet based 3D compression with fast random access for very large volume data. IEEE Proc. 7th Pacific Conf. on Computer Graphics and Applications. 108–117. 1999

  19. Schelkens P, Munteanu A, Barbarien J, Galca M, Giro-Nieto X, Cornelis J (2003) Wavelet coding of volumetric medical datasets. IEEE Trans Med Imag 22:441–458

    Article  Google Scholar 

  20. Schelkens P, Munteanu A, Tzannes A, Brislawn C (2006) JPEG2000 Part 10 – volumetric data encoding. IEEE Proc Int Symp Circuit Syst: 3874–3877.

  21. Taubin G, Rossignac J (1998) Geometry compression through topological surgery. ACM Trans Graph: 84–115

  22. Tzannes A (2003) Compression of 3-dimensional medical image data using Part 2 of JPEG 2000. Aware, Inc

  23. Xiong Z, Wu X, Cheng S, Hua J (2003) Lossy-to-lossless compression of medical volumetric data using three-dimentional integer wavelet transforms. IEEE Trans Med Imag 22:459–470

    Article  Google Scholar 

  24. Xu J, Xiong Z, Li S, Zhang Y (2001) 3-D embedded subband coding with optimal truncation (3-D ESCOT), J Appl Comput Harmon Anal 10:290–315

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nantheera Anantrasirichai.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Anantrasirichai, N., Canagarajah, N.C., Redmill, D.W. et al. Colour volumetric compression for realistic view synthesis applications. Multimed Tools Appl 53, 25–51 (2011). https://doi.org/10.1007/s11042-010-0484-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0484-4

Keywords

Navigation