Skip to main content
SpringerLink
Log in

What Is the Best Depth-Map Compression for Depth Image Based Rendering?

  • Conference paper
  • First Online:
Computer Analysis of Images and Patterns (CAIP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10425))

Included in the following conference series:

Abstract

Many of the latest smart phones and tablets come with integrated depth sensors, that make depth-maps freely available, thus enabling new forms of applications like rendering from different view points. However, efficient compression exploiting the characteristics of depth-maps as well as the requirements of these new applications is still an open issue. In this paper, we evaluate different depth-map compression algorithms, with a focus on tree-based methods and view projection as application.

The contributions of this paper are the following: 1. extensions of existing geometric compression trees, 2. a comparison of a number of different trees, 3. a comparison of them to a state-of-the-art video coder, 4. an evaluation using ground-truth data that considers both depth-maps and predicted frames with arbitrary camera translation and rotation.

Despite our best efforts, and contrary to earlier results, current video depth-map compression outperforms tree-based methods in most cases. The reason for this is likely that previous evaluations focused on low-quality, low-resolution depth maps, while high-resolution depth (as needed in the DIBR setting) has been ignored up until now. We also demonstrate that PSNR on depth-maps is not always a good measure of their utility.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., Fitzgibbon, A.: KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 127–136 (2011)

    Google Scholar 

  2. Kim, S.-Y., Ho, Y.-S.: Mesh-based depth coding for 3D video using hierarchical decomposition of depth maps. In: Proceedings of IEEE International Conference on Image Processing, pp. 117–120 (2007)

    Google Scholar 

  3. Jingjing, F., Miao, D., Weiren, Y., Wang, S., Yan, L., Li, S.: Kinect-like depth data compression. IEEE Trans. Multimed. 15, 1340–1352 (2013)

    Article  Google Scholar 

  4. Merkle, P., Múller, K., Marpe, D., Wiegand, T.: Depth intra coding for 3d video based on geometric primitives. IEEE Trans. Circ. Syst. Video Technol. 99, 570–582 (2015)

    Google Scholar 

  5. Chai, B.B., Sethuraman, S., Sawhney, H.S., Hatrack, P.: Depth map compression for real-time view-based rendering. Pattern Recogn. Lett. 25, 755–766 (2004)

    Article  Google Scholar 

  6. Morvan, Y., Farin, D., de With, P.H.N.: Multiview video coding using depth based 3D warping. In: Proceedings of IEEE International Conference on Image Processing, vol. 5, pp. 105–108 (2007)

    Google Scholar 

  7. Colleu, T., Pateux, S., Morinc, L., Labit, C.: A polygon soup representation for multiview coding. J. Vis. Commun. Image Represent. 21, 561–576 (2010)

    Article  Google Scholar 

  8. Sandberg, D., Forssén, P.E., Ogniewski, J.: Model-based video coding using colour and depth cameras. In: Proceedings of International Conference on Digital Image Computing Techniques and Applications, pp. 158–163 (2011)

    Google Scholar 

  9. Chai, B.-B., Sethuraman, S., Sawhney, H.S.: A depth map representation for real-time transmission and view-based rendering of a dynamic 3D scene. In: Proceedings of First International Symposium on 3D Data Processing Visualization and Transmission, pp. 107–114 (2002)

    Google Scholar 

  10. Sarkis, M., Zia, W., Diepold, K.: Fast depth map compression and meshing with compressed tritree. In: Zha, H., Taniguchi, R., Maybank, S. (eds.) ACCV 2009. LNCS, vol. 5995, pp. 44–55. Springer, Heidelberg (2010). doi:10.1007/978-3-642-12304-7_5

    Chapter  Google Scholar 

  11. Oh, B.T., Lee, J., Park, D.-S.: Binary tree decomposition depth coding for 3D video applications. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1–6 (2011)

    Google Scholar 

  12. Byung Tae, O., Lee, J., Park, D.-S.: Depth map coding based on synthesized view distortion function. IEEE J. Sel. Topics Signal Process. 5, 1344–1352 (2011)

    Article  Google Scholar 

  13. Wang, L., Yu, L.: Rate-distortion optimization for depth map coding with distortion estimation of synthesized view. In: Proceedings of IEEE International Symposium on Circuits and Systems, pp. 17–20 (2013)

    Google Scholar 

  14. Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Rhee, F.H., Tech, G., Winken, M., Wiegand, T.: 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans. Image Process. 22, 2266–2278 (2013)

    Article  MathSciNet  Google Scholar 

  15. Ogniewski, J., Forssén, P.E.: Pushing the limits for view prediction in video coding. In: 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2017)

    Google Scholar 

  16. Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multi-scale structural similarity for image quality assessment. In: 37th IEEE Asilomar Conference on Signals, Systems and Computers (2003)

    Google Scholar 

  17. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circ. Syst. Video Technol. 22, 1649–1668 (2012)

    Article  Google Scholar 

  18. Iyer, K.N., Maiti, K., Navathe, B., Kannan, H., Sharma, A.: Multiview video coding using depth based 3D warping. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1108–1113 (2010)

    Google Scholar 

  19. Butler, D.J., Wulff, J., Stanley, G.B., Black, M.J.: A naturalistic open source movie for optical flow evaluation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7577, pp. 611–625. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33783-3_44

    Chapter  Google Scholar 

  20. Solh, M., Al Regib, G.: Hierarchical Hole-Filling(HHF): depth image based rendering without depth map filtering for 3D-TV. In: IEEE International Workshop on Multimedia and Signal Processing (2010)

    Google Scholar 

  21. Chao, Y.-H., Ortega, A., Wei, H., Cheung, G.: Edge-adaptive depth map coding with lifting transform on graphs. In: Picture Coding Symposium (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Linköping University, 581 83, Linköping, Sweden

    Jens Ogniewski & Per-Erik Forssén

Authors
  1. Jens Ogniewski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Per-Erik Forssén
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jens Ogniewski .

Editor information

Editors and Affiliations

  1. Linköping University, Linköping, Sweden

    Michael Felsberg

  2. Lund University, Lund, Sweden

    Anders Heyden

  3. University of Southern Denmark, Odense, Denmark

    Norbert Krüger

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ogniewski, J., Forssén, PE. (2017). What Is the Best Depth-Map Compression for Depth Image Based Rendering?. In: Felsberg, M., Heyden, A., Krüger, N. (eds) Computer Analysis of Images and Patterns. CAIP 2017. Lecture Notes in Computer Science(), vol 10425. Springer, Cham. https://doi.org/10.1007/978-3-319-64698-5_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64698-5_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64697-8

  • Online ISBN: 978-3-319-64698-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation