Skip to main content

3D Video Compression Using Depth Map Propagation

  • Conference paper
Multimedia Communications, Services and Security (MCSS 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 368))

Abstract

We propose a method of 3D video compression based on 2D+depth representation. We use correlation between 2D video and depth map to reconstruct highly compressed depth map while decoding. Depth map is compressed with reduced spatial and temporal resolution. On decoding stage the algorithm restore original resolution using information from 2D video. We evaluated the influence of key frames’ resolution, compression ratio and density on the performance of the algorithm. The proposed technique was compared to depth map compression using H.264 in compression pipeline for stereo video.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Lukacs, M.E.: Predictive coding of multi-viewpoint image sets. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Tokyo, Japan, vol. 1, pp. 521–524 (1986)

    Google Scholar 

  2. Merkle, P., Muller, K., Smolic, A., Wiegand, T.: Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC. In: Proc. IEEE International Conference on Multimedia and Expo., pp. 1717–1720 (2006)

    Google Scholar 

  3. ITU-T and ISO/IEC JTC 1, Final draft amendment 3, amendment 3 to ITU-T recommendation H.262 and ISO/IEC13818-2 (MPEG-2 Video), ISO/IEC JTC 1/SC29/WG 11 (MPEG) Doc. N 1366 (1996)

    Google Scholar 

  4. ITU-T and ISO/IEC JTC 1, Advanced video coding for generic audiovisual services, ITU-T Recommendation H.264 and ISO/IEC 14496-10, MPEG-4 AVC (2010)

    Google Scholar 

  5. Müller, K., Merkle, P., Wiegand, T.: 3D Video Representation Using Depth Maps. Proceedings of the IEEE, Special Issue on “3D Media and Displays” 99(4), 643–656 (2011)

    Google Scholar 

  6. Morvan, Y., de With, P., Farin, D.: Platelet-based coding of depth maps for the transmission of multiview images. In: Proc. Stereoscopic Displays and Applications, SPIE, vol. 6055, pp. 93–100 (2006)

    Google Scholar 

  7. Bosc, E., Jantet, V., Pressigout, M., Morin, L., Guillemot, C.: Bit-rate allocation for multi-view video plus depth. In: Proc. 3DTV Conference The True Vision Capture Transmission and Display of 3D Video 3DTVCON, pp. 1–4 (2011)

    Google Scholar 

  8. Choi, J., Min, D., Sohn, K.: 2D-plus-depth based resolution and frame-rate up-conversion technique for depth video. IEEE Transactions on Consumer Electronics 56, 2489–2497 (2010)

    Article  Google Scholar 

  9. De Silva, D.V.S.X., Fernando, W.A.C., Yasakethu, S.L.P.: Object based coding of the depth maps for 3D video coding. IEEE Transactions on Consumer Electronic 55, 1699–1706 (2009)

    Article  Google Scholar 

  10. Kim, W.-S., Ortega, A., Lai, P., Tian, D., Gomila, C.: Depth map distortion analysis for view rendering and depth coding. In: Proc. International Conference on Image Processing, pp. 721–724 (2009)

    Google Scholar 

  11. Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality evaluation for compressed depth maps associated with colour plus depth 3D video. In: 17th IEEE International Conference on Image Processing, ICIP (2010)

    Google Scholar 

  12. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)

    Article  Google Scholar 

  13. Lee, C., Jung, J.-I., Ho, Y.-S.: Inter-view Depth Pre-processing for 3D Video Coding. ISO/IEC JTC1/SC29/WG11, m22669, pp. 1–7 (November 2011)

    Google Scholar 

  14. YUVsoft Depth Upscale, http://www.yuvsoft.com/stereo-3d-technologies/depth-upscale/ (retrieved)

  15. YUVsoft Depth Propagation, http://www.yuvsoft.com/stereo-3d-technologies/depth-propagation/ (retrieved)

  16. Li, Y., Sun, L., Xue, T.: Fast frame-rate up-conversion of depth video via video coding. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 1317–1320. ACM, USA (2011)

    Google Scholar 

  17. Zhang, G., Jia, J., Wong, T.T., Bao, H.: Consistent depth maps recovery from a video sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(6), 974–988 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Matyunin, S., Vatolin, D. (2013). 3D Video Compression Using Depth Map Propagation. In: Dziech, A., CzyĹĽewski, A. (eds) Multimedia Communications, Services and Security. MCSS 2013. Communications in Computer and Information Science, vol 368. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38559-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38559-9_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38558-2

  • Online ISBN: 978-3-642-38559-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics