Skip to main content
SpringerLink
Log in

Error Concealment Methods for Multiview Video and Depth

  • Chapter
  • First Online:
Book cover 3D Visual Content Creation, Coding and Delivery

Part of the book series: Signals and Communication Technology ((SCT))

Abstract

The different media representation formats and coding techniques currently used to deliver 3D visual information across diverse networks require specific approaches and methods to minimise the perceptual impact of data loss, that may occur along the communications path. This chapter addresses this type of problem by presenting recent advances in error concealment methods, expanding conventional techniques used for 2D video to multiview (MVC) and multiview video-plus-depth (MVD) coded formats. The methods described in the chapter exploit the specific characteristics of multiview formats to achieve highly efficient error concealment performance and, consequently, to improve the perceptual quality delivered to end users, in the presence of transmission losses. In the case of MVC, besides spatial and inter-frame, inter-view correlations are also exploited, while in MVD, the most efficient methods use both the texture (view) and depth information to improve the error concealment performance. The most relevant contributions in this field are described in detail, where the performance of these advanced solutions is discussed along with comparisons between different methods and benchmarking.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wang, Y.-K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M.: The error concealment feature in the H.26L test model. In: Proceedings of the International Conference on Image Processing, pp. 729–732, September (2002)

    Google Scholar 

  2. Lam, W.M., Reibman, A.R., Liu, B.: Recovery of lost or erroneously received motion vectors. Proc. Int. Conf. Acoustics Speech Signal Process. 5, 417–420 (1993)

    Google Scholar 

  3. Micallef, B.W., Debono, C.J.: Error concealment techniques for multi-view video. In: Proceedings of the IFIP 2010 wireless days, October 2010

    Google Scholar 

  4. Thaipanich, T., Wu, P.H., Kuo, C.C.J.: Low-complexity video error concealment for mobile applications using OBMA. IEEE Trans. Consum. Electron. 54(2), 753–761 (2008)

    Article  Google Scholar 

  5. Ali, A., Karim, H.A., Arif, N.A.M., Sali, A.: Depth image-based spatial error concealment for 3-D video transmission. Res. Dev. (SCOReD), 2010 IEEE Student Conf 421–425 (2010)

    Google Scholar 

  6. Liu, S., Chen, Y., Wang, Y.-K., Gabbouj, M., Hannuksela, M.M., Li, H.: Frame loss error concealment for multiview video coding. Proc. IEEE Int. Symp. Circuits Syst. ISCAS 2008, 3470–3473 (2008)

    Google Scholar 

  7. Belfiore, S., Grangetto, M., Magli, E., Olmo, G.: An error concealment algorithm for streaming video. In: Proceedings of the International Conference on Image Processing - ICIP 2003, vol. 3, pp. 649–52 (2003)

    Google Scholar 

  8. Vetro, A., Wiegand, T., Sullivan, G.J.: Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC Standard. In: Proceedings of the IEEE, vol. 99, no. 4, pp. 626–642 (2011)

    Google Scholar 

  9. Chen, Y., Cai, C., Ma, K.-K.: Stereoscopic video error concealment for missing frame recovery using disparity-based frame difference projection. In: Proceedings of the 16th IEEE International Conference on Image Processing—ICIP 2009, pp. 4289–4292 (2009)

    Google Scholar 

  10. Gonzalez, R.C.: Digital image processing. Pearson Education India (2007)

    Google Scholar 

  11. Bilen, C., Aksay, A., Akar, G.B.: Motion and disparity aided stereoscopic full frame loss concealment method. In: Proceedings of the IEEE 15th Signal Processing and Communications Applications—SIU 2007, pp. 1–4 (2007)

    Google Scholar 

  12. Pang L., Yu, M., Yi, W., Jiang, G., Liu,W., Jiang, Z.: Relativity analysis-based error concealment algorithm for entire frame loss of stereo video. In: Proceedings of the 15th IEEE 8th International Conference on Signal Processing, vol. 2 (2006)

    Google Scholar 

  13. Chung,T., Sull, S., Kim, C.: Frame loss concealment for stereoscopic video based on inter-view similarity of motion and intensity difference. In: Proceedings of the 17th IEEE International Conference on Image Process—ICIP 2010, pp. 441–444 (2010)

    Google Scholar 

  14. Micallef, B.W, Debono, C.J., Farrugia, R.A.: Performance of enhanced error concealment techniques in multi-view video coding systems. In: Proceedings of the 17th IEEE International Conference on Systems Signals Image Process—IWSSIP—2011, pp. 1–4 (2011)

    Google Scholar 

  15. Lam, W.-M., Reibman, A. R., Liu, B.: Recovery of lost or erroneously received motion vectors. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing—ICASSP 199, vol. 5, pp. 417–420 (1993)

    Google Scholar 

  16. Stankiewicz, O., Wegner, K., Doman M., ski: Error concealment for MVC and 3D video coding. In: Proceedings of the Picture Coding Symposium—PCS 2010, pp. 498–501 (2010)

    Google Scholar 

  17. Liu, H., Wang, D., Li, W., Issa, O.: New method for concealing entirely lost frames in H.264 video transmission over wireless networks. In: Proceedings of the IEEE 15th International Symposium on Consumer Electronics—ISCE 2011, pp. 112–116 (2011)

    Google Scholar 

  18. Xiang, X., Zhao, D., Ma, S., Gao, W.: Auto-regressive model based error concealment scheme for stereoscopic video coding. Proc. IEEE Int. Conf. Acoustics Speech Signal Processing ICASSP 2011, pp. 849–852 (2011)

    Google Scholar 

  19. Wu, X., Barthel, K.U., Zhang, W.: Piecewise 2D autoregression for predictive image coding. In: Proceedings of the International Conference on Image Processing—ICIP 1998., vol. 3, pp. 901–904 (1998)

    Google Scholar 

  20. Yan B., Zhou J.: Efficient Frame Concealment for Depth Image Based 3D Video Transmission. IEEE Trans. Multimedia 99(1) (2012)

    Google Scholar 

  21. Yan, B., Gharavi, H.: A Hybrid Frame Concealment Algorithm for H.264/AVC. IEEE Trans. Image Process. 19(1), 98–107 (2010)

    Article  MathSciNet  Google Scholar 

  22. Doan, V.-H., Nguyen, V.-A., Do, M.N.: Efficient view synthesis based error concealment method for multiview video plus depth. Proc. IEEE Int. Symp. Circuits Syst. ISCAS 2013, 2900–2903 (2013)

    Google Scholar 

  23. Liu, Y., Wang, J., Zhang, H.: Depth image-based temporal error concealment for 3D video transmission. IEEE Trans. Circuits Syst. Video Technol. 20(4), 600–604 (2010)

    Article  Google Scholar 

  24. Hewage, C.T.E.R., Worrall, S.T., Dogan, S., Kondoz, A.M.: A Novel Frame Concealment Method for Depth Maps Using Corresponding Colour Motion Vectors. In: Proceedings of the 3DTV Conference on True Visual—Capture, Transmission and Display 3D Video, pp. 149–152 (2008)

    Google Scholar 

  25. Hewage, C.T.E.R., Martini, M.G.: Joint Error Concealment Method for Backward Compatible 3D Video Transmission. In: Proceedings of the IEEE 73rd Vehicular Technology Conference—VTC Spring 2011, pp. 1–5 (2011)

    Google Scholar 

  26. Yan, B.: A Novel H.264 Based Motion Vector Recovery Method for 3D Video Transmission. IEEE Trans. Consum. Electron. 53(4), 1546–1552 (2007)

    Article  Google Scholar 

  27. Hewage, C.T.E.R., Worrall, S., Dogan, S., Kondoz, A.M.: Frame concealment algorithm for stereoscopic video using motion vector sharing. In: Proceedings of the IEEE International Conference on Multimedia Expo 2008, pp. 485–488 (2008)

    Google Scholar 

  28. Wang, Y., Ostermann, J., Zhang, Y.-Q.: Video processing and communications. vol. 5. Prentice Hall Upper Saddle River (2002)

    Google Scholar 

  29. Chung, T., Sull, S., Kim, C.: Frame loss concealment for stereoscopic video plus depth sequences. IEEE Trans. Consum. Electron. 57(3), 1336–1344 (2011)

    Article  Google Scholar 

  30. Chen, Y, Yu, K., Li, J., Li, S.: An error concealment algorithm for entire frame loss in video transmission. In: Proceedings of the IEEE International Conference on Picture Coding Symposium, pp. 15–17 (2004)

    Google Scholar 

  31. Bilen, C, Aksay, A., Akar, G.B.: Two novel methods for full frame loss concealment in stereo video. In: Proceedings of the Picture Coding Symposium (2007)

    Google Scholar 

  32. Liu, X., Peng, Q., Fan, X., Frame loss concealment for multi-view video plus depth. In: Proceedings of the IEEE 15th International Symposium Consumer Electronics—ISCE 2011, pp. 208–211 (2011)

    Google Scholar 

  33. Lie W.-N., Lin, G.-H.: Error concealment for 3D video transmission. In: Proceedings of the IEEE International Symposium on Circuits and Systems - ISCAS - 2013, pp. 2559–2856 (2013)

    Google Scholar 

  34. Zhang, X., Zhao, Y., Lin, C., Bai, H., Yao, C., Wang, A.: Warping-driven mode selection for depth error concealment. In: Proceedings of the IEEE Global Conference on Signal and Information Processing—GlobalSIP 2014, pp. 302–306 (2014)

    Google Scholar 

  35. Marcelino, S., Assuncao, P., de Faria, S.M.M., Soares, S.: Error recovery of image-based depth maps using Bézier curve fitting. In: Proceedings of the International Conference on Image Processing—ICIP 2011, pp. 2293–2296 (2011)

    Google Scholar 

  36. Marcelino, S., Assuncao, P., de Faria, S.M.M., Soares, S.: Lost block reconstruction in depth maps using color image contours. In: Proceedings of the Picture Coding Symposium - PCS 2012, pp. 253–256 (2012)

    Google Scholar 

  37. Marcelino, S., Assuncao, P., de Faria, S.M.M., Soares, S.: Efficient depth error concealment for 3D video over error-prone channels. In: Proceedings of the IEEE International Symposium on Broadband Multimedia Systems and Broadcasting—BMSB 2013, pp. 1–5 (2013)

    Google Scholar 

  38. Marcelino, S., Assuncao, P., Faria, S.M.M., Soares, S.: Depth map concealment using interview warping vectors from geometric transforms. In: Proceedings of the 20th IEEE International Conference on Image Processing—ICIP 2013, pp. 1821–1825 (2013)

    Google Scholar 

  39. Marcelino, S.: Adaptação e Optimização de Qualidade em Serviços Futuros de Vídeo 3D—Depth error concealment for 3D video over error-prone networks. Universidade de Trás-os-Montes e Alto Douro, Vila Real, Portugal (2016)

    Google Scholar 

  40. Correia,P., Marcelino, S., Assuncao, P., de Faria, S.M.M., Soares, S, Pagliari, C., da Silva, E.: Enhancement method for multiple description decoding of depth maps subject to random loss. 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1–4 (2014)

    Google Scholar 

  41. Marcelino, S., Assuncao, P., de Faria, S.M.M., Soares, S.: Robust decoding of MDC Depth Maps for enhanced 3D video over Hybrid Broadcasting Networks. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–5, Nara—Japan (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Instituto de Telecomunicações, Leiria, Portugal

    Sérgio M. M. de Faria, Sylvain Marcelino & Pedro Amado Assunção

  2. Politécnico de Leiria, Leiria, Portugal

    Sérgio M. M. de Faria & Pedro Amado Assunção

  3. Department of Communications and Computer Engineering, University of Malta, Msida, Malta

    Carl J. Debono

  4. Douro/ECT Engineering Department, Universidade de Trás-os-Montes e Alto Douro, Vila Real, Portugal

    Sylvain Marcelino & Salviano Soares

  5. IEETA, University of Aveiro Campus, Aveiro, Portugal

    Salviano Soares

Authors
  1. Sérgio M. M. de Faria
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sylvain Marcelino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carl J. Debono
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Salviano Soares
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pedro Amado Assunção
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sérgio M. M. de Faria .

Editor information

Editors and Affiliations

  1. Instituto de Telecomunicações and Politécnico de Leiria, Leiria, Portugal

    Pedro Amado Assunção

  2. Department of Signal Processing, Tampere University of Technology, Tampere, Finland

    Atanas Gotchev

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

de Faria, S.M.M., Marcelino, S., Debono, C.J., Soares, S., Assunção, P.A. (2019). Error Concealment Methods for Multiview Video and Depth. In: Assunção, P., Gotchev, A. (eds) 3D Visual Content Creation, Coding and Delivery. Signals and Communication Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-77842-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77842-6_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77841-9

  • Online ISBN: 978-3-319-77842-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation