Advertisement

Multimedia Tools and Applications

, Volume 75, Issue 16, pp 9927–9947 | Cite as

An effiicient full frame algorithm for object-based error concealment in 3D depth-based video

  • Shen-Chuan Tai
  • Chuen-Ching Wang
  • Chien-Shiang Hong
  • Ya-Chiung Luo
Article

Abstract

In real-time video transmission, the loss of packet results in visual quality degraded for the succeeding frames. This paper proposes an efficient full frame algorithm for depth-based 3-D videos. Each frame can be regarded as combination of objects. True motion estimation (TME) and depth map are exploited to calculate the motion vector (MV) for each object. In this paper, the object is defined as the pixels with the same MV and similar depth value. The object-based MV can extrapolate each object in reference frame to reconstruct the damage frame. In the consideration of computational complexity, in this method, only the high frequency regions need to execute TME. In this paper, we provide a new method to obtain the objects according to temporal and depth information. From the simulation results, our algorithm gives better visual quality and PSNR in most case with lower complexity.

Keywords

Error concealment H.264/AVC Depth map 3D video 

Notes

Acknowledgments

The authors thank the National Science Council in Taiwan (NSC 99-2221-E-471-002- and 102-2221-E-244-017-) for the financial support.

References

  1. 1.
    Chen MJ, Chen CS, Chi MC (2005) Temporal error concealment algorithm by recursive block-matching principle. IEEE Trans Circ Syst Video Technol 15(11):1385–1393CrossRefGoogle Scholar
  2. 2.
    Chen C, Liu Y, Yang Z, Bu J, Deng X (2008) Multi-frame error concealment for H.264/AVC frames with complexity adaptation. IEEE Trans Consum Electron 54(3):1422–1429CrossRefGoogle Scholar
  3. 3.
    Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3DTV”. Proc SPIE Stereoscopic Displays Virtual Real Syst XI 5291:93–104Google Scholar
  4. 4.
    Hong CS (2006) “An object-base motion vector recovery strategy for H.264/AVC,” National Cheng Kung University of Education, Master dissertationGoogle Scholar
  5. 5.
    Liu Y, Wang J, Zhang H (2010) Depth image-based temporal error concealment for 3-D video transmission. IEEE Trans Circ Syst Video Technol 20(4):600–604CrossRefGoogle Scholar
  6. 6.
    Tai SC, Chen YR, Huang ZB, Wang CC (2008) A multi-pass true motion estimation scheme with motion vector propagation for frame rate up-conversion applications. IEEE/OSA J Display Technol 4(2):188–197CrossRefGoogle Scholar
  7. 7.
    Thaipanich T, Wu PH, Kuo CCJ (2007) Video error concealment with outer and inner boundary matching algorithm. SPIE 6696:669607Google Scholar
  8. 8.
    Tsekeridou S, Pitas I (2000) MPEG-2 error concealment based on block-matching principles. IEEE Trans Circ Syst Video Technol 10(4):646–658CrossRefGoogle Scholar
  9. 9.
    Wang Z, Yu Y, Zhang D (1998) Best neighboring matching: an information loss restoration technique for block-based image coding systems. IEEE Trans Image Process 7:1056–1061CrossRefGoogle Scholar
  10. 10.
    Wang Y, Zhu QF (1998) Error control and concealment for video communication: a review. Proc IEEE 86:974–997CrossRefGoogle Scholar
  11. 11.
    Wang Y, Zhu QF, Shaw L (1993) Maximally smooth image recovery in transform coding. IEEE Trans Commun 41(10):1544–1551CrossRefMATHGoogle Scholar
  12. 12.
    Wu Z, Boyce JM (2006) “An error concealment scheme for entire frame losses based on H.264/AVC”. IEEE Int Symp Circ Syst. 4463–4466Google Scholar
  13. 13.
    Yan B (2007) “A novel H.264 based motion vector recovery method for 3D video transmission”. IEEE Trans Consum Electron 53(4)Google Scholar
  14. 14.
    Yan B, Gharavi H (2010) A hybrid frame concealment algorithm for H.264/AVC. IEEE Trans Image Process 19:98–107MathSciNetCrossRefGoogle Scholar
  15. 15.
    Yan B, Zhou J (2012) Efficient frame concealment for depth image-based 3-D Video transmission. IEEE Trans Multimed 4:936–941CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.Institute of Computer and Communication EngineeringCheng Kung UniversityTainanRepublic of China
  2. 2.Department of Information TechnologyKao Yuan UniversityKaohsiungRepublic of China

Personalised recommendations