Classification-Based Spatial Error Concealment for Visual Communications

Open Access
Research Article
Part of the following topical collections:
  1. Video Analysis and Coding for Robust Transmission

Abstract

In an error-prone transmission environment, error concealment is an effective technique to reconstruct the damaged visual content. Due to large variations of image characteristics, different concealment approaches are necessary to accommodate the different nature of the lost image content. In this paper, we address this issue and propose using classification to integrate the state-of-the-art error concealment techniques. The proposed approach takes advantage of multiple concealment algorithms and adaptively selects the suitable algorithm for each damaged image area. With growing awareness that the design of sender and receiver systems should be jointly considered for efficient and reliable multimedia communications, we proposed a set of classification-based block concealment schemes, including receiver-side classification, sender-side attachment, and sender-side embedding. Our experimental results provide extensive performance comparisons and demonstrate that the proposed classification-based error concealment approaches outperform the conventional approaches.

Keywords

Lost Spatial Error Extensive Performance Visual Content Visual Communication 

References

  1. 1.
    Wang Y, Zhu Q-F: Error control and concealment for video communication: a review. Proceedings of the IEEE 1998, 86(5):974-997. 10.1109/5.664283CrossRefGoogle Scholar
  2. 2.
    Kwok W, Sun H: Multi-directional interpolation for spatial error concealment. IEEE Transactions on Consumer Electronics 1993, 39(3):455-460. 10.1109/30.234620CrossRefGoogle Scholar
  3. 3.
    Sun H, Kwok W: Concealment of damaged block transform coded images using projections onto convex sets. IEEE Transactions on Image Processing 1995, 4(4):470-477. 10.1109/83.370675CrossRefGoogle Scholar
  4. 4.
    Wang Y, Zhu Q-F, Shaw L: Maximally smooth image recovery in transform coding. IEEE Transactions on Communications 1993, 41(10):1544-1551. 10.1109/26.237889CrossRefMATHGoogle Scholar
  5. 5.
    Zeng W, Liu B: Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(4):648-665. 10.1109/76.767129CrossRefGoogle Scholar
  6. 6.
    Li X, Orchard MT: Novel sequential error-concealment techniques using orientation adaptive interpolation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):857-864. 10.1109/TCSVT.2002.804882CrossRefGoogle Scholar
  7. 7.
    Zhang D, Wang Z: Image information restoration based on long-range correlation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(5):331-341. 10.1109/TCSVT.2002.1003472CrossRefGoogle Scholar
  8. 8.
    Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 2003, 12(8):882-889. 10.1109/TIP.2003.815261CrossRefGoogle Scholar
  9. 9.
    Yin P, Liu B, Yu HH: Error concealment using data hiding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1453-1456.Google Scholar
  10. 10.
    Yin P, Wu M, Liu B: Robust error-resilient approach for MPEG video transmission over Internet. Visual Communications and Image Processing (VCIP '02), January 2002, San Jose, Calif, USA, Proceedings of SPIE 4671: 103-111.Google Scholar
  11. 11.
    Liu Y, Li Y: Error concealment of digital images using data hiding. Proceeding of 9th IEEE DSP Workshop, October 2000, Hunt, Tex, USAGoogle Scholar
  12. 12.
    Jung K-H, Chang J-H, Lee CW: Error concealment technique using projection data for block-based image coding. Visual Communications and Image Processing (VCIP '94), September 1994, Chicago, Ill, USA, Proceedings of SPIE 2308, part 3: 1466-1476.CrossRefGoogle Scholar
  13. 13.
    Duda RO, Hart PE, Stork DG: Pattern Classification. 2nd edition. John Wiley & Sons, New York, NY, USA; 2001.MATHGoogle Scholar
  14. 14.
    Joachims T: Text categorization with support vector machines: learning with many relevant features. Proceedings of 10th European Conference on Machine Learning (ECML '98), April 1998, Chemnitz, Germany 137-142.CrossRefGoogle Scholar
  15. 15.
    Burges CJC: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121-167. 10.1023/A:1009715923555CrossRefGoogle Scholar
  16. 16.
    Vapnik VN: The Nature of Statistical Learning Theory. Springer, Berlin, Germany; 1995.CrossRefMATHGoogle Scholar
  17. 17.
    Smola AJ, Bartlett P, Schölkopf B, Schuurmans D: Advances in Large Margin Classifiers. MIT Press, Cambridge, Mass, USA; 1999.MATHGoogle Scholar
  18. 18.
    Joachims T:Open image in new window Support Vector Machine V5.00. 2002.http://svmlight.joachims.orgGoogle Scholar
  19. 19.
    Joachims T: Making large-scale SVM learning practical. In Advances in Kernel Methods—Support Vector Learning. Edited by: Schölkopf B, Burges CJC, Smola AJ. MIT Press, Cambridge, Mass, USA; 1999:169-184.Google Scholar
  20. 20.
    Wu M, Liu B: Multimedia Data Hiding. Springer, New York, NY, USA; 2002.MATHGoogle Scholar
  21. 21.
    Wu M, Liu B: Data hiding in image and video: Part-I Fundamental issues and solutions. IEEE Transactions on Image Processing 2003, 12(6):685-695. 10.1109/TIP.2003.810588CrossRefGoogle Scholar
  22. 22.
    Wu M, Yu HH, Gelman A: Multi-level data hiding for digital image and video. Multimedia Systems and Applications II, September 1999, Boston, Mass, USA, Proceedings of SPIE 3845: 10-21.CrossRefGoogle Scholar
  23. 23.
    Dovrolis C, Tull D, Ramanathan P: Hybrid spatial/temporal loss concealment for packet video. Proceedings of the 9th International Packet Video Workshop (PVW '99), April 1999, New York, NY, USAGoogle Scholar
  24. 24.
    Lee Y-C, Altunbasak Y, Mersereau RM: A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 990-993.Google Scholar
  25. 25.
    Chen M, He Y, Lagendijk RL: A fragile watermark error detection scheme for wireless video communications. IEEE Transactions on Multimedia 2005, 7(2):201-211.CrossRefGoogle Scholar
  26. 26.
    Chen M, Wu M, Zheng Y: Classification-based spatial error concealment for images. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 675-678.Google Scholar

Copyright information

© Chen et al. 2006

Authors and Affiliations

  1. 1.Department of Electrical and Computer EngineeringUniversity of MarylandCollege ParkUSA

Personalised recommendations