Skip to main content
Log in

Arbitrarily shaped virtual-object based video compression

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Object based compression techniques are widely believed to have the potential to give the best compression results for a given signal quality. However, true object tracking and extraction are difficult and computationally expensive. In this paper, an arbitrarily shaped virtual-object compression method is developed. The method is similar to the object based compression methods in that it separates the changing portion of the video from the stationary portion, and encodes them independently. The changing portion of the video is grouped as a 3D arbitrarily shaped virtual-object whereas the unchanged portion of the video is grouped as background. The arbitrarily shaped virtual object is coded using 3D wavelet compression whereas stationary background is coded as a single frame using 2D wavelet compression. Experimental results demonstrate that the newly developed method has comparable performance with the state-of-the-art compression methods and significantly outperforms rectangular virtual-object compression.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abu-Hajar A, Sankar R (2002) Integer-to-integer shape adaptive wavelet transform for region of interest image coding. In: Proc. IEEE 10th digital signal processing workshop, and the 2nd signal processing education workshop, pp 94–97

  2. Adhami R (1996) Video compression technique using wavelet transform. In: Proc. IEEE conf. aerospace applications, vol 4, pp 449–455

  3. Avaro O, Eleftheriadis A, Herpel C, Rajan G, Ward L (2000) MPEG-4 systems: overview

  4. Balster EJ (2004) Video compression and rate-constrained control methods based on the wavelet transform. PhD thesis, The Ohio State University

  5. Balster EJ, Zheng YF (2005) Virtual-object video compression. In: Proc. 48th midwest symposium on circuits and systems, pp 1700–1704

  6. Balster EJ, Zheng YF, Ewing RL (2005) Feature-based wavelet shrinkage algorithm for image denoising. IEEE Trans Image Process 14(12):2024–2039

    Article  Google Scholar 

  7. Balster EJ, Zheng YF, Ewing RL (2006) Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising. IEEE Trans Circuits Syst Video Technol 16(2):220–230

    Article  Google Scholar 

  8. BBC Research (2010) Dirac overview. http://www.bbc.co.uk/rd/projects/dirac/overview.shtml. Accessed 4 Mar 2011

  9. Bindulal TS, Kaima MR (2007) Object coding using a shape adaptive wavelet transform with scalable WDR method. In: Proc. IEEE intl. conf. image processing, vol 2, pp 325–328 (2007)

  10. Crave O, Pesquet-Popescu B, Guillemot C (2010) Robust video coding based on multiple description scalar quantization with side information. IEEE Trans Circuits Syst Video Technol 20(6):769–779

    Article  Google Scholar 

  11. Fowler JE (2000) Qccpack: an open-source software library for quantization, compression, and coding. In: Tescher AG (ed) Applications of digital image processing XXIII, San Diego, CA, Proc SPIE, vol 4115

  12. Guo C, Zhang L (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process 19(1):185–198

    Article  MathSciNet  Google Scholar 

  13. Guo H, Burrus C (1997) Wavelet transform based fast approximate fourier transform. In: Proc IEEE intl. conf. acoustics, speech, and signal processing, vol 3, pp 1973–1976

  14. He C, Zheng YF, Ahalt SC (2002) Object tracking using the gabor wavelet transform and the golden section algorithm. IEEE Trans Multimedia 4(4):528–538

    Article  Google Scholar 

  15. He C, Dong J, Zheng YF, Gao Z (2003) Optimal 3-D coefficient tree structure for 3-D wavelet video coding. IEEE Trans Circuits Syst Video Technol 13(10):961–972

    Article  Google Scholar 

  16. Hwang YT, Wang YC, Wang SS (2001) An efficient shape coding scheme and its codec design. In: Proc. IEEE workshop on signal processing systems, pp 225–232

  17. ISO/IEC (1993) ISO/IEC 11172-2: information technology—coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbits/s - part 2: video. International Organization of Standarization, Geneva, Swizerland

  18. ISO/IEC (1995) ISO/IEC 13818-2: information technology—generic coding of moving pictures and associated audio information: video. International Organization of Standarization, Geneva, Swizerland

  19. ISO/IEC (1998) ISO/IEC 14496-10: information technology—coding of audio-visual objects : MPEG-4 systems. International Organization of Standarization, Geneva, Swizerland

  20. ISO/IEC (2004) ISO/IEC 14496-10: information technology—coding of audio-visual objects-part 10 : advanced video coding. International Organization for Standarization, Geneva, Switzerland

  21. Jiang C, Zhu L (2010) Design and optimization of video compression system based on H.264. In: Proc. intl. conf. on optoelectronics and image processing (ICOIP), vol 1, pp 376–379

  22. Jiang C, Zhu L (2010) Design and optimization of video compression system based on MPEG-4. In: Proc. intl. conf. computer application and system modeling (ICCASM), vol 15, pp 275–278

  23. Jozawa H, Watanabe H, Singhal S (1992) Interframe video coding using overlapped motion compensation and perfect reconstruction filter banks. In: Proc. IEEE intl. conf. acoustics, speech, and signal processing, vol 4, pp 649–652

  24. Kao MP, Nguyen TQ (2010) Rate-distortion optimized bitstream extractor for motion scalability in wavelet-based scalable video coding. IEEE Trans Image Process 19(5):1214–1223

    Article  MathSciNet  Google Scholar 

  25. Karlsson G, Vetterli M (1988) Three dimensional sub-band coding of video. In: Proc. intl. conf. acoustics, speech, and signal processing, pp 1100–1103

  26. van der Laan WJ, Jalba AC, Roerdink JB (2011) Accelerating wavelet lifting on graphics hardware using cuda. IEEE Trans Parallel Distrib Syst 22(1):132–146

    Article  Google Scholar 

  27. Li J, Lei S (1998) Arbitrary shape wavelet transform with phase alignment. In: Proc. IEEE intl. conf. image processing, vol 3, pp 683–687

  28. Li S, Li W (2000) Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding. IEEE Trans Circuits Syst Video Technol 10(5):725–743

    Article  Google Scholar 

  29. Lin C, Zhang B, Zheng YF (2000) Packed integer wavelet transform constructed by lifting scheme. IEEE Trans Circuits Syst Video Technol 10(8):1496–1501

    Article  Google Scholar 

  30. Liu Y, Ngan KN, Wu F (2008) 3-D shape-adaptive directional wavelet transform for object-based scalable video coding. IEEE Trans Circuits Syst Video Technol 18(7):888–899

    Article  Google Scholar 

  31. Martucci SA, Sodagar I, Chiang T, Zhang Y (1997) A zerotree wavelet video coder. IEEE Trans Circuit Syst Video Technol 7(1):109–118

    Article  Google Scholar 

  32. MSU Graphics and Media Lab (Video Group) (2011) MSU video quality measurement tool. http://compression.ru/video/quality_measure/video_measurement_tool_en.html. Accessed 4 Mar 2011

  33. Oktiawati UY, Yap VV (2007) Video compression using dual tree complex wavelet transform. In: Proc. Intl. conf. intelligent and advanced systems, pp 775–778

  34. Polzer A, Klock H, Buhrmann JM (1997) Video coding by region-based motion compensation and spatio-temporal wavelet transform. In: Proc. intl. conf. image processing, vol 3, pp 436–439

  35. Shen Z, Frater MR, Arnold JF (2008) Quad-tree block-based binary shape coding. IEEE Trans Circuit Syst Video Technol 18(6):845–850

    Article  Google Scholar 

  36. Sikora T, Makai B (1995) Shape-adaptive DCT for generic coding of video. IIEEE Trans Circuit Syst Video Technol 5(1):59–62

    Article  Google Scholar 

  37. Strat TM (2001) Object-based encoding: next-generation video compression. In: Proc. workshop and exhibition. MPEG-4, pp 53–57

  38. Sweldens W (1996) The lifting scheme: a custom design construction of biorthogonal wavelets. Appl Comput Harmon Anal 3(2):186–200

    Article  MathSciNet  MATH  Google Scholar 

  39. Tan W, Chan E, Zalchor A (1996) Real time software implementation of scalable video codec. In: Proc. intl. conf. image processing, vol 1, pp 17–20

  40. Tham JY, Ranganath S, Kassim AA (1998) Highly scalable wavelet-based video codec for very low bit-rate environment. IEEE J Sel Areas Commun 16(1):12–27

    Article  Google Scholar 

  41. Tsai MJ, Villasenor JD, Chen F (1996) Stack-run image coding. IEEE Trans Circuit Syst Video Technol 6(5):519–521

    Article  Google Scholar 

  42. VideoLan.org (2011) http://www.videolan.org/developers/x264.html. Accessed 4 Mar 2011

  43. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE computer society conf computer vision and pattern recognition, vol 1, pp 511–518

  44. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  45. Xing G, Li J, Li S, Zhang YQ (2001) Arbitrarily shaped video-object coding by wavelet. IEEE Trans Circuit Syst Video Technol 11(10):1135–1139

    Article  Google Scholar 

  46. Xiong Z, Ramchandran K, Orchard MT, Zhang Y (1998) A comparative study of DCT and wavelet based coding. In: Proc. IEEE intl. symp. circuits and systems, vol 4, pp 273–276

  47. Zhou L, Zahir S (2006) A novel shape coding scheme for MPEG-4 visual standard. In: Proc. intl. conf. innovative computing, information and control, vol 3, pp 585–588

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eric J. Balster.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sharma, N., Zhu, J., Zheng, Y.F. et al. Arbitrarily shaped virtual-object based video compression. Multimed Tools Appl 62, 659–680 (2013). https://doi.org/10.1007/s11042-011-0869-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0869-z

Keywords

Navigation