Advertisement

Multimedia Tools and Applications

, Volume 62, Issue 3, pp 659–680 | Cite as

Arbitrarily shaped virtual-object based video compression

  • Naresh Sharma
  • Junda Zhu
  • Yuan F. Zheng
  • Eric J. BalsterEmail author
Article

Abstract

Object based compression techniques are widely believed to have the potential to give the best compression results for a given signal quality. However, true object tracking and extraction are difficult and computationally expensive. In this paper, an arbitrarily shaped virtual-object compression method is developed. The method is similar to the object based compression methods in that it separates the changing portion of the video from the stationary portion, and encodes them independently. The changing portion of the video is grouped as a 3D arbitrarily shaped virtual-object whereas the unchanged portion of the video is grouped as background. The arbitrarily shaped virtual object is coded using 3D wavelet compression whereas stationary background is coded as a single frame using 2D wavelet compression. Experimental results demonstrate that the newly developed method has comparable performance with the state-of-the-art compression methods and significantly outperforms rectangular virtual-object compression.

Keywords

Arbitrarily shaped virtual-object Shape adaptive wavelet transform 3D wavelet compression 

References

  1. 1.
    Abu-Hajar A, Sankar R (2002) Integer-to-integer shape adaptive wavelet transform for region of interest image coding. In: Proc. IEEE 10th digital signal processing workshop, and the 2nd signal processing education workshop, pp 94–97Google Scholar
  2. 2.
    Adhami R (1996) Video compression technique using wavelet transform. In: Proc. IEEE conf. aerospace applications, vol 4, pp 449–455Google Scholar
  3. 3.
    Avaro O, Eleftheriadis A, Herpel C, Rajan G, Ward L (2000) MPEG-4 systems: overviewGoogle Scholar
  4. 4.
    Balster EJ (2004) Video compression and rate-constrained control methods based on the wavelet transform. PhD thesis, The Ohio State UniversityGoogle Scholar
  5. 5.
    Balster EJ, Zheng YF (2005) Virtual-object video compression. In: Proc. 48th midwest symposium on circuits and systems, pp 1700–1704Google Scholar
  6. 6.
    Balster EJ, Zheng YF, Ewing RL (2005) Feature-based wavelet shrinkage algorithm for image denoising. IEEE Trans Image Process 14(12):2024–2039CrossRefGoogle Scholar
  7. 7.
    Balster EJ, Zheng YF, Ewing RL (2006) Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising. IEEE Trans Circuits Syst Video Technol 16(2):220–230CrossRefGoogle Scholar
  8. 8.
    BBC Research (2010) Dirac overview. http://www.bbc.co.uk/rd/projects/dirac/overview.shtml. Accessed 4 Mar 2011
  9. 9.
    Bindulal TS, Kaima MR (2007) Object coding using a shape adaptive wavelet transform with scalable WDR method. In: Proc. IEEE intl. conf. image processing, vol 2, pp 325–328 (2007)Google Scholar
  10. 10.
    Crave O, Pesquet-Popescu B, Guillemot C (2010) Robust video coding based on multiple description scalar quantization with side information. IEEE Trans Circuits Syst Video Technol 20(6):769–779CrossRefGoogle Scholar
  11. 11.
    Fowler JE (2000) Qccpack: an open-source software library for quantization, compression, and coding. In: Tescher AG (ed) Applications of digital image processing XXIII, San Diego, CA, Proc SPIE, vol 4115Google Scholar
  12. 12.
    Guo C, Zhang L (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process 19(1):185–198MathSciNetCrossRefGoogle Scholar
  13. 13.
    Guo H, Burrus C (1997) Wavelet transform based fast approximate fourier transform. In: Proc IEEE intl. conf. acoustics, speech, and signal processing, vol 3, pp 1973–1976Google Scholar
  14. 14.
    He C, Zheng YF, Ahalt SC (2002) Object tracking using the gabor wavelet transform and the golden section algorithm. IEEE Trans Multimedia 4(4):528–538CrossRefGoogle Scholar
  15. 15.
    He C, Dong J, Zheng YF, Gao Z (2003) Optimal 3-D coefficient tree structure for 3-D wavelet video coding. IEEE Trans Circuits Syst Video Technol 13(10):961–972CrossRefGoogle Scholar
  16. 16.
    Hwang YT, Wang YC, Wang SS (2001) An efficient shape coding scheme and its codec design. In: Proc. IEEE workshop on signal processing systems, pp 225–232Google Scholar
  17. 17.
    ISO/IEC (1993) ISO/IEC 11172-2: information technology—coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbits/s - part 2: video. International Organization of Standarization, Geneva, SwizerlandGoogle Scholar
  18. 18.
    ISO/IEC (1995) ISO/IEC 13818-2: information technology—generic coding of moving pictures and associated audio information: video. International Organization of Standarization, Geneva, SwizerlandGoogle Scholar
  19. 19.
    ISO/IEC (1998) ISO/IEC 14496-10: information technology—coding of audio-visual objects : MPEG-4 systems. International Organization of Standarization, Geneva, SwizerlandGoogle Scholar
  20. 20.
    ISO/IEC (2004) ISO/IEC 14496-10: information technology—coding of audio-visual objects-part 10 : advanced video coding. International Organization for Standarization, Geneva, SwitzerlandGoogle Scholar
  21. 21.
    Jiang C, Zhu L (2010) Design and optimization of video compression system based on H.264. In: Proc. intl. conf. on optoelectronics and image processing (ICOIP), vol 1, pp 376–379Google Scholar
  22. 22.
    Jiang C, Zhu L (2010) Design and optimization of video compression system based on MPEG-4. In: Proc. intl. conf. computer application and system modeling (ICCASM), vol 15, pp 275–278Google Scholar
  23. 23.
    Jozawa H, Watanabe H, Singhal S (1992) Interframe video coding using overlapped motion compensation and perfect reconstruction filter banks. In: Proc. IEEE intl. conf. acoustics, speech, and signal processing, vol 4, pp 649–652Google Scholar
  24. 24.
    Kao MP, Nguyen TQ (2010) Rate-distortion optimized bitstream extractor for motion scalability in wavelet-based scalable video coding. IEEE Trans Image Process 19(5):1214–1223MathSciNetCrossRefGoogle Scholar
  25. 25.
    Karlsson G, Vetterli M (1988) Three dimensional sub-band coding of video. In: Proc. intl. conf. acoustics, speech, and signal processing, pp 1100–1103Google Scholar
  26. 26.
    van der Laan WJ, Jalba AC, Roerdink JB (2011) Accelerating wavelet lifting on graphics hardware using cuda. IEEE Trans Parallel Distrib Syst 22(1):132–146CrossRefGoogle Scholar
  27. 27.
    Li J, Lei S (1998) Arbitrary shape wavelet transform with phase alignment. In: Proc. IEEE intl. conf. image processing, vol 3, pp 683–687Google Scholar
  28. 28.
    Li S, Li W (2000) Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding. IEEE Trans Circuits Syst Video Technol 10(5):725–743CrossRefGoogle Scholar
  29. 29.
    Lin C, Zhang B, Zheng YF (2000) Packed integer wavelet transform constructed by lifting scheme. IEEE Trans Circuits Syst Video Technol 10(8):1496–1501CrossRefGoogle Scholar
  30. 30.
    Liu Y, Ngan KN, Wu F (2008) 3-D shape-adaptive directional wavelet transform for object-based scalable video coding. IEEE Trans Circuits Syst Video Technol 18(7):888–899CrossRefGoogle Scholar
  31. 31.
    Martucci SA, Sodagar I, Chiang T, Zhang Y (1997) A zerotree wavelet video coder. IEEE Trans Circuit Syst Video Technol 7(1):109–118CrossRefGoogle Scholar
  32. 32.
    MSU Graphics and Media Lab (Video Group) (2011) MSU video quality measurement tool. http://compression.ru/video/quality_measure/video_measurement_tool_en.html. Accessed 4 Mar 2011
  33. 33.
    Oktiawati UY, Yap VV (2007) Video compression using dual tree complex wavelet transform. In: Proc. Intl. conf. intelligent and advanced systems, pp 775–778Google Scholar
  34. 34.
    Polzer A, Klock H, Buhrmann JM (1997) Video coding by region-based motion compensation and spatio-temporal wavelet transform. In: Proc. intl. conf. image processing, vol 3, pp 436–439Google Scholar
  35. 35.
    Shen Z, Frater MR, Arnold JF (2008) Quad-tree block-based binary shape coding. IEEE Trans Circuit Syst Video Technol 18(6):845–850CrossRefGoogle Scholar
  36. 36.
    Sikora T, Makai B (1995) Shape-adaptive DCT for generic coding of video. IIEEE Trans Circuit Syst Video Technol 5(1):59–62CrossRefGoogle Scholar
  37. 37.
    Strat TM (2001) Object-based encoding: next-generation video compression. In: Proc. workshop and exhibition. MPEG-4, pp 53–57Google Scholar
  38. 38.
    Sweldens W (1996) The lifting scheme: a custom design construction of biorthogonal wavelets. Appl Comput Harmon Anal 3(2):186–200MathSciNetzbMATHCrossRefGoogle Scholar
  39. 39.
    Tan W, Chan E, Zalchor A (1996) Real time software implementation of scalable video codec. In: Proc. intl. conf. image processing, vol 1, pp 17–20Google Scholar
  40. 40.
    Tham JY, Ranganath S, Kassim AA (1998) Highly scalable wavelet-based video codec for very low bit-rate environment. IEEE J Sel Areas Commun 16(1):12–27CrossRefGoogle Scholar
  41. 41.
    Tsai MJ, Villasenor JD, Chen F (1996) Stack-run image coding. IEEE Trans Circuit Syst Video Technol 6(5):519–521CrossRefGoogle Scholar
  42. 42.
    VideoLan.org (2011) http://www.videolan.org/developers/x264.html. Accessed 4 Mar 2011
  43. 43.
    Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE computer society conf computer vision and pattern recognition, vol 1, pp 511–518Google Scholar
  44. 44.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRefGoogle Scholar
  45. 45.
    Xing G, Li J, Li S, Zhang YQ (2001) Arbitrarily shaped video-object coding by wavelet. IEEE Trans Circuit Syst Video Technol 11(10):1135–1139CrossRefGoogle Scholar
  46. 46.
    Xiong Z, Ramchandran K, Orchard MT, Zhang Y (1998) A comparative study of DCT and wavelet based coding. In: Proc. IEEE intl. symp. circuits and systems, vol 4, pp 273–276Google Scholar
  47. 47.
    Zhou L, Zahir S (2006) A novel shape coding scheme for MPEG-4 visual standard. In: Proc. intl. conf. innovative computing, information and control, vol 3, pp 585–588Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Naresh Sharma
    • 1
  • Junda Zhu
    • 1
  • Yuan F. Zheng
    • 1
  • Eric J. Balster
    • 2
    Email author
  1. 1.Department of Electrical and Computer EngineeringThe Ohio State UniversityColumbusUSA
  2. 2.Department of Electrical and Computer EngineeringUniversity of DaytonDaytonUSA

Personalised recommendations