Multimedia Tools and Applications

, Volume 1, Issue 1, pp 89–111 | Cite as

Video parsing and browsing using compressed data

  • Hongjiang Zhang
  • Chien Yong Low
  • Stephen W. Smoliar


Parsing video content is an important first step in the video indexing process. This paper presents algorithms to automate the video parsing task, including partitioning a source video into clips and classifying those clips according to camera operations, using compressed video data. We have developed two algorithms and a hybrid approach to partitioning video data compressed according to the JPEG and MPEG standards. The algorithms utilize both the video content encoded in DCT (Discrete Cosine Transform) coefficients and the motion vectors between frames. The hybrid approach integrates the two algorithms and incorporates multi-pass strategies and motion analyses to improve both accuracy and processing speed. Also, we present content-based video browsing tools which utilize the information, particularly about the shot boundaries and key frames, obtained from parsing.


video parsing video compression MPEG JPEG video retrieval video browsing motion analysis camera operation video database multimedia systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    F. Arman, A. Hsu, and M.-Y. Chiu, “Image Processing on Compressed Data for Large Video Databases,” Proc. ACM Multimedia 93, Anaheim, CA, pp. 267–272, 1993.Google Scholar
  2. 2.
    D. Le Gall, “MPEG: A Video Compression Standard for Multimedia Applications,” Communications of the ACM, 34 (4), pp. 46–58, 1991.Google Scholar
  3. 3.
    R.M. Haralick and L.G. Shapiro, “Computer and Robot Vision,” Vol. 2, Addison-Wesley, Reading, MA, 1993.Google Scholar
  4. 4.
    M. Mills, J. Cohen, and Y.Y. Wong, “A Magnifier Tool for Video Data,” Proc. CHI '92, Monterey, CA, pp. 93–98, 1992.Google Scholar
  5. 5.
    A. Nagasaka and Y. Tanaka, “Automatic Video Indexing and Full-Video Search for Object Appearances,” Visual Database Systems, II, E. Knuth and L.M. Wegner, editors, North-Holland, pp. 119–133, 1991.Google Scholar
  6. 6.
    B.C. O'Connor, “Selecting Key Frames of Moving Image Documents: A Digital Environment for Analysis and Navigation,” Microcomputers for Information Management, 8(2), pp. 119–133, 1991.Google Scholar
  7. 7.
    R. Steinmetz, “Data Compression in Multimedia Computing—Standards and Systems,” Multimedia Systems, 1(4), pp. 187–204, 1994.Google Scholar
  8. 8.
    D. Swanberg, C.-F. Shu, and R. Jain, “Knowledge Guided Parsing in Video Databases,” Proc. IS&T/SPIE Conf. on Storage and Retrieval for Image and Video Databases, San Jose, CA, 1993.Google Scholar
  9. 9.
    L. Teodosio and W. Bender, “Salient Video Stills: Content and Context Preserved,” Proc. ACM Multimedia 93, Anaheim, CA, pp. 39–46, 1993.Google Scholar
  10. 10.
    Y.T. Tse and R.L. Baker, “Camera Zoom/Pan Estimation and Compensation for Video Compression,” Proc. SPIE Conf. on Image Processing Algorithms and Techniques II, Boston, MA, pp. 468–79, 1991.Google Scholar
  11. 11.
    H. Ueda, T. Miyatake, and S. Yoshizawa, “IMPACT: An Interactive Natural-Motion-Picture Multimedia Authoring System,” Proc. CHI'91, New Orleans, LA, pp. 343–350, 1991.Google Scholar
  12. 12.
    G.K. Wallace, “The JPEG Still Picture Compression Standard,” Communications of the ACM, 34(4), pp. 30–44, 1991.Google Scholar
  13. 13.
    H.J. Zhang, A. Kankanhalli, and S.W. Smoliar, “Automatic Partitioning of Full-motion Video,” Multimedia Systems, 1(1), pp. 10–28, 1993.Google Scholar
  14. 14.
    H.J. Zhang, C.Y. Low, Y. Gong, and S.W. Smoliar, “Video Parsing Using Compressed Data,” Proc. IS&T/SPIE Conf. on Image and Video Processing II, San Jose, CA, pp. 142–149, 1994.Google Scholar
  15. 15.
    H.J. Zhang and S.W. Smoliar, “Developing Power Tools for Video Indexing and Retrieval,” Proc. IS&T/SPIE Conf. on Storage and Retrieval for Image and Video Databases II, San Jose, CA, pp. 140–149, 1994.Google Scholar

Copyright information

© Kluwer Academic Publishers 1995

Authors and Affiliations

  • Hongjiang Zhang
    • 1
  • Chien Yong Low
    • 1
  • Stephen W. Smoliar
    • 1
  1. 1.Institute of Systems ScienceNational University of SingaporeSingaporeRepublic of Singapore

Personalised recommendations