An Overview of MPEG-7 Motion Descriptors and Their Applications

  • Ajay Divakaran
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2124)


We present an overview of the MPEG-7 motion descriptors viz. motion trajectory, camera motion, parametric motion and motion activity. These descriptors cover a wide range of functionality and hence enable several applications. We present the salient parts of the syntax, the semantics and the associated extraction of each of these descriptors. We discuss the possible applications for these descriptors and associated complexity trade-offs. We then describe a case study of a low complexity video browsing and indexing system that capitalizes on the simple extraction, compactness and effectiveness of the motion activity descriptor. This system relies on feature extraction in the compressed domain, which makes dynamic feature extraction possible. It combines the MPEG-7 motion activity descriptor and a simple color histogram to achieve both video summarization (top-down traversal) and indexing (bottom-up traversal) and thus enables a user-friendly video-browsing interface.


MPEG-7 motion-based video indexing and summarization motion activity 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jeannin S., Divakaran, A.: MPEG-7 visual motion descriptors. Invited paper To appear in: Trans. Circuits and Systems for Video Technology special issue on MPEG-7, 11(6) (2001)Google Scholar
  2. 2.
    Divakaran A., Sun, H.: A Descriptor for spatial distribution of motion activity. In: Proc. SPIE Conf. on Storage and Retrieval from Image and Video Databases, San Jose, CA 24–28 Jan. (2000)Google Scholar
  3. 3.
    MPEG-7 Visual part of the XM 4.0. In: ISO/IEC MPEG99/W3068, Maui, USA, Dec. (1999)Google Scholar
  4. 4.
    Kadir A. Peker: Video indexing and summarization using motion activity. Ph.D. Dissertation, New Jersey Institute of Technology, Electrical Engineering Dept. (2001)Google Scholar
  5. 5.
    Akutsu & al.: Video indexing using motion vectors. In: Proc. Visual Communications and Image Processing, SPIE 1818 (1992) 1522–1530Google Scholar
  6. 6.
    Ardizzone E. & al.: Video indexing using MPEG motion compensation vectors. In: Proc. IEEE International Conference on Multimedia Computing and Systems (1999)Google Scholar
  7. 7.
    Davis, J.W.: Recognizing movement using motion histograms, Technical Report No. 487, MIT Media Laboratory Perceptual Computing Section (1998)Google Scholar
  8. 8.
    Dimitrova N., Golshani, F.: Motion recovery for video content analysis. ACM Trans. Information Systems, 13 (1995) 408–439CrossRefGoogle Scholar
  9. 9.
    Kobla V., Doermann D., Lin, K.-L, Faloutsous, C: Compressed domain video indexing techniques using DCT and motion vector information in MPEG video. In: Proc. SPIE Conference on Storage and Retrieval for Image and Video Databases V, SPIE Vol. 3022, (1997)200–211Google Scholar
  10. 10.
    Sahouria, E.: Video indexing based on object motion. M.S. thesis, Dept. of EECS, UC BerkeleyGoogle Scholar
  11. 11.
    Tan, Y.P., Kulkarni, S.R., Ramadge, P.J.: Rapid estimation of camera motion from compressed video with application to video annotation. IEEE Trans, on Circuits and Systems for Video Technology, 10 (2000) 133–146.CrossRefGoogle Scholar
  12. 12.
    Tse, Y.T., Baker, R.L.: Camera zoom/pan estimation and compensation fore video compression. In: Proc. SPIE Conf. On Image Processing Algorithms and Techniques II, Boston, MA (1991) 468–479Google Scholar
  13. 13.
    Wolf, W.: Key frame selection by motion analysis. In: Proc. ICASSP 96, Vol. II (1996) 1228–1231Google Scholar
  14. 14.
    Jeannin, S., Jasinschi R. & al.: Motion Descriptors for Content-Based Video Representation. Signal Processing: Image Communication Journal, August 2000 (to appear)Google Scholar
  15. 15.
    Chang, S.F., Chen, W., Meng, HJ., Sundaram, H., Zhong, D.: A Fully Automated Content-Based Video Search Engine Supporting Multi-Objects Spatio-Temporal Queries. IEEE Transactions on Circuit and Systems for Video Technology, 8 (1998) 602–615CrossRefGoogle Scholar
  16. 16.
    Marr, D.: Vision. W. H. Freeman, San Francisco (1982)Google Scholar
  17. 17.
    Niblack, W., Ponceleon, D.B., Petkovic D. & al.: Updates to the QBIC System. In: Proc. IS&T SPIE, Storage and Retrieval for Image and Video Databases VI, San Jose, Vol. 3312 (1998) 150–161Google Scholar
  18. 18.
    Hori, O., Kaneko, T.: Results of Spatio-Temporal Region DS Core/Validation Experiment. In: ISO/IEC JTC1/SC29/WG11/MPEG99/M5414, Dec. 1999, Maui.Google Scholar
  19. 19.
    Llach, J., Salembier, P.: Analysis of video sequences: table of contents and index creation. In: Proc. Int’l Workshop on very low bit-rate video coding (VLBV’99), Kyoto, Japan (1999) 52–56Google Scholar
  20. 20.
    Jeannin, S., Video Motion Representation for Improved Content Access. IEEE Transactions on Consumers Electronics, August (2000)Google Scholar
  21. 21.
    Information technology-Coding of Audio-visual Objects. Standard MPEG4, Version 1. ISO/IEC 14496Google Scholar
  22. 22.
    Lee, K.W., You, W.S., Kim, J.: Quantitative analysis for the motion trajectory descriptor in MPEG-7. In: ISO/IEC JTC1/SC29/WG11/MPEG99/M5400, Dec. 1999, Maui.Google Scholar
  23. 23.
    Szeliski, R.: Image Mosaicing for Tele-reality Applications. In: IEEE Workshop on Applications of Computer Vision, IEEE Computer Society (1994) 44–53Google Scholar
  24. 24.
    Irani, M., Anandan P. & al.: Efficient Representation of Video Sequences and their Application. Signal Processing: Image Communications, 8 (1996) 327–351CrossRefGoogle Scholar
  25. 25.
    URL: official MPEG site
  26. 26.
    URL:, Virage system
  27. 27.
  28. 28.
  29. 29.
    Peker K., Divakaran, A.: Automatic Measurement of Intensity of Motion Activity of Video Segments. In: Proc. SPIE Conference on Storage and Retrieval from Multimedia Databases, San Jose, CA (2001)Google Scholar
  30. 30.
    Divakaran A., Peker, K.: Video Summarization Using Motion Descriptors. In: Proc. SPIE Conference on Storage and Retrieval from Multimedia Databases, San Jose, CA (2001)Google Scholar
  31. 31.
    Bober, M., Asai K., Divakaran, A.: MPEG-4/7 based internet video and still image browsing system. In: Proc. SPIE Conference on Multimedia Systems and Applications, Boston, MA (2000)Google Scholar
  32. 32.
    Divakaran A., Vetro A., Asai K., Nishikawa, H.: Video browsing system based on compressed domain feature extraction. IEEE Trans. Consumer Electronics, Aug. 2000Google Scholar
  33. 33.
    Peker, K., Divakaran A., Sun, H.: Constant Pace Skimming and Temporal Sub-sampling of Video Using Motion Activity. To appear in: ICIP 2001Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Ajay Divakaran
    • 1
  1. 1.Mitsubishi Electric Research LaboratoriesNew ProvidenceUSA

Personalised recommendations