Multimedia Tools and Applications

, Volume 1, Issue 1, pp 9–46 | Cite as

Production model based digital video segmentation

  • Arun Hampapur
  • Ramesh Jain
  • Terry E Weymouth


Effective and efficient tools for segmenting and content-based indexing of digital video are essential to allow easy access to video-based information. Most existing segmentation techniques do not use explicit models of video. The approach proposed here is inspired and influenced by well established video production processes. Computational models of these processes are developed. The video models are used to classify the transition effects used in video and to design automatic edit effect detection algorithms. Video segmentation has been formulated as a production model based classification problem. The video models are also used to define segmentation error measures. Experimental results from applying the proposed technique to commercial cable television programming are presented.


Digital Video Video Segmentation Video Indexing Video Databases Edit Effects Fade In Fade Out Dissolve Editing Content based retrieval 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Farshid Arman, Arding Hsu, and Ming-Yee Chiu. Image processing on compressed data for large video databases. InProceedings of the ACM MultiMedia, pages 267–272, California, USA, June 1993. Association of Computing Machinery.Google Scholar
  2. 2.
    David Bordwell and Thompson Kristin.Film Art: An Introduction. Addison-Wesley Publishing Company, 1980.Google Scholar
  3. 3.
    Richard O Duda and Peter E Hart.Pattern Classification and Scene Analysis. A Wiley-Interscience Publication. John Wiley and Sons, 1973.Google Scholar
  4. 4.
    Claude L Fenema and William B Thompson. Velocity determination in scenes containing several moving objects.Computer Graphics and Image Processing, 9:301–315, 1979.Google Scholar
  5. 5.
    Foley, vanDam, Feiner, and Hughes.Computer Graphics: Principles and Practice. The Systems Programming Series. Addison Wesley, 1990.Google Scholar
  6. 6.
    Anderson H Gary.Video Editing and Post Production: A Professional Guide. Knowledge Industry Publications, 1988.Google Scholar
  7. 7.
    Laurence Goldstein and Jay Kaufman.Into Film. E P Dutton and Co, 1976.Google Scholar
  8. 8.
    Arun Hampapur.Designing Video Data Management Systems. PhD Thesis, The University of Michigan, 1994.Google Scholar
  9. 9.
    Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video indexing in multimedia systems. InProoceedings of the Workshop on Indexing and Reuse in Multimedia Systems. American Association of Artificial Intelligence, August 1994.Google Scholar
  10. 10.
    Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video segmentation. InProoceedings Second Annual ACM MultiMedia Conference and Exposition. Association of Computing Machinery, October 1994.Google Scholar
  11. 11.
    Berthold K. P. Horn and Brian G. Schunck. Determining optical flow.Artificial Intelligence, 17:185–203, 1981.Google Scholar
  12. 12.
    R Jain. Difference and accumulative difference pictures in dynamic scene analysis.Image and Vision Computing, Vol 2(No 2):99–108, May 1984.Google Scholar
  13. 13.
    R Jain and H H Nagel. On the analysis of accumulative difference pictures from image sequences of real world scenes.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 1(No 2):206–214, April 1979.Google Scholar
  14. 14.
    Ramesh Jain and Arun Hampapur. Metadata in video databases. InTo appear Sigmod Record: Special Issue On Metadata For Digital Media. ACM: SIGMOD, December 1994.Google Scholar
  15. 15.
    Ramesh Jain, Rangachar Kasturi, and Brian G Schunck.(To be published) Introduction to Machine Vision. McGraw Hill, 1995.Google Scholar
  16. 16.
    Zvi Kohavi.Switching and Finite Automata Theory. Computer Science Series. McGraw Hill, 1978.Google Scholar
  17. 17.
    Ira Konigsberg.The Complete Film Dictionary. Penguin Books, 1989.Google Scholar
  18. 18.
    J O Limb and J A Murphy. Estimating the velocity of moving images in television signals.Computer Graphics and Image Processing, 4:311–327, 1975.Google Scholar
  19. 19.
    Akio Nagasaka and Yuzuru Tanaka. Automatic video indexing and full-video search for object appearances. In2nd Working Conference on Visual Database Systems, pages 119–133, Budapest, Hungary, October 1991. IFIP WG 2.6.Google Scholar
  20. 20.
    Azriel Rosenfeld and Avinash C Kak.Digital Picture Processing Vol 1,2. Academic Press, 1976.Google Scholar
  21. 21.
    Ishwar K Sethi and Ramesh Jain. Finding trajectories of feature points in a monocular image sequence.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 9(No 1):56–73, January 1987.Google Scholar
  22. 22.
    Yoshinobu Tonomura, Akihito Akutsu, Yukinobu Taniguchi, and Gen Suzuki. Structured video computing.IEEE Multimedia, 1(3):34–43, Fall 1994.Google Scholar
  23. 23.
    George Wolberg.Digital Image Warping. IEEE Computer Society Press, 1992.Google Scholar
  24. 24.
    H J Zhang, A Kankanhalli, and S W Smoliar. Automatic partitioning of video.Multimedia Systems, 1(1):10–28, 1993.Google Scholar

Copyright information

© Kluwer Academic Publishers 1995

Authors and Affiliations

  • Arun Hampapur
    • 1
  • Ramesh Jain
    • 1
  • Terry E Weymouth
    • 1
  1. 1.Computer Science and Engineering, Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn Arbor

Personalised recommendations