Video Modeling

  • Milan Petković
  • Willem Jonker
Part of the The Springer International Series in Engineering and Computer Science book series (MMSA, volume 25)


Content-based video retrieval requires changes in a multimedia database management system relative to a traditional database management system. These changes take effect mainly with respect to modeling and querying techniques. As stated in [1], a multimedia data model should be different from a traditional data model. First of all, a video data model has to manage all modalities involved in a video document, i.e. visual, auditory, and textual modalities. Next, a multimedia data model should include the elements that represent the content of these modalities, together with the elements that represent their inherent structural properties. It should be able to capture and represent various types of information about multimedia objects, their structures, operations, and properties, as well as real-world objects and relationships among them. Therefore, it has to provide a sophisticated representation of video content in terms of low-level features and high-level concepts, and enable satisfactory retrieval capabilities. In a multimedia environment, browsing has additional importance and queries can be based not only on an exact matching but also on degrees of similarity, which has to be supported starting from the data model.


Video Content Video Modeling Video Object Video Retrieval Shot Boundary Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    W. Grosky, “Managing Multimedia Information in Database Systems”, Communications of the ACM, Vol. 40, No. 12, Dec. 1997, pp. 73–80.CrossRefGoogle Scholar
  2. [2]
    O. Marques, B. Furht, Content-Based Image and Video Retrieval, Kluwer Academic Publisher, 2002.Google Scholar
  3. [3]
    J.S. Boreczky, L.A. Rowe, “Comparison of video shot boundary detection techniques”, In Proceedings SPIE Conference Storage and Retrieval for Video Databases IV, San Jose, USA, 1995.Google Scholar
  4. [4]
    H-J. Zhang, “Content-based Video Browsing and Retrieval” In Handbook of Internet and Multimedia Systems and Applications (B. Furht, ed. ), CRC - IEEE Press, 1998.Google Scholar
  5. [5]
    R. Brunelli, O. Mich, C. M. Modena, “A Survey on the Automatic Indexing of Video Data”, Journal of Visual Communication and Image Representation, 10 (2), pp. 78–112, 1999.CrossRefGoogle Scholar
  6. [6]
    B. Rubin, G. Davenport, “Structured Content Modeling for Cinematic Information”, SIGCHI Bulletin, 21 (2), 1989, pp. 78–79.CrossRefGoogle Scholar
  7. [7]
    B-L. Yeo, M.M. Yeung, “Retrieving and Visualizing Video”, Communications of the ACM, Vol. 40, No. 12, 1997, pp. 43–52.CrossRefGoogle Scholar
  8. [8]
    R. Weiss, A. Duda, D. K. Gifford, “Content-based Access to Algebraic Video”, In Proceedings of International Conference on Multimedia Computing and Systems, IEEE Press, 1994, pp. 140–151.Google Scholar
  9. [9]
    E. Oomoto, K. Tanaka, “OVID: Design and Implementation of a Video-Object Database System”, IEEE Transaction on Knowledge and Data Engineering, Vol. 5, No. 4, Avgust, 1993, pp. 629–643.Google Scholar
  10. [10]
    A. Hampapur, R. Jain, “Video Data Management Systems: Metadata and Architecture” in Multimedia Data Management, A. Sheth, W. Klas (ed.), McGraw-Hill, 1998.Google Scholar
  11. [11]
    D. Swanberg, C.F. Shu, R. Jain, “Knowledge Guided Parsing in Video Databases”, In Proc. of SPIE Symposium on Electronic Imaging: Science and Technology, February 1993, pp. 13–24.Google Scholar
  12. [12]
    H. Zhang, S.W. Smoliar, “Developing Power Tools for Video Indexing and Retrieval”, In Proc. of SPIE Storage and Retrieval for Video Databases, San Jose, CA, Jan. 1994.Google Scholar
  13. [13]
    H. Wactiar, T. Kanade, M. Smith. S. Stevens, “Intelligent Access to Digital Video: Informedia Project”, IEEE Computer, Vol. 4, No. 2, 1996.Google Scholar
  14. [14]
    C. Snoek, M. Worring “A Review on Multimodal Video Indexing”, In the Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Lausanne, 2002.Google Scholar
  15. [15]
    J. Z. Li, M. T. Ozsu, D. Szafron, “Modeling of Video Spatial Relationships in an Object Database Management System”, In Proceedings of International Workshop on Multimedia Database Management Systems, 1996, pp. 124–132.Google Scholar
  16. [16]
    M. Adiba, J.L. Zechinelli-Martini, “Managing Spatio-Temporal Multimedia Presentations as Database Objects”, Technical Report RR 1022-I-LSR 10, IMAG, July 1999.Google Scholar
  17. [17]
    P. Aigrain, H. Zhang, D. Petkovic, “Content-based Representation and Retrieval of Visual Media: A State-of-the-Art Review”, Multimedia Tools and Applications, Kluwer Academic Publishers, 3 (3), 1996, pp. 179–202.Google Scholar
  18. [18]
    M. Petkovic, W. Jonker, “Overview of Data Models and Query Languages for Content-based Video Retrieval”, International Conference on Advances in Infrastructure for Electronic Business, Science, and Education on the Internet, l’Aquila, Italy, 2000.Google Scholar
  19. [19]
    A. Yoshitaka, T. Ichikawa, “A Survey on Content-Based Retrieval for Multimedia Databases”, IEEE Transactions on Knowledge and Data Engineering, Vol. 11, No. 1, 1999, pp. 81–93.CrossRefGoogle Scholar
  20. [20]
    B. Perry, S-K. Chang, J. Dinsmore, D. Doermann, A. Rosenfeld, S. Stevens, Content-based Access to Multimedia Information: From Technology Trends to State of the Art, Kluwer Academic Publisher, 1999.Google Scholar
  21. [21]
    J. R. Smith, S-F. Chang, “VisualSEEk: A Fully Automated Content-Based Image Query System”, In Proceedings of ACM Multimedia Conference, Boston, MA, November 1996.Google Scholar
  22. [22]
    A. Pentland, R. W. Picard, S. Sclaroff, “Photobook: Content-Based Manipulation of Image Databases”, International Journal of Computer Vision, 18 (3), 1996, pp. 233–254.CrossRefGoogle Scholar
  23. [23]
    C. Nastar, M. Mitschke, C. Meilhac, N. Boujemaa, “Surfimage: A Flexible Content-Based Image Retrieval System”, In Proceedings of ACM Multimedia International Conference, Bristol, England, 1998, pp. 339–344.Google Scholar
  24. [24]
    C. Carson, M. Thomas, S. Belongie, J. M. Hellerstein, J. Malik, “Blobworld: A System for Region-Based Image Indexing and Retrieval”, Third International Conference on Visual Information and Information Systems, Amsterdam, 1999, pp. 509–516.Google Scholar
  25. [25]
    M. Flinker, H. S. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. N. Lee, D. Petkovic, D. Steele, P. Yanker, “Query by Image and Video Content: The QBIC System”, IEEE Computer, 28, 1995, pp. 23–32.Google Scholar
  26. [26]
    S-F. Chang, W. Chen, H. Meng, H. Sundaram, D. Zhong, “A Fully Automated Content Based Video Search Engine Supporting Spatio-Temporal Queries”, IEEE Transaction on Circuits and Systems for Video Technology, Vol. 8, No. 5, Sept., 1998.Google Scholar
  27. [27]
    A. Hampapur, A. Gupta, B. Horowitz, C-F. Shu, C. Fuller, J. Bach, M. Gorkani, R. Jain, “Virage Video Engine”, In Proceedings of SPIE Vol. 3022, 1997.Google Scholar
  28. [28]
    M. La Cascia, E. Ardizzone, “JACOB: Just a Content-based Query System for Video Databases”, Proceedings ICASSP-96, Atlanta, GA, 1996, pp. 56–71.Google Scholar
  29. [29]
    D. Ponceleon, S. Srinivasan, A. Amir, D. Petkovic, D. Diklic, “Key to Effective Video Retrieval: Effective Cataloging and Browsing”, ACM Multimedia, 1998, pp. 99–107.Google Scholar
  30. [30]
    W. Wolf, “Key Frame Selection by Motion Analysis”, Proceedings ICASSP-96, Atlanta, GA, 1996.Google Scholar
  31. [31]
    T. G. Aguierre Smith, G. Davenport, “The Stratification System: A Design Environment for Random Access Video”, In Proceedings of 3rd International Workshop on Network and operating system Support for Digital Audio and Video, La Jolla, CA, 1992.Google Scholar
  32. [32]
    S. Adali, K. S. Candan, S-S. Chen, K. Erol, V. S. Subrahmanian, “Advanced Video Information System: Data Structure and Query Processing”, Multimedia System, Vol. 4, No. 4, Aug. 1996, pp. 172–86.CrossRefGoogle Scholar
  33. [33]
    C. Decleir, M-S. Hacid, J. Kouloumdjian, “A Database Approach for Modeling and Querying Video data”, LTCS-Report 99–03, 1999.Google Scholar
  34. [34]
    E. Ardizzone, M-S. Hacid, “A Semantic Modeling Approach for Video Retrieval by Content”, In Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, June 1999.Google Scholar
  35. [35]
    M. Davis, “Knowledge Representation for Video”, Proc. of 12` h National Conference on Artificial Intelligence, Vol. 1, Seattle, Washington, 1994, pp. 120–127.Google Scholar
  36. [36]
    H. Jiang, A. Elmagarmid, “Spatial and temporal content-based access to hypervideo databases” VLDB Journal, 7 (4), 1998, pp. 226–238.CrossRefGoogle Scholar
  37. [37]
    N. Dimitrova, F. Golshani, “Rx for Semantic Video Database Retrieval”, In Proceedings of ACM Multimedia conference, 1994, pp. 219–226.Google Scholar
  38. [38]
    A. Woudstra, D.D. Velthausz, H.J.G. de Poot, F. Moelaert El-Hadidy, W. Jonker, M.A.W. Houtsma, R.G. Heller, J.N.H. Heemskerk, “Modelling and Retrieving Audiovisual Information - A Soccer Video Retrieval System”, 4 t h International Workshop on Multimedia Information Systems; Istanbul, Turkey, September 1998.Google Scholar
  39. [39]
    Y. Gong, L. T. Sin, C. H. Chuan, H-J. Zhang, M. Sakauchi, “Automatic Parsing of TV Soccer Programs”, In Proceedings of IEEE International Conference on Multimedia Computing and Systems, Washington D. C., 1995, pp. 167–174.CrossRefGoogle Scholar
  40. [40]
    S. Intille, A. Bobick, “Visual Tracking Using Closed-Worlds”, MI.T. Media Laboratory Technical Report No. 294, Nov. 1994.Google Scholar
  41. [41]
    G. P. Pingali, Y. Jean I. Carlbom, “LucentVision: A System for Enhanced Sports Viewing”, In Proceedings of Visual ‘89 International Conference, Amsterdam, 1999, pp. 689–696.Google Scholar
  42. [42]
    F. Golshani, N. Dimitrova, “A Language for Content-Based Video Retrieval”, Multimedia Tools and Applications, 6 (3), 1998, pp. 289–312.CrossRefGoogle Scholar
  43. [43]
    M. Petkovic, W. Jonker, “A Framework for Video Modeling”, In Proceedings of Eighteenth TASTED International Conference on Applied Informatics, Innsbruck, February 2000, pp. 317–322.Google Scholar
  44. [44]
    MPEG Requirements Group, MPEG-7 visual part of eXperimentation Model 6.0, ISO/IEC JTC1/SC29/WG11 MPEG2000/N3398, Geneva, CH, June 2000.Google Scholar
  45. [45]
    MPEG Requirements Group, Working Draft 2.0 of MPEG-7 Visual, ISO/IEC JTC1/SC29/WG11 MPEG2000 N3322, Noordwijkerhout, NL, March 2000.Google Scholar
  46. [46]
    J.S. Boreczky, L.A. Rowe, “Comparison of video shot boundary detection techniques”, In Proceedings of SPIE Conference Storage and Retrieval for Video Databases IV, San Jose, USA, 1995.Google Scholar
  47. [47]
    M. Petkovic, Content-Based Video Retrieval Supported by Database Technology, PhD Thesis, Centre for Telematics and Information Technology Ph.D. Thesis Series No. 0248, Enschede, the Netherlands, 2003.Google Scholar

Copyright information

© Springer Science+Business Media New York 2004

Authors and Affiliations

  • Milan Petković
    • 1
  • Willem Jonker
    • 2
  1. 1.University of TwenteThe Netherlands
  2. 2.University of Twente and Philips ResearchThe Netherlands

Personalised recommendations