Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu

Video Content Modeling

  • Lei ChenEmail author
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_1028


Video data modeling


Video Content Modeling refers to representing the content of video data for search later on. Specifically, the content of video data includes the visual features, the temporal features, the contained objects, and the semantic concepts. With an effective modeling technique, people cannot only browse the video data, but also search the video with the specific features. Video content modeling is the basic for video data indexing and retrieval.

Historical Background

Video, as a popular type of multimedia, has been widely used by movie/TV industries and individuals. In the earlier 90s, people started search video data through annotated text information [ 20, 21, 23]. However, the low efficiency of manual annotation techniques prevents the text-based retrieval techniques applying to video data on a large scale. Thus, content-based video retrieval was proposed and studied. For the purpose of conducting effective and efficient search, significant works...
This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Aigrain P, Zhang H, Petkovic D. Content-based representation and retrieval of visual media: a state-of-the-art review. Multimed Tools Appl. 1996;3(3):179–202.CrossRefGoogle Scholar
  2. 2.
    Al-Khatib W, Ghafoor A. An approach for video meta-data modeling and ouery processing. In: Proceedings of the 7th ACM International Conference on Multimedia; 1999. p. 215–24.Google Scholar
  3. 3.
    Bertini M, Bimbo AD, Torniai C. Automatic video annotation using ontologies extended with visual information. In: Proceedings of the 13th ACM International Conference on Multimedia; 2005. p. 395–8.Google Scholar
  4. 4.
    Bimbo AD, Vicario E, Zingoni D. Symbolic description and visual querying of image sequences using spatio-temporal logic. IEEE Trans Knowl Data Eng. 1995;7(4):609–22.CrossRefGoogle Scholar
  5. 5.
    Browne P, Smeaton AF. Video information retrieval using objects and ostensive relevance feedback. In: Proceedings of the 2004 ACM Symposium on Applied Computing; 2004. p. 1084–90.Google Scholar
  6. 6.
    Chang SF, Chen W, Meng HJ, Urama H, Zhong D. A fully automated content-based video search engine supporting spatiotemporal queries. IEEE Trans Circ Syst Video Technol. 1998;8(5):602–15.CrossRefGoogle Scholar
  7. 7.
    Chen L, Oria V, Özsu MT. Modeling video data for content based queries: extending the DISIMA image data model. In: Proceedings of the 9th International Conference on Multimedia Modeling; 2003. p. 169–89.Google Scholar
  8. 8.
    Cooper M. Video segmentation combining similarity analysis and classification. In: Proceedings of the 12th ACM International Conference on Multimedia; 2004. p. 252–5.Google Scholar
  9. 9.
    Courtney JD. Automatic video indexing via ojbect motion analysis. Pattern Recognit. 1999;30(4):607–25.CrossRefGoogle Scholar
  10. 10.
    Day YF, Dagtas S, Iino M, Khokhar A, Ghafoor A. Object-oriented conceptual modeling of video data. In: Proceedings of the 11th International Conference on Data Engineering; 1995. p. 401–8.Google Scholar
  11. 11.
    Hjelsvold R, Midtstraum R. Modelling and querying video data. In: Proceedings of the 20th International Conference on Very large Data Bases; 1994. p. 686–94.Google Scholar
  12. 12.
    Lefèvre S, Holler J, Vincent N. A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval. Real-Time Imaging. 2003;9(1):73–98.CrossRefGoogle Scholar
  13. 13.
    Li J, Özsu MT, Szafron D. Modeling of moving objects in a video databas. In: Proceedings of the International Conference on Multimedia Computing and Systems; 1997. p. 336–43.Google Scholar
  14. 14.
    Martinez M, Moran F. Authoring 744: writing descriptions to create content. IEEE Multimed. 2003;10(4):94–9.CrossRefGoogle Scholar
  15. 15.
    Nabil M, Ngu AHH, Shepherd J. Modeling moving objects in multimedia database. In: Proceedings of the 8th International Conference Database and Expert Systems Applications; 1997. p. 67–76.Google Scholar
  16. 16.
    Naphade MR, Huang TS. Extracting semantics from audio-visual content: the final frontier in multimedia retrieva. IEEE Trans Neural Netw. 2002;13(4):793–810.CrossRefGoogle Scholar
  17. 17.
    Oomoto E, Tanaka K. Ovid: design and implementation of a video-object database system. IEEE Trans Knowl Data Eng. 1993;4(5):629–43.CrossRefGoogle Scholar
  18. 18.
    Rui Y, Huang TS, Mehrotra S. Exploring video structure beyond the shots. In: Proceedings of the International Conference on Multimedia Computing and Systems; 1992. p. 237–40.Google Scholar
  19. 19.
    Shibata T, Kato N, Kurohashi S. Automatic object model acquisition and object recognition by integrating linguistic and visual information. In: Proceedings of the 15th ACM International Conference on Multimedia; 2007. p. 383–92.Google Scholar
  20. 20.
    Smith TGA, Davenport G. The stratification system: a design environment for random access video. In: Proceedings of the International Workshop on Networking and Operating System Support for Digital Audio and Video; 1992. p. 250–61.CrossRefGoogle Scholar
  21. 21.
    Smoliar S, Zhang H. Content-based video indexing retrieval. IEEE Multimed. 1994;1(2):62–72.CrossRefGoogle Scholar
  22. 22.
    Vendrig J, Worring M. Interactive adaptive movie annotation. IEEE Multimed. 2003;10(3):30–7.CrossRefGoogle Scholar
  23. 23.
    Weiss R, Duda A, Gifford DK. Composition and search with a video algebra. IEEE Multimed. 1994;1(2):12–25.Google Scholar
  24. 24.
    Zhang H, Kankanhalli A, Smoliar S. Automatic partitioning of full-motion video. Multimed Syst. 1993;1(1):10–28.CrossRefGoogle Scholar
  25. 25.
    Zhang HJ, Low CY, Smoliar SW, Wu JH. Video parsing, retrieval and browsing: An integrated and content based solution. In: Proceedings of the 3rd ACM International Conference on Multimedia; 1995. p. 15–24.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Hong Kong University of Science and TechnologyHong KongChina

Section editors and affiliations

  • Vincent Oria
    • 1
  • Shin'ichi Satoh
    • 2
  1. 1.Dept. of Computer ScienceNew Jersey Inst. of TechnologyNewarkUSA
  2. 2.Digital Content and Media Sciences ReseaMultimedia Information Research DivisionNational Institute of InformaticsTokyoJapan