Skip to main content
SpringerLink
Log in

BilVideo: Design and Implementation of a Video Database Management System

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the advances in information technology, the amount of multimedia data captured, produced, and stored is increasing rapidly. As a consequence, multimedia content is widely used for many applications in today’s world, and hence, a need for organizing this data, and accessing it from repositories with vast amount of information has been a driving stimulus both commercially and academically. In compliance with this inevitable trend, first image and especially later video database management systems have attracted a great deal of attention, since traditional database systems are designed to deal with alphanumeric information only, thereby not being suitable for multimedia data.

In this paper, a prototype video database management system, which we call BilVideo, is introduced. The system architecture of BilVideo is original in that it provides full support for spatio-temporal queries that contain any combination of spatial, temporal, object-appearance, external-predicate, trajectory-projection, and similarity-based object-trajectory conditions by a rule-based system built on a knowledge-base, while utilizing an object-relational database to respond to semantic (keyword, event/activity, and category-based), color, shape, and texture queries. The parts of BilVideo (Fact-Extractor, Video-Annotator, its Web-based visual query interface, and its SQL-like textual query language) are presented, as well. Moreover, our query processing strategy is also briefly explained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. S. Adalt, K. Candan, S. Chen, K. Erol, and V. Subrahmanian, “Advanced video information systems: Data structures and query processing,” ACM Multimedia Systems, Vol. 4, pp. 172–186, 1996.

    Article  Google Scholar 

  2. J. Allen, “Maintaining knowledge about temporal intervals,” Communications of ACM, Vol. 26, No. 11, pp. 832–843, 1983.

    Article  Google Scholar 

  3. U. Arslan, “A semantic data model and query language for video databases,” M.S. Thesis, Dept. of Computer Eng., Bilkent University, Ankara, Turkey, 2002.

    Google Scholar 

  4. U. Arslan, M. önderler, E. Şaykol, Ö. Ulusoy, and U. üdükbay, “A semi-automatic semantic annotation tool for video databases,” in Proc. of the Workshop on Multimedia Semantics (SOFSEM 2002), Milovy, Czech Republic, 2002.

  5. N. Babaguchi, Y. Kawai, and T. Kitahashi, “Event based indexing of broadcasted sports video by intermodel collaboration,” IEEE Trans. on Multimedia, Vol. 4, No. 1, pp. 68–75, 2002.

    Article  Google Scholar 

  6. S.F. Chang, W. Chen, H.J. Meng, H. Sundaram, and D. Zhong, “VideoQ: An automated content based video search system using visual cues”in Proc. of ACM Multimedia, Seattle, WA, 1997, pp. 313–324.

  7. S. Chen and R. L. Kashyap, “A spatio-temporal semantic model for multimedia database systems and multimedia information systems,” IEEE Trans. on Knowledge and Data Eng., Vol. 13, No. 4, pp. 607–622, 2001.

    Article  Google Scholar 

  8. Convera, Screening room technical overview. http://www.convera.com.

  9. M. Dönderler, E. Şaykol, Ö. Ulusoy, and U. Güdükbay, “Bilvideo: A video database management system,” IEEE Multimedia, Vol. 10, No. 1, pp. 66–70, 2003.

    Article  Google Scholar 

  10. M. Dönderler, Ö. Ulusoy, and U. Güdükbay, “Rule-based spatio-temporal query processing for video databases,” the VLDB Journal, Vol. 13, No. 1, pp. 86–103, 2002a.

    Google Scholar 

  11. M. Dönderler, Ö. Ulusoy, and U. Güdükbay. “A rule-based video database system architecture,” Information Sciences, Vol. 143, Nos. 1–4, pp. 13–45, 2002b.

    Article  Google Scholar 

  12. C. Faloutsos, W. Equitz, M. Flickner, W. Niblack, D. Petkovic, and R. Barber, “Efficient and effective querying by image content,” Journal of Intelligent Information Systems, Vol. 3, Nos. 3 /4, pp. 231–262, 1994.

    Article  Google Scholar 

  13. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. G. abd J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by image and video content: The QBIC system,” IEEE Computer, Vol. 28, No. 9, pp. 23–32, 1995.

    Google Scholar 

  14. S. Gauch, J. Gauch, and K. M. Pua, “The VISION digital video library project” in the Encyclopedia of Library and Information Science, volume 68, Supplement 31. Marcel Dekker, 2000.

  15. M. Hacid, C. Decleir, and J. Kouloumdjian, “A database approach for modeling and querying video data,” IEEE Trans. on Knowledge and Data Eng., Vol. 12, No. 5, pp. 729–750, 2000.

    Article  Google Scholar 

  16. A. Hauptmann and M. Witbrock, “Informedia: News-on-Demand Multimedia Information Acquisition and Retrieval, MIT Press, pp. 215–239, 1997.

  17. R. Hjelsvold and R. Midtstraum, “Modelling and querying video data”in Proc. of the 20th Int. Conf. on VLDB, Santiago, Chile, 1994, pp. 686–694.

  18. E. Hwang and V. Subrahmanian, “Querying video libraries,” Journal of Visual Communication and Image Representation, Vol. 7, No. 1, pp. 44–60, 1996.

    Article  Google Scholar 

  19. T. Kuo and A. Chen, “Content-based query processing for video databases,” IEEE Trans. on Multimedia, Vol. 2, No. 1, pp. 1–13, 2000.

    Article  Google Scholar 

  20. J. Li, “Modeling and querying multimedia data”Tech. Report TR-98-05, Dept. of Computing Science, The University of Alberta, Alberta, Canada, 1998.

    Google Scholar 

  21. J. Li, I. Goralwalla, M. Özsu, and D. Szafron, “Modeling video temporal relationships in an object database management system”in Proc. of the Int. Symp. on Electronic Images: Multimedia Computing and Networking, San Jose, CA, 1997, pp. 80–91.

  22. J. Li and M. Özsu, “STARS: A spatial attributes retrieval system for images and videos”in Proc. of the 4th Int. Conf. on Multimedia Modeling, Singapore, 1997, pp. 69–84.

  23. J. Li, M. Özsu, and D. Szafron, “Spatial reasoning rules in multimedia management systems”in Proc. of Int. Conf. on Multimedia Modeling, Toulouse, France, 1996, pp. 119–133.

  24. J. Li, M. Özsu, D. Szafron, and V. Oria. “Multimedia extensions to database query languages”Tech. Report TR-97-01, Dept. of Computing Science, The University of Alberta, Alberta, Canada, 1997.

    Google Scholar 

  25. J. Z. Li, M. T. Özsu, and D. Szafron, “Modeling of video spatial relationships in an object database management system”in Proc. of the Int. Workshop on Multimedia DBMSs, Blue Mountain Lake, NY, 1996, pp. 124–133.

  26. Y. Liu and F. Li, “Semantic extraction and semantics-based annotation and retrieval for video databases,” Multimedia Tools and App., Vol. 17, Nos. 5–20, 2002.

  27. S. Marcus and V. Subrahmanian, “Foundations of multimedia information systems,” Journal of ACM, Vol. 43, No. 3, pp. 474–523, 1996.

    Article  Google Scholar 

  28. S. Markus and V. Subrahmanian, “Multimedia Database Systems: Issues and Research Directions”Towards a Theory of Multimedia Database Systems, V.S. Subrahmanian and S. Jajodia (Eds.), Springer-Verlag, 1996, pp. 1–35.

  29. J. Martinez, “Overview of the MPEG-7 standard”2001. ISO/IEC JTC1/SC29/WG11 N4509, http://mpeg.telecomitalialab.com/standards/mpeg-7/mpeg-7.html.

  30. M. Nabil, A. Ngu, and J. Shepherd, “Modeling and retrieval of moving objects,” Multimedia Tools and Applications, Vol. 13, No. 1, pp. 35–71, 2001.

    Article  Google Scholar 

  31. M. Nascimento and J. Silva, “Towards historical R-trees”in Proc. of ACM Symposium on Applied Computing (ACM-SAC), 1998, pp. 235–240.

  32. E. Oomoto and K. Tanaka, “OVID: Design and implementation of a video object database system,” IEEE Trans. on Knowledge and Data Eng., Vol. 5, No. 4, pp. 629–643, 1993.

    Article  Google Scholar 

  33. M. Özsu, P. Iglinski, D. Szafron, S. El-Medani, and M. Junghanns, “An object-oriented SGML/HYTIME compliant multimedia database management system”in Proc. of ACM Multimedia, Seattle, WA, 1997, pp. 233–240.

  34. S. Satoh, Y. Nakamura, and T. Kanade, “Name-it: Naming and detecting faces in news videos,” IEEE Multimedia, Vol. 6, No. 1, pp. 22–35, 1999.

    Article  Google Scholar 

  35. E. Şaykol, “Web-based user interface for query specification in a video database system,” M.S. Thesis, Dept. of Computer Eng., Bilkent University, Ankara, Turkey, 2001.

    Google Scholar 

  36. E. Şaykol, U. Güdükbay, and Ö. Ulusoy, “A semi-automatic object extraction tool for querying in multimedia databases”in 7th Workshop on Multimedia Information Systems MIS’01, S. Adali and S. Tripathi (Eds.), 2001, Capri, Italy, pp. 11–20.

  37. E. Şaykol, U. Güdükbay, and Ö. Ulusoy, “A histogram-based approach for object-based query-by-shape-and-color in multimedia databases”Tech. Report BU-CE-0201, Dept. of Computer Eng., Bilkent University, Available at http://www.cs.bilkent.edu.tr/tech-reports/2002/BU-CE-0201.ps.gz (submitted to a journal), 2002.

  38. A. Sistla and C. Yu, “Similarity based retrieval of pictures using indices on spatial relationships”in Proc. of the 21st VLDB Conf., Zurich, Switzerland, 1995, pp. 619–629.

  39. A. Sistla and C. Yu, “Reasoning about qualitative spatial relationships,” Journal of Automated Reasoning, Vol. 25, No. 4, pp. 291–328, 2000.

    Article  Google Scholar 

  40. J.R. Smith and S.F. Chang, “Visual Seek: A fully automated content-based image query system”in Proc. of ACM Multimedia, New York, NY, 1996, pp. 87–98.

  41. Y. Theodoridis, J. Silva, and M. Nascimento, “On the generation of spatio-temporal datasets”in Proc. of the 6th Int. Symp. on Large Spatial Databases (SSD), LNCS Series, Hong Kong, China, Springer-Verlag, 1999.

  42. Y. Theodoridis, M. Vazirgiannis, and T. Sellis, “Spatio-temporal indexing for large multimedia applications”in Proc. of the 3rd IEEE Conf. on Multimedia Computing and Systems (ICMCS), 1996.

  43. T. Tzouramanis, M. Vassilakopoulos, and Y. Manolopoulos, “Overlapping linear quadtrees: A spatio-temporal access method”in Proc. of the 6th Int. ACM Workshop on Geographical Information Systems, 1998, pp. 1–7.

  44. G. Ünel, M. Dönderler, Ö. Ulusoy, and U. Güdükbay, “An efficient query optimization strategy for spatio-temporal queries in video databases,” Journal of Systems and Software, Vol. 73, No. 1, pp. 113–131, 2004. pagebreak

    Article  Google Scholar 

  45. R. Veltkamp and M. Tanase, “Content-based retrieval system: A survey”Tech. Report UU-CS-2000-34, Utrect University, The Netherlands, 2000.

  46. Virage, Videologger. http://www.virage.com.

  47. W. Woods, “Transition network grammars for natural language analysis,” Communications of the ACM, Vol. 13, pp. 591–602, 1970.

    Article  Google Scholar 

  48. X. Xu, J. Han, and W. Lu, “R T-tree: An improved R-tree index structure for spatio-temporal databases”in Proc. of the 4th Int. Symp. on Spatial Data Handling (SDH), 1990, pp. 1040–1049.

  49. A. Yoshitaka and T. Ichikawa, “A survey of content-based retrieval for multimedia databases,” IEEE Trans. on Knowledge and Data Eng., Vol. 11, No. 1, pp. 81–93, 1999.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bilkent University, Ankara, Turkey

    Mehmet Emin Dönderler, Ediz Şaykol, Umut Arslan, Özgür Ulusoy & Uğur Güdükbay

Authors
  1. Mehmet Emin Dönderler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ediz Şaykol
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Umut Arslan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Özgür Ulusoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Uğur Güdükbay
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mehmet Emin Dönderler.

Additional information

This work is partially supported by the Scientific and Research Council of Turkey (TÜBİTAK) under Project Code 199E025, Turkish State Planning Organization (DPT) under Grant No. 2004K120720, and European Union under Grant No. FP6-507752 (MUSCLE Network of Excellence Project).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dönderler, M.E., Şaykol, E., Arslan, U. et al. BilVideo: Design and Implementation of a Video Database Management System. Multimed Tools Appl 27, 79–104 (2005). https://doi.org/10.1007/s11042-005-2715-7

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-005-2715-7

Keywords

Search

Navigation