A Friendly and Intelligent Approach to Data Retrieval in a Multimedia DBMS

  • Daniel A. Keim
  • Kyung-Chang Kim
  • Vincent Lum


Manipulation of multimedia data is not straightforward as in conventional databases. One main problem is the retrieval of multimedia data from the database with the need to match the contents of multimedia data to a user query. In order to achieve a content based retrieval, in our approach, we use natural language captions which allow the user to describe the contents of multimedia data In a similar manner, users will specify their queries on multimedia data contents in natural language form. A problem is that different or even the same user describe the same thing differently at different times which results in the descriptions of the contents of multimedia data to rarely exactly match the descriptions of the user queries. Hence, partial or approximate match between descriptions of multimedia data and user queries is generally required during multimedia data retrieval. We propose an intelligent approach to approximate match by integrating both object-oriented and natural language understanding techniques. In order to make the query specification process easier we also develop a graphical user interface supporting incremental query specification and a natural way of expressing joins. The Multimedia Database Management System (MDBMS) described in this paper incorporates the capabilities as mentioned above.


Natural Language Multimedia Data User Query Negative Weight Class Hierarchy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Agrawal, R. et al. “OdeView: The Graphical Interface to Ode”, Proc. ACM-SIGMOD 1990 Int’l Conf. on Management of Data, Atlantic City, pp. 34–43, 1990.Google Scholar
  2. Bates, M. and B. Bobrow, “Information Retrieval using a Transportable Natural Language Interface,” Proc. of the 6th. ACM SIGIR Conf. on RandD in Information Retrieval, Bethesda, MD, 1983.Google Scholar
  3. Bryce D. and Hull, R. “SNAP: A Graphics Based Schema Manager”, Proc. IEEE Intl Conf. on Data Engineering, Los Angeles, CA, pp. 151–164, 1986.Google Scholar
  4. Chiaramella, Y. and B. Delude, “A Prototype of an Intelligent System for Information Retrieval: IOTA,” Information Processing and Management, vol. 23, no. 4, pp. 285–303, 1987.CrossRefGoogle Scholar
  5. Christodoulakis, S. et. al., “Multimedia Document Presentation, Information Extraction, and Document Formation in MINOS: A Model and a System, ” ACM TOOIS, vol. 4, no. 4, pp. 345–383, 1986.MathSciNetCrossRefGoogle Scholar
  6. Grosz, B.J. et. al., “TEAM: An Experiment in the Design of Transportable Natural Language Interfaces,” Artificial Intelligence, pp. 173–243, 1987.Google Scholar
  7. Holzkamp, B. et. al., “Demon– A media Object Model incorporating Natural Language Descriptions for Retrieval Support,” Tech. Report NPS52–90–019, Naval Postgraduate School, Monterey, CA, 1990.Google Scholar
  8. Keim, D. A. and Lum, V. “A Graphical Database Interface for a Multimedia DBMS Supporting a Natural Query Specification Process”, in preparationGoogle Scholar
  9. Lum, V. and K. Meyer–Wegener, “A Multimedia Database Management System Supporting Content Search in Media Data,” Tech. Report NPS52–89–020, Naval Postgraduate School, Monterey, CA, 1989.Google Scholar
  10. Masunaga, Y. “Multimedia Databases: A Formal Framework,” Proc. IEEE CS Office Automation Symp. IEEE CS Press, Washington, pp. 36–45, 1987.Google Scholar
  11. Meyer–Wegener, K. et. al., “Managing Multimedia Data,” Tech. Report NPS52–88–010, Naval Post–graduate School, Monterey, CA, 1988.Google Scholar
  12. Rogers, T. R. and Cattell, R. G. G. “ Entity-Rela-tionship Database User Interfaces” in Readings in Database Systems, edited by M. Stonebraker, 1988.Google Scholar
  13. Rowe, N. and E. Guglielmo, “Exploiting Captions for Access to Multimedia Databases,” to appear in IEEE Computer, 1991.Google Scholar
  14. Spark, K. Jones, “Artificial Intelligence: What can it offer to Information Retrieval,” Proc. of the Informatics 3, Aslib, ed., London, 1978.Google Scholar
  15. Woelk, D. and W. Kim, “Multimedia Information Management in an Object-Oriented Database System,” Proc. of VLDB, Brighton, England, 1987.Google Scholar
  16. Zloof, M. M. “Query-By-Example: A Data Base Language,” IBM Systems Journal, 4, pp. 324–343, 1977.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Wien 1991

Authors and Affiliations

  • Daniel A. Keim
    • 1
    • 2
  • Kyung-Chang Kim
    • 1
  • Vincent Lum
    • 1
  1. 1.Department of Computer ScienceNaval Postgraduate SchoolMontereyUSA
  2. 2.Institut für InformatikUniversität MünchenMünchen 2Germany

Personalised recommendations