Skip to main content

Knowledge Based Multimodal Result Fusion for Distributed and Heterogeneous Multimedia Environments: Concept and Ideas

  • Conference paper
Adaptive Multimedia Retrieval. Context, Exploration, and Fusion (AMR 2010)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6817))

Included in the following conference series:

Abstract

Distributed multimedia retrieval (DMR) is a key issue in today’s information systems. One problem in DMR is the fusion of results retrieved from multiple locations, which is required in order to present the results in an integrated, consolidated and aligned form. This paper sketches a distributed multimedia retrieval scenario in which requirements, a conceptualization and an implementation of a knowledge-based data fusion approach is proposed. The approach is to be used together with the MPEG Query Format and is supported by benchmarks and classifications to derive knowledge used in result fusion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aslam, J., Montague, M.: Models for metasearch. In: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 276–284 (2001)

    Google Scholar 

  2. Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval, 1st edn. Addison Wesley, Reading (1999)

    Google Scholar 

  3. Buckley, C., Voorhees, E.: Retrieval evaluation with incomplete information. In: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 25–32 (2004)

    Google Scholar 

  4. Chang, N.S., Fu, K.S.: Query by pictorial example. IEEE Trans. on Software Engineering 6(6), 519–524 (1980)

    Article  Google Scholar 

  5. Cormack, G.V., Clarke, C.L.A., Buettcher, S.: Reciprocal rank fusion outperforms condorcet and individual rank learning methods. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 758–759 (2009)

    Google Scholar 

  6. Croft, B., Metzler, D., Strohman, T.: Search Engines: Information Retrieval in Practice, 1st edn. Addison Wesley, Reading (2009)

    Google Scholar 

  7. Döller, M.: Draft of Call for JPSearch Benchmark Requirements, ISO/IEC JTC 1/SC 29/WG1 N5399, JPEG (2010)

    Google Scholar 

  8. Döller, M., Bauer, K., Kosch, H., Gruhne, M.: Standardized Multimedia Retrieval based on Web Service technologies and the MPEG Query Format. Journal of Digital Information 6(4), 315–331 (2008)

    Google Scholar 

  9. Döller, M., Stegmaier, F., Kosch, H., Tous, R., Delgado, J.: Standardized Interoperable Image Retrieval. In: ACM Symposium on Applied Computing (SAC), Track on Advances in Spatial and Image-based Information Systems (ASIIS), Sierre, Switzerland, pp. 881–887 (2010)

    Google Scholar 

  10. Döller, M., Tous, R., Gruhne, M., Yoon, K., Sano, M., Burnett, I.S.: The MPEG Query Format: On the way to unify the access to Multimedia Retrieval Systems. IEEE Multimedia 15(4), 82–95 (2008)

    Article  Google Scholar 

  11. Dublin Core Metadata Initiative. Dublin Core Metadata Element Set - Version 1.1: Reference description (2008), http://dublincore.org/documents/dces/

  12. Dufaux, F., Ansorge, M., Ebrahimi, T.: Overview of JPSearch: a Standard for Image Search and Retrieval. In: 5th International Workshop on Content-based Multimedia Indexing (CBMI 2007), Bordeaux, France (2007)

    Google Scholar 

  13. Fisher, L., Elchesen, D.: Effectiveness of combining title words and index terms in machine retrieval searches. Nature (238), 109–110 (1972)

    Article  Google Scholar 

  14. Lee, J.H.: Analyses of multiple evidence combination. In: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 267–276 (1997)

    Google Scholar 

  15. Marchand-Maillet, S., Worring, M.: Benchmarking Image and Video Retrieval: an Overview. In: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, Santa Barbara, California, USA, pp. 297–300 (2006)

    Google Scholar 

  16. Martinez, J.M., Koenen, R., Pereira, F.: MPEG-7. IEEE Multimedia 9(2), 78–87 (2002)

    Article  Google Scholar 

  17. Montague, M., Aslam, J.: Condorcet fusion for improved retrieval. In: Proceedings of the 11th International Conference on Information and Knowledge Management, pp. 538–548 (2002)

    Google Scholar 

  18. Müller, H., Geissbuhler, A.: Benchmarking image retrieval applications. In: Proceedings of the 7th International Conference on Visual Information Systems (2004)

    Google Scholar 

  19. Müller, H., Müller, W., Squire, D.M., Marchand-Maillet, S., Pun, T.: Performance evaluation in content-based image retrieval: overview and proposals. Pattern Recogn. Lett. 22(5), 593–601 (2001)

    Article  MATH  Google Scholar 

  20. Narasimhalu, A.D., Kankanhalli, M.S., Wu, J.: Benchmarking multimedia databases. Multimedia Tools Applications 4(3), 333–356 (1997)

    Article  Google Scholar 

  21. Shaw, J., Fox, E.: Combination of multiple searches. In: Proceedings of the 2nd Text Retrieval Conference (TREC), pp. 243–252 (1994)

    Google Scholar 

  22. Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and TRECVid. In: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330 (2006)

    Google Scholar 

  23. Stegmaier, F., Döller, M., Kosch, H., Hutter, A., Riegel, T.: AIR: Architecture for Interoperable Retrieval on Distributed and Heterogeneous Multimedia Repositories. In: Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2010), Desenzano del Garda, Italy (2010)

    Google Scholar 

  24. Yan, R., Hauptmann, A.: The combination limit in multimedia retrieval. In: Proceedings of the 11th ACM International Conference on Multimedia, pp. 339–342 (2003)

    Google Scholar 

  25. Yan, R., Hauptmann, A., Jin, R.: Multimedia search with pseudo-relevance feedback. In: Proceedings of the International Conference on Image and Video Retrieval, pp. 238–247 (2003)

    Google Scholar 

  26. Yan, R., Yang, J., Hauptmann, A.G.: Learning query-class dependent weights in automatic video retrieval. In: Proceedings of the 12th Annual ACM International Conference on Multimedia, pp. 548–555 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Stegmaier, F., Bürger, T., Döller, M., Kosch, H. (2011). Knowledge Based Multimodal Result Fusion for Distributed and Heterogeneous Multimedia Environments: Concept and Ideas. In: Detyniecki, M., Knees, P., Nürnberger, A., Schedl, M., Stober, S. (eds) Adaptive Multimedia Retrieval. Context, Exploration, and Fusion. AMR 2010. Lecture Notes in Computer Science, vol 6817. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27169-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27169-4_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-27168-7

  • Online ISBN: 978-3-642-27169-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics