Skip to main content

Towards the Creation of a Unified Framework for Multimodal Search and Retrieval

  • Conference paper
Book cover User Centric Media (UCMEDIA 2010)

Abstract

In this paper, a novel framework for search and retrieval of multimodal content is introduced as part of the EU-funded project I-SEARCH. The main objective of I-SEARCH is to create a unified framework for multimodal content search, i.e. to retrieve content of any media type (text, 2D images, video, audio and 3D) by using as query any of the above media, along with real-world information, expressive and social cues. The outcome will be a highly user-centric search engine, able to deliver to the end-users only the content of interest, satisfying their information needs and preferences, which is expected to significantly improve end-user’s experience. The paper will present the concept of I-SEARCH, as well as its major scientific advances.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Flickr Photo Sharing, http://www.flickr.com/

  2. Internet Archive, http://www.archive.org/

  3. VICTORY project official website, http://www.victory-eu.org:8080/victory

  4. Google SketchUp, http://sketchup.google.com/

  5. I-SEARCH project official website, http://www.isearch-project.eu/

  6. The Pharos Project, http://www.pharosproject.net/

  7. The VITALAS Project, http://vitalas.ercim.org/

  8. Worring, M., Gevers, T.: Interactive retrieval of color images. Int. J. Image Graph 1(3), 387–414 (2001)

    Article  Google Scholar 

  9. Kokare, M., Biswas, P.K., Chatterji, B.N.: Texture image retrieval using new rotated complex wavelet filters. IEEE Transactions on Systems, Man, and Cybernetics, Part B 35(6), 1168–1178 (2005)

    Article  Google Scholar 

  10. Attalla, E., Siy, P.: Robust shape similarity retrieval based on contour segmentation polygonal multiresolution and elastic matching. Pattern Recognition 38(12), 2229–2241 (2005)

    Article  Google Scholar 

  11. Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. Int. Journal of Computer Vision 60(2) (2004)

    Google Scholar 

  12. Joly, A., Frélicot, C., Buisson, O.: Feature statistical retrieval applied to content-based copy identification. In: Proc. of Int. Conf. on Image Processing (2004)

    Google Scholar 

  13. Law-To, J., Chen, L., Joly, A., Laptev, I., Buisson, O., Gouet-Brunet, V., Boujemaa, N., Stentiford, F.: Video Copy Detection: a Comparative Study. In: Proc. of the ACM International Conference on Image and Video Retrieval (2007)

    Google Scholar 

  14. Laptev, I., Lindeberg, T.: Local Descriptors for Spatio-Temporal Recognition. In: Proc. of ECCV (2004)

    Google Scholar 

  15. Zarpalas, D., Daras, P., Axenopoulos, A., Tzovaras, D., Strintzis, M.G.: 3D Model Search and Retrieval Using the Spherical Trace Transform., EURASIP Journal on Advances in Signal Processing, Article ID 239110 (2007)

    Google Scholar 

  16. Papadakis, P., Pratikakis, I., Perantonis, S., Theoharis, T.: Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognition 40(9), 2437–2452 (2007)

    Article  MATH  Google Scholar 

  17. Daras, P., Axenopoulos, A.: A 3D Shape Retrieval Framework Supporting Multimodal Queries. International Journal of Computer Vision (July 2009), doi:10.1007/s11263-009-0277-2

    Google Scholar 

  18. Ohbuchi, R., Osada, K., Furuya, T., Banno, T.: Salient local visual features for shape-based 3D model retrieval. In: Proc. of the IEEE International Conference on Shape Modeling and Applications (SMI 2008), pp. 93–102 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Axenopoulos, A., Daras, P., Tzovaras, D. (2012). Towards the Creation of a Unified Framework for Multimodal Search and Retrieval. In: Alvarez, F., Costa, C. (eds) User Centric Media. UCMEDIA 2010. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 60. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35145-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35145-7_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35144-0

  • Online ISBN: 978-3-642-35145-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics