Skip to main content
SpringerLink
Log in

Adaptive Multimedia Retrieval: From Data to User Interaction

  • Chapter
Do Smart Adaptive Systems Exist?

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 173))

17.8 Concluding Remarks

The creation of a multimedia retrieval system is a difficult process that requires considerable efforts. As we pointed out all along this chapter, these efforts are often underestimated and this is particularly true for some crucial steps. It also important to note that a well thought out design of the retrieval system, for instance following the methodology proposed here, is the key of a successful system. We recommend in particular considering all the possible interactions presented in this chapter. Because of these hidden difficulties, very often a multimedia retrieval system focuses on just one media like image or audio, eventually combined with text. But it is clear that in the future the use of several media types in one single retrieval system will show its synergies, and the joined use of several media types is anyway required for the design of improved video retrieval systems.

Although the construction of a multimedia retrieval system is a difficult task, it represents a fascinating challenge. The results are always gratifying, because the new designed tools help to search through data that is richer and its meaning subtler than that of pure text.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bonastre, J.F., Delacourt, P., Fredouille, C., Merlin, T., Wellekens, C.J.: A speaker tracking system based on speaker turn detection for nist evaluation. In: Proc. of ICASSP 2000, Istanbul (2000)

    Google Scholar 

  2. Santo, M.D., Percannella, G., Sansone, C., Vento, M.: Classifying audio streams of movies by a multi-expert system. In: Proc. of Int. Conf. on Image Analysis and Processing (ICIAP01), Palermo, Italy (2001)

    Google Scholar 

  3. Montacié, C., Caraty, M.J.: A silence/noise/music/speech splitting algorithm. In: Proc. of ICSLP, Sydney, Australia (1998)

    Google Scholar 

  4. Idris, F., Panchanathan, S.: Review of image and video indexing techniques. Journal of Visual Communication and Image Representation 8 (1997) 146–166

    Article  Google Scholar 

  5. Zhang, H.J., Low, C.Y., Smoliar, S.W., Wu, J.H.: Video parsing, retrieval and browsing: an integrated and content-based solution. In: Proc. of ACM Multimedia 95 — electronic proc., San Franscisco, CA (1995)

    Google Scholar 

  6. Yu, H.H., Wolf, W.: A hierarchical multiresolution video shot transition detection scheme. Computer Vision and Image Understanding 75 (1999) 196–213

    Article  Google Scholar 

  7. Sudhir, G., Lee, J.C.M.: Video annotation by motion interpretation using optical flow streams. Journal of Visual Communication and Image Representation 7 (1996) 354–368

    Article  Google Scholar 

  8. Pilu, M.: On using raw mepg motion vectors to determine global camera motion. Technical report, Digital Media Dept. of HP Lab., Bristol (1997)

    Google Scholar 

  9. Lee, S.Y., Kao, H.M.: Video indexing — an approach based on moving object and track. SPIE 1908 (1993) 81–92

    Google Scholar 

  10. Sahouria, E.: Video indexing based on object motion. Master’s thesis, UC Berkeley, CA (1997)

    Google Scholar 

  11. Ronfard, R., Thuong, T.T.: A framework for aligning and indexing movies with their script. In: Proc. of IEEE International Conference on Multimedia & Expo (ICME 2003), IEEE (2003)

    Google Scholar 

  12. Potamianos, G., Neti, C., Luettin, J., Matthews, I.: Audio-visual automatic speech recognition: An overview. In Bailly, G., Vatikiotis-Bateson, E., Perrier, P., eds.: Issues in Visual and Audio-Visual Speech Processing. MIT Press (2004)

    Google Scholar 

  13. Jain, A.K., Yu, B.: Automatic text location in images and video frames. Pattern Recognition 31 (1998) 2055–2076

    Article  Google Scholar 

  14. Wu, V., Manmatha, R., Riseman, E.M.: Textfinder: An automatic system to detect and recognize text in images. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 (1999) 1224–1229

    Article  Google Scholar 

  15. Salton, G., Wong, A., Yang, C.S.: A vector space model for automatic indexing. Communications of the ACM 18 (1975) 613–620 (see also TR74-218, Cornell University, NY, USA)

    Article  MATH  Google Scholar 

  16. Robertson, S.E.: The probability ranking principle. Journal of Documentation 33 (1977) 294–304

    Google Scholar 

  17. van Rijsbergen, C.J.: A non-classical logic for information retrieval. The Computer Journal 29 (1986) 481–485

    Article  MATH  Google Scholar 

  18. Turtle, H., Croft, W.B.: Inference networks for document retrieval. In: Proc. of the 13th Int. Conf. on Research and Development in Information Retrieval, New York, ACM (1990) 1–24

    Google Scholar 

  19. Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K.: Indexing by latent semantic analysis. Journal of the American Society for Information Sciences 41 (1990) 391–407

    Article  Google Scholar 

  20. Kaski, S.: Dimensionality reduction by random mapping: Fast similarity computation for clustering. In: Proc. of the International Joint Conference on Artificial Neural Networks (IJCNN’98). Volume 1., IEEE (1998) 413–418

    MathSciNet  Google Scholar 

  21. Isbell, C.L., Viola, P.: Restructuring sparse high dimensional data for effective retrieval. In: Proc. of the Conference on Neural Information Processing (NIPS’98). (1998) 480–486

    Google Scholar 

  22. Salton, G., Allan, J., Buckley, C.: Automatic structuring and retrieval of large text files. Communications of the ACM 37 (1994) 97–108

    Article  Google Scholar 

  23. Salton, G., Buckley, C.: Term weighting approaches in automatic text retrieval. Information Processing & Management 24 (1988) 513–523

    Article  Google Scholar 

  24. Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison Wesley Longman (1999)

    Google Scholar 

  25. Greiff, W.R.: A theory of term weighting based on exploratory data analysis. In: 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, NY, ACM (1998)

    Google Scholar 

  26. Frakes, W.B., Baeza-Yates, R.: Information Retrieval: Data Structures & Algorithms. Prentice Hall, New Jersey (1992)

    Google Scholar 

  27. Porter, M.: An algorithm for suffix stripping. Program (1980) 130–137

    Google Scholar 

  28. Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishers, San Francisco (1999)

    Google Scholar 

  29. Klose, A., Nürnberger, A., Kruse, R., Hartmann, G.K., Richards, M.: Interactive text retrieval based on document similarities. Physics and Chemistry of the Earth, Part A: Solid Earth and Geodesy 25 (2000) 649–654

    Article  Google Scholar 

  30. Lochbaum, K.E., Streeter, L.A.: Combining and comparing the effectiveness of latent semantic indexing and the ordinary vector space model for information retrieval. Information Processing and Management 25 (1989) 665–676

    Article  Google Scholar 

  31. Detyniecki, M.: Browsing a video with simple constrained queries over fuzzy annotations. In: Flexible Query Answering Systems FQAS’2000, Warsaw (2000) 282–287

    Google Scholar 

  32. Yager, R.R.: A hierarchical document retrieval language. Information Retrieval 3 (2000) 357–377

    Article  MATH  Google Scholar 

  33. Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. In: Proc. of the 7th International World Wide Web Conference, Brisbane, Australia (1998) 107–117

    Google Scholar 

  34. Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA (2001)

    Google Scholar 

  35. Steinbach, M., Karypis, G., Kumara, V.: A comparison of document clustering techniques. In: KDD Workshop on Text Mining. (2000) (see also TR 00-034, University of Minnesota, MN)

    Google Scholar 

  36. Nürnberger, A.: Clustering of document collections using a growing self-organizing map. In: Proc. of BISC International Workshop on Fuzzy Logic and the Internet (FLINT 2001), Berkeley, USA, ERL, College of Engineering, University of California (2001) 136–141

    Google Scholar 

  37. Roussinov, D.G., Chen, H.: Information navigation on the web by clustering and summarizing query results. Information Processing & Management 37 (2001) 789–816

    Article  MATH  Google Scholar 

  38. Mendes, M.E., Sacks, L.: Dynamic knowledge representation for e-learning applications. In: Proc. of BISC International Workshop on Fuzzy Logic and the Internet (FLINT 2001), Berkeley, USA, ERL, College of Engineering, University of California (2001) 176–181

    Google Scholar 

  39. Weigend, A.S., Wiener, E.D., Pedersen, J.O.: Exploiting hierarchy in text categorization. Information Retrieval 1 (1999) 193–216

    Article  Google Scholar 

  40. Ruiz, M.E., Srinivasan, P.: Hierarchical text categorization using neural networks. Information Retrieval 5 (2002) 87–118

    Article  MATH  Google Scholar 

  41. Wermter, S.: Neural network agents for learning semantic text classification. Information Retrieval 3 (2000) 87–103

    Article  Google Scholar 

  42. Teuteberg, F.: Agentenbasierte informationserschließung im www unter einsatz von künstlichen neuronalen netzen und fuzzy-logik. Künstliche Intelligenz 03/02 (2002) 69–70

    Google Scholar 

  43. Benkhalifa, M., Mouradi, A., Bouyakhf, H.: Integrating external knowledge to supplement training data in semi-supervised learning for text categorization. Information Retrieval 4 (2001) 91–113

    Article  MATH  Google Scholar 

  44. Vegas, J., de la Fuente, P., Crestani, F.: A graphical user interface for structured document retrieval. In Crestani, F., Girolami, M., van Rijsbergen, C.J., eds.: Advances in Information Retrieval, Proc. of 24th BCS-IRSG European Colloqium on IR Research, Berlin, Springer (2002) 268–283

    Google Scholar 

  45. Kohonen, T.: Self-Organization and Associative Memory. Springer-Verlag, Berlin (1984)

    Google Scholar 

  46. Nürnberger, A.: Interactive text retrieval supported by growing self-organizing maps. In Ojala, T., ed.: Proc. of the International Workshop on Information Retrieval (IR 2001), Oulu, Finland, Infotech (2001) 61–70

    Google Scholar 

  47. Fritzke, B.: Growing cell structures — a self-organizing network for unsupervised and supervised learning. Neural Networks 7 (1994) 1441–1460

    Article  Google Scholar 

  48. Alahakoon, D., Halgamuge, S.K., Srinivasan, B.: Dynamic self-organizing maps with controlled growth for knowledge discovery. IEEE Transactions on Neural Networks 11 (2000) 601–614

    Article  Google Scholar 

  49. Nürnberger, A., Detyniecki, M.: Visualizing changes in data collections using growing self-organizing maps. In: Proc. of International Joint Conference on Neural Networks (IJCNN 2002), Piscataway, IEEE (2002) 1912–1917

    Google Scholar 

  50. Hearst, M.A., Karadi, C.: Cat-a-cone: An interactive interface for specifying searches and viewing retrieval results using a large category hierarchie. In: Proc. of the 20th Annual International ACM SIGIR Conference, ACM (1997) 246–255

    Google Scholar 

  51. Spoerri, A.: InfoCrystal: A Visual Tool for Information Retrieval. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA (1995)

    Google Scholar 

  52. Hemmje, M., Kunkel, C., Willett, A.: Lyberworld — a visualization user interface supporting fulltext retrieval. In: Proc. of ACM SIGIR 94, ACM (1994) 254–259

    Google Scholar 

  53. Fox, K.L., Frieder, O., Knepper, M.M., Snowberg, E.J.: Sentinel: A multiple engine information retrieval and visualization system. Journal of the American Society of Information Science 50 (1999) 616–625

    Article  Google Scholar 

  54. Pu, P., Pecenovic, Z.: Dynamic overview technique for image retrieval. In: Proc. of Data Visualization 2000, Wien, Springer (2000) 43–52

    Google Scholar 

  55. Havre, S., Hetzler, E., Perrine, K., Jurrus, E., Miller, N.: Interactive visualization of multiple query result. In: Proc. of IEEE Symposium on Information Visualization 2001, IEEE (2001) 105–112

    Google Scholar 

  56. Lin, X., Marchionini, G., Soergel, D.: A selforganizing semantic map for information retrieval. In: Proc. of the 14th International ACM/SIGIR Conference on Research and Development in Information Retrieval, New York, ACM Press (1991) 262–269

    Google Scholar 

  57. Honkela, T., Kaski, S., Lagus, K., Kohonen, T.: Newsgroup exploration with the websom method and browsing interface. Technical report, Helsinki University of Technology, Neural Networks Research Center, Espoo, Finland (1996)

    Google Scholar 

  58. Honkela, T.: Self-Organizing Maps in Natural Language Processing. PhD thesis, Helsinki University of Technology, Neural Networks Research Center, Espoo, Finland (1997)

    Google Scholar 

  59. Kohonen, T., Kaski, S., Lagus, K., Salojärvi, J., Honkela, J., Paattero, V., Saarela, A.: Self organization of a massive document collection. IEEE Transactions on Neural Networks 11 (2000) 574–585

    Article  Google Scholar 

  60. Merkl, D.: Text classification with self-organizing maps: Some lessons learned. Neurocomputing 21 (1998) 61–77

    Article  Google Scholar 

  61. Boyack, K.W., Wylie, B.N., Davidson, G.S.: Domain visualization using vxinsight for science and technology management. Journal of the American Society for Information Science and Technologie 53 (2002) 764–774

    Article  Google Scholar 

  62. Wise, J.A., Thomas, J.J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., Crow, V.: Visualizing the non-visual: Spatial analysis and interaction with information from text documents. In: Proc. of IEEE Symposium on Information Visualization’ 95, IEEE Computer Society Press (1995) 51–58

    Google Scholar 

  63. Small, H.: Visualizing science by citation mapping. Journal of the American Society for Information Science 50 (1999) 799–813

    Article  Google Scholar 

  64. Nielsen, J.: Usability Engineering. Morgan Kaufmann Publishers (1994)

    Google Scholar 

  65. Shneiderman, B., Byrd, D., Croft, W.B.: Sorting out searching: A user-interface framework for text searches. Communications of the ACM 41 (1998) 95–98

    Article  Google Scholar 

  66. Klusch, M., ed.: Intelligent Information Agents. Springer Verlag, Berlin (1999)

    Google Scholar 

  67. Rochio, J.J.: Relevance feedback in information retrieval. In Salton, G., ed.: The SMART Retrieval System. Prentice Hall, Englewood Cliffs, NJ (1971) 313–323

    Google Scholar 

  68. Robertson, S.E., Jones, K.S.: Relevance weighting of search terms. Journal of the American Society for Information Science 27 (1976) 129–146

    Google Scholar 

  69. Wong, S.K.M., Butz, C.J.: A bayesian approach to user profiling in information. Technology Letters 4 (2000) 50–56

    Google Scholar 

  70. Somlo, G.S., Howe, A.E.: Incremental clustering for profile maintenance in information gathering web agents. In: Proc. of the 5th International Conference on Autonomous Agents (AGENTS’ 01), ACM Press (2001) 262–269

    Google Scholar 

  71. Joachims, T., Freitag, D., Mitchell, T.M.: Webwatcher: A tour guide for the world wide web. In: Proc. of the International Joint Conferences on Artificial Intelligence (IJCAI 97), San Francisco, USA, Morgan Kaufmann Publishers (1997) 770–777

    Google Scholar 

  72. Jameson, A.: Modeling both the context and the user. Personal and Ubiquitous Computing 5 (2001) 29–33

    Article  Google Scholar 

  73. Nürnberger, A., Klose, A., Kruse, R.: Self-organising maps for interactive search in document databases. In Szczepaniak, P.S., Segovia, J., Kacprzyk, J., Zadeh, L.A., eds.: Intelligent Exploration of theWeb. Physica-Verlag, Heidelberg (2002) 119–135

    Google Scholar 

  74. Nürnberger, A., Klose, A.: Improving clustering and visualization of multimedia data using interactive user feedback. In: Proc. of the 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU 2002). (2002) 993–999

    Google Scholar 

  75. Nürnberger, A., Detyniecki, M.: User adaptive methods for interactive analysis of document databases. In: Proc. of the European Symposium on Intelligent Technologies (EUNITE 2002), Aachen, Verlag Mainz (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. FIN IWS-IR Group, University of Magdeburg, 39106, Magdeburg, Germany

    A. Nürnberger

  2. Laboratoire d’Informatique de Paris 6, CNRS, 75015, Paris, France

    M. Detyniecki

Authors
  1. A. Nürnberger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Detyniecki
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Design, Engineering & Computing, Bournemouth University, Poole House, Talbot Campus, Fern Barrow, Poole, BH12 5BB, UK

    Bogdan Gabrys

  2. Department of Process Engineering, Control Engineering Laboratory, University Oulu, P.O.Box 4300, 90014, Oulu, Finland

    Kauko Leiviskä

  3. Institut für Mechanik, Lehrstuhl für Technische Dynamik, Universität Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany

    Jens Strackeljan

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Nürnberger, A., Detyniecki, M. (2005). Adaptive Multimedia Retrieval: From Data to User Interaction. In: Gabrys, B., Leiviskä, K., Strackeljan, J. (eds) Do Smart Adaptive Systems Exist?. Studies in Fuzziness and Soft Computing, vol 173. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32374-0_17

Download citation

  • DOI: https://doi.org/10.1007/3-540-32374-0_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24077-8

  • Online ISBN: 978-3-540-32374-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation