Semantic multimedia organization is an open challenge. In this chapter, we present an innovative way of automatically organizing multimedia information to facilitate content-based browsing. It is based on self-organizing maps. The visualization capabilities of the self-organizing map provide an intuitive way of representing the distribution of data as well as the object similarities. The main idea is to visualize similar documents spatially close to each other, while the distance between different documents is bigger. We demonstrate this on the particular case of video information. One key concept is the disregard of the temporal aspect during the clustering. We introduce a novel time bar visualization that reprojects the temporal information. The combination of innovative visualization and interaction methods allows efficient exploration of relevant information in multimedia content.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
O’Reilly, T.: What Is Web 2.0? Design Patterns and Business Models for the Next Generation of Software. http://www.oreillynet.com/ (last visited April 5, 2007)
Flickr. http://www.flickr.com/ (last visited April 5, 2007)
MySpace. http://www.myspace.com/ (last visited April 5, 2007)
YouTube. http://www.youtube.com/ (last visited April 5, 2007)
Bade, K., De Luca, E.W., Nürnberger, A.: Multimedia retrieval: Fundamental techniques and principles of adaptivity. KI: German Journal on Artificial Intelligence 18 (2004) 5–10
Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Computer Networks 30 (1998) 107–117
Bach, J.R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R., Shu, C.F.: Virage image search engine: an open framework for image management. In Sethi, I.K., Jain, R.C., eds.: Proc. SPIE. Volume 2670 (1996) 76–87.
Pentland, A., Picard, R., Sclaroff, S.: Photobook: content-based manipulation of image databases. International Journal of Computer Vision 18 (1996) 233–254.
Flickner, M., Sawhney, H.S., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: The QBIC system. IEEE Computer 28 (1995) 23–32
Carson, C., Thomas, M., Belongie, S., Hellerstein, J., Malik, J.: Blobworld: A system for region-based image indexing and retrieval. In: Third International Conference on Visual Information Systems. Springer, Berlin Heidelberg New York (1999) 509–516
Omhover, J.F., Detyniecki, M., Bouchon-Meunier, B.: A region-similarity-based image retrieval system. In Bouchon-Meunier, B., Coletti, G., Yager, R., eds.: Modern Information Processing: From Theory to Applications. Elsevier, Amsterdam (2005)
Natsev, A., Rastogi, R., Shim, K.: WALRUS: A similarity retrieval algorithm for image databases. IEEE Transactions on Knowledge and Data Engineering 16 (2004) 310–316
Wang, J., Li, J., Wiederhold, G.: SIMPLIcity: semantics-sensitive integrated matching for picturelibraries. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001) 947–963
Rui, Y., Huang, T., Mehrotra, S.: Content-based image retrieval with relevance feedback in MARS. In: Proceedings on International Conference on Image Processing (1997)
Kim, D., Chung, C.: QCluster: relevance feedback using adaptive clustering for content-based image retrieval. In: Proceedings of ACM SIGMOD International Conference on Management of data, New York, NY, USA, ACM Press (2003) 599–610
Campbell, M., Haubold, A., Ebadollahi, S., Joshi, D., Naphade, M.R., Natsev, A., Seidl, J., Smith, J.R., Scheinberg, K., Tesic, J., Xie, L.: IBM Research TRECVID-2006 video retrieval system. In: NIST TRECVID-2006 Workshop (2006)
Worring, M., Snoek, C., de Rooij, O., Nguyen, G., Smeulders, A.: The mediamill semantic video search engine. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (2007)
Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: MIR ’06: Proceedings of the Eighth ACM International Workshop on Multimedia Information Retrieval, New York, NY, USA, ACM Press (2006) 321–330
Hauptmann, A., Yan, R., Lin, W.H.: How many high-level concepts will fill the semantic gap in news video retrieval? In: Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR (2007)
Fodor, I.K.: A survey of dimension reduction techniques. Technical Report, Lawrence Livermore National Laboratory (2002)
Burges, C.J.: Geometric methods for feature extraction and dimensional reduction: A guided tour. Technical Report, Microsoft Research (2004)
Kohonen, T.: Self-Organizing Maps. Springer-Verlag, Berlin Heidelberg New York (1995)
Kaski, S.: Data Exploration Using Self-Organizing Maps. PhD thesis, Helsinki University of Technology (1997)
Lin, X., Marchionini, G., Soergel, D.: A selforganizing semantic map for information retrieval. In: Proceedings of the 14th International ACM/SIGIR Conference on Research and Development in Information Retrieval, New York, ACM Press (1991) 262–269
Kohonen, T., Kaski, S., Lagus, K., Salojärvi, J., Honkela, J., Paattero, V., Saarela, A.: Self organization of a massive document collection. IEEE Transactions on Neural Networks 11 (2000) 574–585
Roussinov, D.G., Chen, H.: Information navigation on the web by clustering and summarizing query results. Information Processing & Management 37 (2001) 789–816
Nürnberger, A., Detyniecki, M.: Visualizing changes in data collections using growing self-organizing maps. In: Proceedings of International Joint Conference on Neural Networks (IJCANN 2002), IEEE (2002) 1912–1917
Laaksonen, J., Koskela, M., Oja, E.: PicSOM-self-organizing image retrieval with MPEG-7 content descriptors. IEEE Transactions on Neural Network 13 (2002) 841–853
Koskela, M., Laaksonen, J.: Semantic annotation of image groups with self-organizing maps. In: Leow, W.K., Lew, M.S., Chua, T.S., Ma, W.Y., Chaisorn, L., Bakker, E.M., eds.: Proceedings of the Fourth International Conference on Image and Video Retrieval (CIVR 2005). Volume 3568 of Lecture Notes in Computer Science, Berlin, Springer-Verlag, Berlin Heidelberg New York (2005) 518–527
Nürnberger, A., Klose, A.: Improving clustering and visualization of multimedia data using interactive user feedback. In: Proceedings of the Ninth International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (2002) 993–999
Pampalk, E., Rauber, A., Merkl, D.: Content-based organization and visualization of music archives. In: MULTIMEDIA ’02: Proceedings of the Tenth ACM International Conference on Multimedia, New York, NY, USA, ACM Press (2002) 570–579
Knees, P., Schedl, M., Pohle, T., Widmer, G.: An innovative three-dimensional user interface for exploring music collections enriched with meta-information from the web. In: ACM Multimedia, Santa Barbara, CA, USA (2006)
Vesanto, J.: SOM-based data visualization methods. Intelligent-Data-Analysis 3 (1999) 111–26
Lee, H., Smeaton, A.F., Berrut, C., Murphy, N., Marlow, S., O’Connor, N.E.: Implementation and analysis of several keyframe-based browsing interfaces to digital video. In: Borbinha, J., Baker, T., eds.: LNCS. Volume 1923 (2000) 206–218
Girgensohn, A., Boreczky, J., Wilcox, L.: Keyframe-based user interfaces for digital video. Computer 34 (2001) 61–67
Marques, O., Furht, B.: Content-Based Image and Video Retrieval. Kluwer, Norwell, MA (2002)
Veltkamp, R.C., Burkhardt, H., Kriegel, H.P.: State-of-the-Art in Content-Based Image and Video Retrieval. Kluwer, Norwell, MA (2001)
Nürnberger, A., Detyniecki, M.: Adaptive multimedia retrieval: From data to user interaction. In: Strackeljan, J., Leivisk, K., Gabrys, B., eds.: Do Smart Adaptive Systems Exist – Best Practice for Selection and Combination of Intelligent Methods. Springer-Verlag, Berlin Heildelberg New York (2005)
Browne, P., Smeaton, A.F., Murphy, N., O’Connor, N., Marlow, S., Berrut, C.: Evaluating and combining digital video shot boundary detection algorithms. In: Proceedings of Irish Machine Vision and Image Processing Conference, Dublin (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Bärecke, T., Kijak, E., Detyniecki, M., Nürnberger, A. (2008). Organizing Multimedia Information with Maps. In: Hassanien, AE., Abraham, A., Kacprzyk, J. (eds) Computational Intelligence in Multimedia Processing: Recent Advances. Studies in Computational Intelligence, vol 96. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76827-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-76827-2_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76826-5
Online ISBN: 978-3-540-76827-2
eBook Packages: EngineeringEngineering (R0)