Multimedia Tools and Applications

, Volume 47, Issue 1, pp 105–120 | Cite as

A next generation browsing environment for large image repositories

  • Gerald SchaeferEmail author


Next generation environments will change the way people work and live as they will provide new advances in areas ranging from remote work and education, e-commerce, gaming to information-on-demand. In many of these applications intelligent interpretation of multimedia data such as image, video and audio resources is necessary. In this paper we present an effective approach to handling image repositories providing the user with an intuitive interface of visualising and browsing large collections of pictures. Based on the idea of similarity-based organisation of images where images that are visually similar are located close to each other in visualisation space, images are projected onto a sphere with which the user can interact. Rotating the sphere reveals images of different colours while tilting operations focus on brighter or darker images. Large image collections are handled through a hierarchical approach that brings up similar, previously hidden, images when zooming in on an area. Furthermore, the way images are organised can be interactively changed by the user. Our next generation browsing environment has been successfully tested on a large database of several thousand images.


Image databases Content-based image retrieval Image database browsing Hue sphere 


  1. 1.
    Bartolini I, Ciaccia P, Patella M (2006) Adaptively browsing image databases with PIBE. Multimed Tools Appl 31(3):269–286CrossRefGoogle Scholar
  2. 2.
    Chen C (2004) Information visualization, 2nd edn. Springer, New YorkGoogle Scholar
  3. 3.
    Chen C, Gagaudakis G, Rosin P (2000a) Similarity-based image browsing. In: Int. conference on intelligent information processing, pp 206–213Google Scholar
  4. 4.
    Chen J, Bouman C, Dalton J (2000b) Hierarchical browsing and search of large image databases. IEEE Trans Image Processing 9(3):442–455CrossRefGoogle Scholar
  5. 5.
    Chen Y, Butz A (2008) PhotoSim: Tightly integrating image analysis into a photo browsing UI. In: Int. symposium on smart graphics, pp 224–231Google Scholar
  6. 6.
    CIE (1989) International Lighting Vocabulary, 4th edn. CIE Publications 17.4, Commission International de L’EclairageGoogle Scholar
  7. 7.
    Dontcheva M, Agrawala M, Cohen M (2005) Metadata visualization for image browsing. In: 18th annual ACM symposium on user interface software and technologyGoogle Scholar
  8. 8.
    Gomi A, Miyazaki R, Itoh T, Li J (2008) CAT: A hierarchical image browser using a rectangle packing technique. In: 12th int. conference on information visualization, pp 82–87Google Scholar
  9. 9.
    Heesch D (2008) A survey of browsing models for content based image retrieval. Multimed Tools Appl 40(2):261–284CrossRefGoogle Scholar
  10. 10.
    Heesch D, Rüger S (2004) NNk networks for content-based image retrieval. In: European conference on information retrieval, pp 253–266Google Scholar
  11. 11.
    Keller I, Meiers T, Ellerbrock T, Sikora T (2001) Image browsing with PCA-assisted user-interaction. In: IEEE workshop on content-based access of image and video libraries, pp 102–108Google Scholar
  12. 12.
    Krischnamachari S, Abdel-Mottaleb M (1999) Image browsing using hierarchical clustering. In: IEEE symposium on computers and communications, pp 301–307Google Scholar
  13. 13.
    Kruskal J, Wish M (1978) Multidimensional scaling. Sage, Newbury ParkGoogle Scholar
  14. 14.
    Moghaddam B, Tian Q, Lesh N, Shen C, Huang T (2004) Visualization and user-modeling for browsing personal photo libraries. Int Journal of Computer Vision 56(1–2):109–130CrossRefGoogle Scholar
  15. 15.
    Moving Picture Experts Group (1999) Description of core experiments for MPEG-7 color/texture descriptors. Tech. rep. ISO/IEC JTC1/SC29/WG11/ N2929Google Scholar
  16. 16.
    Nakazato M, Huang T (2001) 3D MARS: immersive virtual reality for content-based image retrieval. In: IEEE int. conference on multimedia and expo, pp 44–47Google Scholar
  17. 17.
    Nguyen G, Worring M (2008) Interactive access to large image collections using similarity-based visualization. J Vis Lang Comput 19(2):203–224CrossRefGoogle Scholar
  18. 18.
    Plant W, Schaefer G (2009) Evaluation and benchmarking of image database navigation tools. In: Int. conference on image processing, computer vision, and pattern recognition, vol 1, pp 248–254Google Scholar
  19. 19.
    Platt J, Czerwinski M, Field B (2002) PhotoTOC: automatic clustering for browsing personal photographs. Tech. rep., Microsoft ResearchGoogle Scholar
  20. 20.
    Rodden K, Wood K (2003) How do people manage their digital photographs? In: SIGCHI conference on human factors in computing systems, pp 409–416Google Scholar
  21. 21.
    Rodden K, Basalaj D W Sinclair, Wood K (1999) Evaluating a visualisation of image similarity as a tool for image browsing. In: IEEE symposium on information visualization, pp 36–43Google Scholar
  22. 22.
    Rodden K, Basalaj W, Sinclair D, Wood K (2000) A comparison of measures for visualising image similarity. In: The challenge of image retrievalGoogle Scholar
  23. 23.
    Rubner Y, Guibas L, Tomasi C (1997) The earth mover’s distance, multi-dimensional scaling, and color-based image retrieval. In: Image understanding workshop, pp 661–668Google Scholar
  24. 24.
    Ruszala S, Schaefer G (2004) Visualisation models for image databases: A comparison of six approaches. In: Irish machine vision and image processing conference, pp 186–191Google Scholar
  25. 25.
    Sangwine J, Horne R (1998) The colour image processing handbook. Chapman & Hall, LondonGoogle Scholar
  26. 26.
    Schaefer G, Ruszala S (2005) Image database navigation: a globe-al approach. In: Int. symposium on visual computing. Springer lecture notes on computer science, vol 3804, pp 279–286Google Scholar
  27. 27.
    Schaefer G, Ruszala S (2006) Hierarchical image database navigation on a hue sphere. In: Int. symposium on visual computing. Springer lecture notes on computer science, vol 4292, pp 814–823Google Scholar
  28. 28.
    Schaefer G, Stich M (2004) UCID - An uncompressed colour image database. In: Storage and retrieval methods and applications for multimedia 2004. Proceedings of SPIE, vol 5307, pp 472–480Google Scholar
  29. 29.
    Smeulders A, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1249–1380CrossRefGoogle Scholar
  30. 30.
    Stricker M, Orengo M (1995) Similarity of color images. In: Conf. on storage and retrieval for image and video databases III. Proceedings of SPIE, vol 2420, pp 381–392Google Scholar
  31. 31.
    Worring M, de Rooij O, van Rijn T (2007) Browsing visual collections using graphs. In: Int. workshop on workshop on multimedia information retrieval, pp 307–312Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Department of Computer ScienceLoughborough UniversityLoughboroughUK

Personalised recommendations