Skip to main content
SpringerLink
Log in

Interactive search and browsing interface for large-scale visual repositories

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Due to the rapid proliferation of both user-generated and broadcasted content, the interfaces for search and browsing of visual media have become increasingly important. This paper presents a novel intuitive interactive interface for browsing of large-scale image and video collections. It visualises underlying structure of the dataset by the size and spatial relations of displayed images. In order to achieve this, images or video key-frames are initially clustered using an unsupervised graph-based clustering algorithm. By selecting images that are hierarchically laid out on the screen, user can intuitively navigate through the collection or search for specific content. The extensive experimental results based on user evaluation of photo search, browsing and selection as well as interactive video search demonstrate good usability of the presented system and improvement when compared to the standard methods for interaction with large-scale image and video collections.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Apple Ltd., iPhoto09 (2009) http://www.apple.com/ilife/iphoto/

  2. Bederson B (2001) PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, pp 71–80

  3. Calic J, Campbell NW (2007) Compact visualisation of video summaries. EURASIP Journal on Advances in Signal Processing, vol 2007, Article ID 19496

  4. Calic J, Gibson DP, Campbell NW (2007) Efficient layout of comic-like video summaries. IEEE Trans Circuits Syst Video Technol 17(7):931–936

    Article  Google Scholar 

  5. Chong-Wah N, Yu-Fei M, Hong-Jiang Z (2005) Video summarization and scene detection by graph modelling. IEEE Trans Circuits Syst Video Technol 15(2):296–305

    Article  Google Scholar 

  6. Cooper M, Foote J, Girgensohn A, Wilcox L (2003) Temporal event clustering for digital photo collections. In: Proceedings of the eleventh ACM international conference on Multimedia. ACM Press, pp 364–373

  7. Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181

    Article  Google Scholar 

  8. Ferman M, Tekalp M (1997) Multiscale content extraction and representation for video indexing. Proc SPIE Int Soc Opt Eng 3229:23–31. doi:10.1117/12.290352

    Google Scholar 

  9. Graham A, Garcia-Molina H, Paepcke A, Winograd T (2002) Time as essence for photo browsing through personal digital libraries. In: Proceedings of the second ACM/IEEE-CS joint conference on digital libraries

  10. Huynh DF, Drucker SM, Baudisch P, Wong C (2005) Time quilt: scaling up zoomable photo browsers for large, unstructured photo collections. In: CHI ’05 Extended abstracts on human factors in computing systems, ACM, New York, NY, pp 1937–1940

    Chapter  Google Scholar 

  11. Jung CG (1971) Psychological types. Princeton University Press, Princeton, New Jersey

    Google Scholar 

  12. Loui A, Savakis AE (2000) Automatic image event segmentation and quality screening for albuming applications. In: IEEE international conference on multimedia and expo

  13. Ren K, Calic J (2009) FreeEye - interactive intuitive interface for large-scale image browsing. In: Proc of ACM multimedia

  14. Ren K, Sarvas R, Calic J (2009) FreeEye - intuitive summarisation of photo collections. In: Proc of ACM multimedia multimedia grand challenge

  15. Toyama K, Logan R, Roseway A (2003) Geographic location tags on digital images. In: Proc of 11th annual ACM international conference on multimedia (MM2003), Berkeley, CA, November 2–8, 2003. ACM Press, New York, NY, pp 156–166

    Google Scholar 

  16. Zhong D, Zhang H, Chang S (1996) Clustering methods for video browsing and annotation. Proc SPIE Int Soc Opt Eng 2670:239. doi:10.1117/12.234800

    Google Scholar 

  17. Zhuang Y, Rui Y, Huang TS, Mehrotra S (1998) Adaptive key frame extraction using unsupervised clustering. Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on, vol 1, pp 866–870, 4–7 Oct 1998

Download references

Author information

Authors and Affiliations

  1. I-Lab, University of Surrey, Guildford, GU2 7XH, UK

    Kan Ren & Janko Ćalić

  2. Helsinki Institute for Information Technology, PO Box 9800, 02015, TKK, Finland

    Risto Sarvas

Authors
  1. Kan Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Risto Sarvas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Janko Ćalić
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kan Ren.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ren, K., Sarvas, R. & Ćalić, J. Interactive search and browsing interface for large-scale visual repositories. Multimed Tools Appl 49, 513–528 (2010). https://doi.org/10.1007/s11042-009-0445-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0445-y

Keywords

Search

Navigation