Skip to main content
SpringerLink
Log in

A hierarchical photo visualization system emphasizing temporal and color-based coherences

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Most photograph management systems use a scrollable view based on a sequential grid layout that arranges photo thumbnails in some default order on the screen. Although users are very accustomed to this kind of photo layout, multiple drag and drop mouse interactions are required to search and obtain an overview of their photos. This paper describes a photo visualization system that visualizes hundreds of photos on a 2D grid space in order to help users manage their photos. Our system provides the following three main functions. First, it places similar photos in terms of color histogram and shoot time close together on the grid. Therefore, users can find their photos using temporal and color-based coherences relating to human sensory information such as colors that invokes similar feelings and photo shoot time. Second, our system provides a hierarchical clustering method based on a 2D grid space. This function can decrease drag and drop mouse interactions when classifying photos into small groups compared to the sequential grid layout. Finally, our system displays a representative photo from each cluster, in order to provide a summarized view of multiple photos. For evaluation of our system, we conducted seven experiments consisting of four computational and three subjective evaluations making a comparison with a sequential grid layout. The computational evaluations consider the four features of space efficiency, temporal stability and color-based consistency between neighbor photos of the grid, and cluster similarity. The evaluations establish that our system can decrease space efficiency while improving the other features. The three subjective evaluations deal with our system’s ease-of-use from a subjective human perspective. Most people that participated in our experiments found that this photo visualization system was quite suited to finding and summarizing their photo content.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. ACDSystems. ACDSee photomanager. http://store.acdsee.com/

  2. Apple. iPhoto. http://www.apple.com/ilife/iphoto/

  3. Bederson BB (2001) PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps. In: Proc. of ACM symposium on user interface software and technology. ACM Press, pp 71–80

  4. Cooper M, Foote J, Girgensohn A, Wilcox L (2005) Temporal event clustering for digital photo collections. ACM Trans Multimed Comput Commun Appl 1(3):269–288

    Article  Google Scholar 

  5. Girgensohn A, Shipman F, Wilcox L, Turner T, Cooper M (2009) MediaGLOW: organizing photos in a graph-based workspace. In: Proc. of the 13th international conference on intelligent user interfaces. ACM, pp 419–424

  6. Google. Picasa web albums. http://picasa.google.com/features.html

  7. Graham A, Garcia-Molina H, Paepcke A, Winograd T (2002) Time as essence for photo browsing through personal digital libraries. In: Proc. of the 2nd ACM/IEEE-CS joint conference on digital libraries. ACM Press, pp 326–335

  8. Jang C-J, Yoon T, Cho H-G (2009) A smart clustering algorithm for photo set obtained from multiple digital cameras. In: Proc. of the 24th ACM symposium on applied computing. ACM, pp 1784–1791

  9. Ke Y, Tang X, Jing F (2006) The design of high-level features for photo quality assessment. In: Proc. of IEEE computer society conference on computer vision and pattern recognition, pp 419–426

  10. Kustanowitz J, Shneiderman B (2006) Hierarchical layouts for photo libraries. IEEE Multimed 13(4):62–72

    Article  Google Scholar 

  11. Litten J (1975) Design and form: the basic course at the Bauhaus and later. Wiley, Chichester

    Google Scholar 

  12. Luo Y, Tang X (2008) Photo and video quality evaluation: focusing on the subject. In: Proc. of the 10th European conference on computer vision, Berlin, Heidelberg, pp 386–399

  13. Mota J, Fonseca MJ, Gonçalves D, Jorge JA (2008) Agrafo: a visual interface for grouping and browsing digital photos. In: Proc. of the working conference on advanced visual interfaces. ACM, pp 494–495

  14. Pinho R, de Oliveira MCF, de A Lopes A (2009) Incremental board: a grid-based space for visualizing dynamic data sets. In: Proc. of the 24th ACM symposium on applied computing. ACM, pp 1757–1764

  15. Platt JC (2000) Autoalbum: clustering digital photos using probabilistic model merging. In: Proc. of IEEE workshop on content-based access of image and video libraries. IEEE Computer Society, Los Alamitos, pp 96–100

    Chapter  Google Scholar 

  16. Platt JC, Czerwinski M, Field BA (2003) PhotoTOC: automatic clustering for browsing personal photos. In: Proc. of pacific rim conference on multimedia, pp 6–10

  17. Prasad BG, Biswas KK, Gupta SK (2004) Region-based image retrieval using integrated color, shape, and location index ((special issue: colour for image indexing and retrieval)). Comput Vis Image Underst 94(1–3):193–233

    Article  Google Scholar 

  18. Rodden K, Wood KR (2003) How do people manage their digital photos? In: Proc. of ACM SIGCHI on human factors in computing systems, pp 409–416

  19. Ryu D-S, Chung W-K, Cho H-G (2010) PHOTOLAND: a new image layout system using spatio-temporal information in digital photos. In: Proc. of the 25th ACM symposium on applied computing, pp 1884–1891

  20. Schaefer G (2010) A next generation browsing environment for large image repositories. Multimed Tools Appl 47(1):105–120

    Article  Google Scholar 

  21. Singh R, Pinzon JC (2007) Study and analysis of user behaviour and usage patterns in a unified personal multimedia information environment. In: Proc. of international conference on multimedia and expo, IEEE, Piscataway. IEEE, Piscataway, pp 1031–1034

    Chapter  Google Scholar 

  22. Toyama K, Logan R, Roseway A (2003) Geographic location tags on digital images. In: Proc. of the 11th ACM international conference on multimedia. ACM, pp 156–166

  23. Wiki. CUDA. http://enc.daum.net/dic100/contents.do?query1=10XX171957

Download references

Acknowledgements

This work was supported by the IT R&D program of MKE/MCST/KEIT (KI001820, Development of Computational Photography Technologies for Image and Video Contents).

Author information

Authors and Affiliations

  1. Dept. of Computer Science and Engineering, Pusan National University, Keumjeong-gu, Busan, Korea

    Dong-Sung Ryu, Woo-Keun Chung & Hwan-Gue Cho

Authors
  1. Dong-Sung Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Woo-Keun Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hwan-Gue Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hwan-Gue Cho.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ryu, DS., Chung, WK. & Cho, HG. A hierarchical photo visualization system emphasizing temporal and color-based coherences. Multimed Tools Appl 61, 523–550 (2012). https://doi.org/10.1007/s11042-010-0700-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0700-2

Keywords

Search

Navigation