Abstract
In this paper, we propose an automatic photo tag expansion system for the community photo collections, such as Flickr. Our aim is to suggest relevant tags for a target photograph uploaded to the system by a user, by incorporating the visual and textual cues from other related photographs. As the first step, the system requires the user to add only a few initial tags for each uploaded photo. These initial tags are used to retrieve related photos including the same tags in their tag lists. Then the set of candidate tags collected from a large pool of photos is weighted according to the similarity of the target photo to the retrieved photo including the tag. Finally, the tags in the highest rankings are used to automatically expand the tags of the target photo. The experimental results on Flickr photos show that, the use of visual similarity of semantically relevant photos to recommend tags improves the quality of suggested tags compared to only text-based systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Naaman, M., Yeh, R.B., Garcia-Molina, H., Paepcke, A.: Leveraging context to resolve identity in photo albums. In: Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, JCDL 2005, Denver, CO, USA, June 07 - 11, pp. 178–187. ACM, New York (2005)
Yan, R., Natsev, A., Campbell, M.: An efficient Manual Image Annotation Approach based on Tagging and Browsing. In: Proceedings of ACM International Multimedia Conference (2007)
Wenyin, L., Dumais, S., Sun, Y., Zhang, H., Czerwinski, M., Field, B.: Semi-automatic image annotation. In: Proc. of Interact: Conference on HCI, pp. 326–333 (July 2001)
Wenyin, L., Sun, Y., Zhang, H.: MiAlbum - a system for home photo managemet using the semi-automatic image annotation approach. In: Proceedings of the Eighth ACM international Conference on Multimedia, MULTIMEDIA 2000, Marina del Rey, California, United States, pp. 479–480. ACM, New York (2000)
Suh, B., Bederson, B.B.: Semi-Automatic Image Annotation Using Event and Torso Identification. Tech Report HCIL-2004-15, Computer Science Department, University of Maryland, College Park, MD
Suh, B., Bederson, B.B.: Semi-automatic photo annotation strategies using event based clustering and clothing based person recognition. Interact. Comput. 19(4), 524–544 (2007)
Marlow, C., Naaman, M., Boyd, D., Davis, M.: HT06, tagging paper, taxonomy, Flickr, academic article, to read. In: Proceedings of the Seventeenth Conference on Hypertext and Hypermedia, Odense, Denmark, August 22-25 (2006)
Sigurbjrnsson, B., van Zwol, R.: Flickr tag recommendation based on collective knowledge. In: Proceeding of the 17th international Conference on World Wide Web, WWW 2008, Beijing, China, April 21 - 25, pp. 327–336. ACM, New York (2008)
Elliott, B., Ozsoyoglu, Z.M.: A comparison of methods for semantic photo annotation suggestion. In: 22nd International International Symposium on Computer and Information Sciences, 2007. ISCIS 2007, November 7-9, pp. 1–6 (2007)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2) (2004)
Quack, T., Leibe, B., Gool, L.V.: World-scale Mining of Objects and Events from Community Photo Collections. In: CIVR 2008, Niagara Falls, Canada, July 7-9 (2008)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content based image retrieval at the end of the early years. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(12) (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kucuktunc, O., Sevil, S.G., Tosun, A.B., Zitouni, H., Duygulu, P., Can, F. (2008). Tag Suggestr: Automatic Photo Tag Expansion Using Visual Information for Photo Sharing Websites. In: Duke, D., Hardman, L., Hauptmann, A., Paulus, D., Staab, S. (eds) Semantic Multimedia. SAMT 2008. Lecture Notes in Computer Science, vol 5392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92235-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-92235-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92234-6
Online ISBN: 978-3-540-92235-3
eBook Packages: Computer ScienceComputer Science (R0)