Abstract
This paper adopts the premise that the’ semantic gap’ is an incompletely surveyed feature in the landscape of visual image retrieval, and proposes a framework within which this deficiency might be made good. Simple classifications of types of image and of types of user are proposed. Consideration is then given in outline to how semantic content is realised by each class of user within each class of image. The argument is advanced that this realisation finds expression in perceptual, generic interpretive and specific interpretive content. This analytic framework provides the basis for the specification of a broadly encompassing evaluation study, which will employ the image/user type classification and the expert domain knowledge of selected user groups in the construction of segmented test collections of real queries, images and relevance judgements. From this study should come a better-informed view on the nature of semantic information need, and on the representation and recovery of semantic content across a broad spectrum of image retrieval activity.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Barthes, R.: The Elements of Semiology. Cape, London, (1967)
Eakins, John P.; Graham, Margaret E.: Content-based Image Retrieval. A report to the JISC Technology Applications Programme. Institute for Image Data Research, University of Northumbria at Newcastle, Newcastle upon Tyne, (1999). http://www.unn.ac.uk/iidr/. Accessed February 2003
Panofsky, E.: Studies in Iconology: Humanistic Themes in the Art of the Renaissance. Harper & Rowe, New York, (1962)
Shatford, S.: Analyzing the Subject of a Picture: A Theoretical Approach. Cataloguing & Classification Quarterly, 5(3) (1986), 39–61
Krause, M. G.: Intellectual Problems of Indexing Picture Collections. Audiovisual Librarian, 14(2), (1988) 73–81
Jörgensen, Corinne: Indexing Images: Testing an Image Description Template. Paper given at the ASIS 1996 Annual Conference, October 19–24, 1996. http://www.asis.org/annual-96/ElectronicProceedings/jorgensen.html. Acessed February 2003
Enser, P.G.B.: Query Analysis in a Visual Information Retrieval Context. Journal of Document and Text Management, 1(1), (1993) 25–52
Enser, P.G.B.: Pictorial Information Retrieval. (Progress in Documentation). Journal of Documentation, 51(2) (1995) 126–170
Armitage, L. H.; Enser, P. G. B.: Analysis of User Need in Image Archives. Journal of Information Science, 23(4) (1997), 287–299
Sandom, C.; Enser, P.: VIRAMI — Visual Information Retrieval for Archival Moving Imagery. In: Bearman, D.; Garzotto, F. (eds.): ichim01 International Cultural Heritage Informatics Meeting: Cultural Heritage and Technologies in the Third Millennium, Politecnico di Milano, Italy, September 3–7 2001, 141–152
Enser, P. and Sandom, C.: Retrieval of Archival Moving Imagery — CBIR Outside the Frame? In: Lew, Michael S.; Sebe, Nicu,; Eakins, John P. (eds.): Image And Video Retrieval. International Conference, CIVR 2002, London, UK, July 18–19, 2002 Proceedings. Springer, Berlin, (2002) 202–214
Markkula, M.; Sormunen, E.: End-user Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive. Information Retrieval 1(4), (2000) 259–285
Greisdorf, Howard; O’Connor, Brian: Modelling What Users See When They Look at Images: A Cognitive Viewpoint. In: Journal of Documentation. Vol 58. No. 1, (2002) 6–29
Rui, Y.; Huang, T.S.; Chang, S.-F.: Image Retrieval: Current Techniques, Promising Directions, and Open Issues. Journal of Visual Communication and Image Representation 10, (1999) 39–62
Biederman, I.: Recognition-by-components: A Theory of Human Image Understanding. Psychological Review 94(2), (1987) 115–147
Eakins, J.P.: Content-Based Image Retrieval — What’s Holding It Back? Paper given at the ASCI [Advanced School for Computing and Imaging] 2002 Conference, Lochem, the Netherlands, June 19–21 2002
Graham, Margaret E.: The Description and Indexing of Images. Report of a survey of ARLIS members, 1998/1999. (1999). http://www.unn.ac.uk/iidr/ RLIS/rlisrep.htm. Accessed February 2003
Eakins,, J.P.; Graham, M.E.; Boardman, J.M.: Trademark Image Retrieval by Shape Similarity. IEEE Multimedia, 5(2), April–June 1998, 53–63
Wu, J.K. et al.: Content-Based Retrieval for Trademark Registration. Multimedia Tools and Applications 3, (1996) 245–267
Eakins, J. P. Design Criteria for a Shape Retrieval System. Computers in Industry, 21 (1993), 167–184
Conniss, L.R; Ashford, L.R; Graham, M.E.: Information Seeking Behaviour in Image Retrieval. VISOR 1 Final Report. Library and Information Commission Research Report 95. Institute for Image Data Research, University of Northumbria at Newcastle’ Newcastle upon Tyne, (2000)
Fidel, Raya: The Image Retrieval Task: Implications for the Design and Evaluation of Image Databases. New Review of Hypermedia and Multimedia. 1997(3) 181–199
Ornager, Susanne: The Newspaper Image Database: Empirical Supported Analysis of Users’ Typology and Word Association Clusters. In Fox, E.A.; Ingwersen, P.; Fidel R.; (eds): SIGIR 95, Proceedings of the 18th International AGM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, New York, (1995). 212–218
Markkula, M.; Sormunen, E.: Searching for Photos-Journalists’ Practices in Pictorial IR. In: Eakins, J.P.; Harper, D.J.; Jose, J. (eds) The Challenge of Image Retrieval: papers presented at a Wokshop on Image Retrieval, 5 February 1998, University of Northumbria at Newcastle, UK. University of Northumbria at Newcastle, Newcastle upon Tyne, (1998)
Hastings, S.K.: Query Categories in a Study of Intellectual Access to Digitized Art Images. ASIS’ 95: Proceedings of the 58th ASIS Annual Meeting, Vol.32, (1995), 3–8
Hastings, S.K. Evaluation of Image Retrieval Systems: Role of User Feedback. In: Sandore, B. (ed.) Progress in Visual Information Access and Retrieval. Library Trends 48(2), (1999) 438–452
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Enser, P., Sandom, C. (2003). Towards a Comprehensive Survey of the Semantic Gap in Visual Image Retrieval. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds) Image and Video Retrieval. CIVR 2003. Lecture Notes in Computer Science, vol 2728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45113-7_29
Download citation
DOI: https://doi.org/10.1007/3-540-45113-7_29
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40634-1
Online ISBN: 978-3-540-45113-6
eBook Packages: Springer Book Archive