Skip to main content

Towards a Comprehensive Survey of the Semantic Gap in Visual Image Retrieval

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2728))

Abstract

This paper adopts the premise that the’ semantic gap’ is an incompletely surveyed feature in the landscape of visual image retrieval, and proposes a framework within which this deficiency might be made good. Simple classifications of types of image and of types of user are proposed. Consideration is then given in outline to how semantic content is realised by each class of user within each class of image. The argument is advanced that this realisation finds expression in perceptual, generic interpretive and specific interpretive content. This analytic framework provides the basis for the specification of a broadly encompassing evaluation study, which will employ the image/user type classification and the expert domain knowledge of selected user groups in the construction of segmented test collections of real queries, images and relevance judgements. From this study should come a better-informed view on the nature of semantic information need, and on the representation and recovery of semantic content across a broad spectrum of image retrieval activity.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barthes, R.: The Elements of Semiology. Cape, London, (1967)

    Google Scholar 

  2. Eakins, John P.; Graham, Margaret E.: Content-based Image Retrieval. A report to the JISC Technology Applications Programme. Institute for Image Data Research, University of Northumbria at Newcastle, Newcastle upon Tyne, (1999). http://www.unn.ac.uk/iidr/. Accessed February 2003

    Google Scholar 

  3. Panofsky, E.: Studies in Iconology: Humanistic Themes in the Art of the Renaissance. Harper & Rowe, New York, (1962)

    Google Scholar 

  4. Shatford, S.: Analyzing the Subject of a Picture: A Theoretical Approach. Cataloguing & Classification Quarterly, 5(3) (1986), 39–61

    Article  Google Scholar 

  5. Krause, M. G.: Intellectual Problems of Indexing Picture Collections. Audiovisual Librarian, 14(2), (1988) 73–81

    Google Scholar 

  6. Jörgensen, Corinne: Indexing Images: Testing an Image Description Template. Paper given at the ASIS 1996 Annual Conference, October 19–24, 1996. http://www.asis.org/annual-96/ElectronicProceedings/jorgensen.html. Acessed February 2003

    Google Scholar 

  7. Enser, P.G.B.: Query Analysis in a Visual Information Retrieval Context. Journal of Document and Text Management, 1(1), (1993) 25–52

    Google Scholar 

  8. Enser, P.G.B.: Pictorial Information Retrieval. (Progress in Documentation). Journal of Documentation, 51(2) (1995) 126–170

    Article  Google Scholar 

  9. Armitage, L. H.; Enser, P. G. B.: Analysis of User Need in Image Archives. Journal of Information Science, 23(4) (1997), 287–299

    Article  Google Scholar 

  10. Sandom, C.; Enser, P.: VIRAMI — Visual Information Retrieval for Archival Moving Imagery. In: Bearman, D.; Garzotto, F. (eds.): ichim01 International Cultural Heritage Informatics Meeting: Cultural Heritage and Technologies in the Third Millennium, Politecnico di Milano, Italy, September 3–7 2001, 141–152

    Google Scholar 

  11. Enser, P. and Sandom, C.: Retrieval of Archival Moving Imagery — CBIR Outside the Frame? In: Lew, Michael S.; Sebe, Nicu,; Eakins, John P. (eds.): Image And Video Retrieval. International Conference, CIVR 2002, London, UK, July 18–19, 2002 Proceedings. Springer, Berlin, (2002) 202–214

    Google Scholar 

  12. Markkula, M.; Sormunen, E.: End-user Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive. Information Retrieval 1(4), (2000) 259–285

    Article  MATH  Google Scholar 

  13. Greisdorf, Howard; O’Connor, Brian: Modelling What Users See When They Look at Images: A Cognitive Viewpoint. In: Journal of Documentation. Vol 58. No. 1, (2002) 6–29

    Article  Google Scholar 

  14. Rui, Y.; Huang, T.S.; Chang, S.-F.: Image Retrieval: Current Techniques, Promising Directions, and Open Issues. Journal of Visual Communication and Image Representation 10, (1999) 39–62

    Article  Google Scholar 

  15. Biederman, I.: Recognition-by-components: A Theory of Human Image Understanding. Psychological Review 94(2), (1987) 115–147

    Article  Google Scholar 

  16. Eakins, J.P.: Content-Based Image Retrieval — What’s Holding It Back? Paper given at the ASCI [Advanced School for Computing and Imaging] 2002 Conference, Lochem, the Netherlands, June 19–21 2002

    Google Scholar 

  17. Graham, Margaret E.: The Description and Indexing of Images. Report of a survey of ARLIS members, 1998/1999. (1999). http://www.unn.ac.uk/iidr/ RLIS/rlisrep.htm. Accessed February 2003

    Google Scholar 

  18. Eakins,, J.P.; Graham, M.E.; Boardman, J.M.: Trademark Image Retrieval by Shape Similarity. IEEE Multimedia, 5(2), April–June 1998, 53–63

    Article  Google Scholar 

  19. Wu, J.K. et al.: Content-Based Retrieval for Trademark Registration. Multimedia Tools and Applications 3, (1996) 245–267

    Article  Google Scholar 

  20. Eakins, J. P. Design Criteria for a Shape Retrieval System. Computers in Industry, 21 (1993), 167–184

    Article  Google Scholar 

  21. Conniss, L.R; Ashford, L.R; Graham, M.E.: Information Seeking Behaviour in Image Retrieval. VISOR 1 Final Report. Library and Information Commission Research Report 95. Institute for Image Data Research, University of Northumbria at Newcastle’ Newcastle upon Tyne, (2000)

    Google Scholar 

  22. Fidel, Raya: The Image Retrieval Task: Implications for the Design and Evaluation of Image Databases. New Review of Hypermedia and Multimedia. 1997(3) 181–199

    Google Scholar 

  23. Ornager, Susanne: The Newspaper Image Database: Empirical Supported Analysis of Users’ Typology and Word Association Clusters. In Fox, E.A.; Ingwersen, P.; Fidel R.; (eds): SIGIR 95, Proceedings of the 18th International AGM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, New York, (1995). 212–218

    Chapter  Google Scholar 

  24. Markkula, M.; Sormunen, E.: Searching for Photos-Journalists’ Practices in Pictorial IR. In: Eakins, J.P.; Harper, D.J.; Jose, J. (eds) The Challenge of Image Retrieval: papers presented at a Wokshop on Image Retrieval, 5 February 1998, University of Northumbria at Newcastle, UK. University of Northumbria at Newcastle, Newcastle upon Tyne, (1998)

    Google Scholar 

  25. Hastings, S.K.: Query Categories in a Study of Intellectual Access to Digitized Art Images. ASIS’ 95: Proceedings of the 58th ASIS Annual Meeting, Vol.32, (1995), 3–8

    Google Scholar 

  26. Hastings, S.K. Evaluation of Image Retrieval Systems: Role of User Feedback. In: Sandore, B. (ed.) Progress in Visual Information Access and Retrieval. Library Trends 48(2), (1999) 438–452

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Enser, P., Sandom, C. (2003). Towards a Comprehensive Survey of the Semantic Gap in Visual Image Retrieval. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds) Image and Video Retrieval. CIVR 2003. Lecture Notes in Computer Science, vol 2728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45113-7_29

Download citation

  • DOI: https://doi.org/10.1007/3-540-45113-7_29

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40634-1

  • Online ISBN: 978-3-540-45113-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics