Abstract
One important user-oriented facet of digital video retrieval research involves how to abstract and display digital video surrogates. This study reports on an investigation of digital video results pages that use textual and visual surrogates. Twelve subjects selected relevant video records from results lists containing titles, descriptions, and three keyframes for ten different search tasks. All subjects were eye-tracked to determine where, when, and how long they looked at text and image surrogates. Participants looked at and fixated on titles and descriptions statistically reliably more than on the images. Most people used the text as an anchor from which to make judgments about the search results and the images as confirmatory evidence for their selections. No differences were found whether the layout presented text or images in left to right order.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wildemuth, B., Marchionini, G., Wilkens, T., Yang, M., Geisler, G., Fowler, B., Hughes, A., & Mu, X. (2002) Alternative surrogates for video objects in a digital library: users’ perspectives on their relative usability. In Proceedings of the European Conference on Digital Libraries. Rome, September 16–18, 2002. pp. 493–507.
Marchionini, G. & Geisler, G. (2002). The Open Video Digital Library. dLib Magazine, 8(12). http://www.dlib.org/dlib/december02/marchionini/12marchionini.html
Just, M. & Carpenter A. (1976) Eye Fixations and Cognitive Processes. Cognitive Psychology, 8. pp. 441–480.
Jacob, R. (1990) What You Look at is What you Get: Eye Movement-Based Interaction Techniques. ACM Transaction on Information Systems, 9(3). pp. 152–169.
Salvucci, D. & Goldberg, H. (2000). Identifying Fixations and Saccades in Eye-Tracking Protocols. Proceedings of the Symposium on Eye Tracking Research and Applications 2000. 2000, Palm Beach Gardens, Florida, US. pp. 71–78.
Velichkovsky, B., Dornhoefer, S., Pannash, S. & Unema, P. (2000) Visual Fixations and Level of Attentional Processing. Proceedings of the Symposium on Eye Tracking Research and Applications 2000. 2000, Palm Beach Gardens, Florida, US. pp. 79–85.
Peiz, J., Canosa, R. & Babcock, J. (2000) Extended Tasks Elicit Complex Eye Movement Patterns. Proceedings of the Symposium on Eye Tracking Research and Applications 2000. 2000, Palm Beach Gardens, Florida, US. pp. 37–43.
Rayner, K., Rotello, C., Stewart, A., Keir, J., & Duffy, S. (2001) Integrating text and pictorial information: eye movements when looking at print advertisements. Journal of Experimental Psychology: Applied, 7(3). pp. 219–226.
Faraday, P. & Sutcliffe, A. (1998) Making Contact Points between Text and Images. Proceedings of the sixth ACM International Conference on Multimedia. Bristol, UK. pp. 29–37.
Hegarty, M. (1992) The Mechanics of Comprehension and Comprehension of Mechanics. In Eye Movements and Visual Cognition: Scene Perception and Reading. ed. Rayner, K. New York: Springer-Verlag. pp. 428–448.
Hegarty, M. (1992) Mental Animation: Inferring Motion from Static displays of Mechanical Systems. Journal of Experimental Psychology: Learning, Memory and Cognition, 18. pp. 1084–1102.
Fox, R., Krugman, D., Fletcher, J. & Fischer, P. (1998) Adolescents’ Attention to Beer and Cigarette Print Ads and Associated Product Warnings. Journal of Advertising, 27. pp. 57–68.
Lohse, G. (1997) Consumer Eye Movement Patterns on Yellow Page Advertising. Journal of Advertising, 26. pp. 61–73.
Kirby, J., Moore, P., & Schofield, N. (1988) Verbal and Visual Learning Styles. Contemporary Educational Psychology, 13. pp. 169–184.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hughes, A., Wilkens, T., Wildemuth, B.M., Marchionini, G. (2003). Text or Pictures? An Eyetracking Study of How People View Digital Video Surrogates. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds) Image and Video Retrieval. CIVR 2003. Lecture Notes in Computer Science, vol 2728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45113-7_27
Download citation
DOI: https://doi.org/10.1007/3-540-45113-7_27
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40634-1
Online ISBN: 978-3-540-45113-6
eBook Packages: Springer Book Archive