Skip to main content
SpringerLink
Log in

An Eye-Tracking Study of Integrative Spatial Cognition over Diagrammatic Representations

  • Conference paper
Spatial Cognition VII (Spatial Cognition 2010)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6222))

Included in the following conference series:

Abstract

Spatial representations, such as maps, charts, and graphs, convey different levels of information, depending on how their elements are grouped into different units of objects. Therefore, how people set boundaries to graphical objects to be interpreted and how they maintain the object boundaries during the given task are two important problems in understanding the way people utilize spatial representations for problem-solving. Table comprehension process was experimentally investigated in terms of eye gaze control behaviors when people were required to read off information distributed over large-scale objects, e.g., a row or a column, of the given table. Evidence was found that a large-scale object can be bounded by a single attentional shift to it, and that they can be retained as coherent objects for subsequent reference. These findings suggest the existence of a higher-order information processing in the comprehension of a spatial representation, based on rather intricate processes of attention management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ballard, D.H., Hayhoe, M.M., Pook, P.K., Rao, R.P.N.: Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20(4), 723–767 (2001)

    Google Scholar 

  2. Barwise, J., Etchemendy, J.: Visual information and valid reasoning. In: Allwein, G., Barwise, J. (eds.) Logical Reasoning with Diagrams, pp. 3–25. Oxford University Press, Oxford (1990)

    Google Scholar 

  3. Bertin, J.: Semiology of Graphics: Diagrams, Networks, Maps. The University of Wisconsin Press (1973)

    Google Scholar 

  4. Bertin, J.: Graphics and Graphic Information. Walter de Gruyter, Berlin (1981) (Originally published in France in 1977)

    Google Scholar 

  5. Blignaut, P.: Fixation identification: The optimum threshold for a dispersion algorithm. Attention, Perception, & Psychophysics 71(4), 881–895 (2009)

    Article  Google Scholar 

  6. Driver, J., Baylis, G.C.: Attention and visual object segmentation. In: Driver, J., Baylis, G.C., Parasuraman, R. (eds.) The Attentive Brain, pp. 299–325. MIT Press, Cambridge (1998)

    Google Scholar 

  7. Duncan, J.: Selective attention and the organization of visual information. Journal of Experimental Psychology: General 113(4), 501–517 (1984)

    Article  Google Scholar 

  8. Gilhooly, K.J., Wood, M., Kinnear, P.R., Green, C.: Skill in map reading and memory for maps. Quarterly Journal of Experimental Psychology 40A, 87–107 (1988)

    Google Scholar 

  9. Grawemeyer, B., Cox, R.: The effects of users’ background diagram knowledge and task characteristics upon information display selection. In: Stapleton, G., Howse, J., Lee, J. (eds.) Diagrams 2008. LNCS (LNAI), vol. 5223, pp. 321–334. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  10. Guthrie, J.T., Weber, S., Kimmerly, N.: Searching documents: Cognitive processes and deficits in understanding graphs, tables, and illustrations. Contemporary Educational Psychology 18, 186–221 (1993)

    Article  Google Scholar 

  11. Kahneman, D., Treisman, A., Gibbs, B.J.: The reviewing of object files: Object-speci?c integration of information. Cognitive Psychology 24(2), 175–219 (1992)

    Article  Google Scholar 

  12. Kosslyn, S.M.: Elements of Graph Design. W. H. Freeman and Company, New York (1994)

    Google Scholar 

  13. Kramer, A.F., Jacobson, A.: Perceptual organization and focused attention: the role of objects and proximity in visual processing. Perception & Psychophysics 50(3), 267–284 (1991)

    Google Scholar 

  14. Lamme, V.A.F., Rodriguez-Rodriguez, V., Spekreojse, H.: Separate processing dynamics for texture elements, bundaries and surfaces in primary visual cortex of the macaque monkey. Cerebral Cortex 9, 406–413 (1999)

    Article  Google Scholar 

  15. Lowe, R.K.: Diagram prediction and higher order structures in mental representation. Research in Science Education 24, 208–216 (1994)

    Article  Google Scholar 

  16. O’Craven, K.M., Downing, P.E., Kanwisher, N.K.: fMRI evidence for objects as the units of attentional selection. Nature 401, 584–587 (1999)

    Article  Google Scholar 

  17. Olivier, P.: Diagrammatic reasoning: an artificial intelligence perspective. In: Blackwell, A.F. (ed.) Thinking with Diagrams, pp. 63–78. Kluwer Academic Publishers, Dordrecht (2001)

    Google Scholar 

  18. Pinker, S.: A theory of graph comprehension. In: Aritificial Intelligence and the Future of Testing, pp. 73–126. L. Erlbaum Associates, Mahwah (1990)

    Google Scholar 

  19. Pylyshyn, Z.: The role of location indexes in spatial perception: A sketch of the finst spatial-index model. Cognition 32, 65–97 (1989)

    Article  Google Scholar 

  20. Pylyshyn, Z.: Seeing and Visualizing: It’s Not What You Think. The MIT Press, Cambridge (2003)

    Google Scholar 

  21. Ratwani, R.M., Trafton, J.G., Boehm-Davis, D.A.: Thinking graphically: Connecting vision and cognition during graph comprehension. Journal of Experimental Psychology: Applied 14(1), 36–49 (2008)

    Article  Google Scholar 

  22. Roelfsema, P.R.: Cortical algorithms for perceptual grouping. Annual Review of Neuroscience 29, 203–227 (2006)

    Article  Google Scholar 

  23. Roelfsema, P.R., Lamme, V.A.F., Spekreijse, H.: The implementation of visual routines. Vision Research 40, 1385–1411 (2000)

    Article  Google Scholar 

  24. Roelfsema, P.R., Lamme, V.A.F., Spekreojse, H.: Object-based attention in the primary visual cortex of the macaque monkey. Nature 395, 376–381 (1998)

    Article  Google Scholar 

  25. Shimojima, A.: Operational constraints in diagrammatic reasoning. In: Barwise, J., Allwein, G. (eds.) Logical Reasoning with Diagrams, pp. 27–48. Oxford University Press, Oxford (1995)

    Google Scholar 

  26. Shimojima, A.: Derivative meaning in graphical representations. In: Proceedings of the 1999 IEEE Symposium on Visual Languages, pp. 212–219. IEEE Computer Society, Los Alamitos (1999)

    Chapter  Google Scholar 

  27. Shimojima, A., Katagiri, Y.: An eye-tracking study of exploitations of spatial constraints in diagrammatic reasoning. In: Stapleton, G., Howse, J., Lee, J. (eds.) Diagrams 2008. LNCS (LNAI), vol. 5223, pp. 74–88. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  28. Shimojima, A., Katagiri, Y.: Hypothetical drawing in embodied spatial reasoning. In: Proceedings of the 30th Annual Meeting of the Cognitive Science Society, pp. 2247–2252 (2008)

    Google Scholar 

  29. Spivey, M.J., Richardson, D.C., Fitneva, S.A.: Thinking outside the brain: Spatial indices to visual and linguistic information. In: Henderson, J.M., Ferreira, F. (eds.) The Interface of Language, Vision, and Action: Eye Movements and the Visual World, pp. 161–189. Psychology Press, San Diego (2004)

    Google Scholar 

  30. Stenning, K., Oberlander, J.: A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science 19(1), 97–140 (1995)

    Article  Google Scholar 

  31. Ullman, S.: Visual routines. Cognition 18, 97–159 (1984)

    Article  Google Scholar 

  32. Wainer, H.: Understanding graphs and tables. Educaional Researcher 21, 14–23 (1992)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Doshisha University, 1-3 Tatara-Miyakodani, Kyotanabe, Kyoto, Japan

    Atsushi Shimojima

  2. Future University Hakodate, 116-2 Kamedanakano, Hakodate, Hokkaido, Japan

    Yasuhiro Katagiri

Authors
  1. Atsushi Shimojima
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yasuhiro Katagiri
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Cognitive Science, Institute of Computer Science and Social Research, Albert-Ludwigs-Universität Freiburg, Friedrichstraße 50, 79098, Freiburg, Germany

    Christoph Hölscher

  2. Department of Psychology, Temple University, Weiss Hall 1701 North 13th Street, 19122-6085, Philadelphia, PA, USA

    Thomas F. Shipley  & Nora S. Newcombe  & 

  3. Department of Psychology, ’Sapienza’ University of Rome, Via dei Marsi 78, 00185, Rome, Italy

    Marta Olivetti Belardinelli

  4. FB 10, Faculty of Linguistics and Literary Sciences, University of Bremen, Building GW2, Bibliothekstraße 1, 28334, Bremen, Germany

    John A. Bateman

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shimojima, A., Katagiri, Y. (2010). An Eye-Tracking Study of Integrative Spatial Cognition over Diagrammatic Representations. In: Hölscher, C., Shipley, T.F., Olivetti Belardinelli, M., Bateman, J.A., Newcombe, N.S. (eds) Spatial Cognition VII. Spatial Cognition 2010. Lecture Notes in Computer Science(), vol 6222. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14749-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14749-4_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14748-7

  • Online ISBN: 978-3-642-14749-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation