Recognising, Knowing and Naming: Can Object Picture Processing Models Accommodate Non-Picture Visuals?
This paper provides an overview of information processing accounts of pictures of objects and of non-picture visuals (NPVs) such as graphs and diagrams, including theories of graph comprehension. Compared to the study of objects, there appear to be rather few information processing studies of NPVs. An NPV corpus was developed and items were used as visual stimuli in four cognitive tasks. The tasks assessed perceptual level processing (NPV recognition), semantic knowledge and lexical production (naming). The results are discussed in relation to several questions: How well do models of object picture processing accommodate the findings from this study of NPV processing? To what extent can NPVs be considered to be another class of object pictures? Are well-established phenomena in the visual object domain such as frequency and age of acquisition effects observed for NPVs? How do patterns of performance on the perceptual, semantic and naming tasks differ across NPV item sub-classes? The results show that performance patterns across a range of cognitive tasks utilizing NPV stimuli are - to some degree - similar to those seen in object picture processing. Age of acquisition effects were also observed. It is concluded that the use of experimental paradigms from studies of object picture processing are useful for understanding how people understand and use non-pictorial graphical representations such as diagrams.
Keywordsinformation processing cognitive processing diagrams external representations graph comprehension object recognition picture naming age of acquisition
Unable to display preview. Download preview PDF.
- 1.Humphreys, G.W., Riddoch, M.J.: Visual object processing: A cognitive neuropsychological approach. Lawrence Erlbaum Associates, Hillsdale (1987)Google Scholar
- 2.Shah, P., Freedman, E.G., Vekiri, I.: The comprehension of quantitative information in graphical displays. In: Shah, P., Miyake, A. (eds.) The Cambridge Handbook of Visuospatial Thinking, pp. 426–476. Cambridge University Press (2005)Google Scholar
- 3.Pinker, S.: A theory of graph comprehension. In: Freedle, R. (ed.) Artificial Intelligence and the Future of Testing, pp. 73–126. Lawrence Erlbaum Associates, Hillsdale (1990)Google Scholar
- 5.Baddeley, A.: Working memory, thought, and action. Oxford University Press (2007)Google Scholar
- 6.Snodgrass, J.G., Vanderwart, M.: A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 6, 174–215 (1980)Google Scholar
- 13.Shah, P., Freedman, E.G.: Bar and line graph comprehension: An interaction of top-down and bottom-up processes. Topics in Cognitive Science, 1–19 (2009)Google Scholar
- 16.Trafton, J.G., Trickett, S.B.: A new model of graph and visualization usage. In: Moore, J.D., Stenning, K. (eds.) Proceedings of the 23rd Annual Conference of the Cognitive Science Society, pp. 1048–1053. Lawrence Erlbaum Associates, Mahweh (2001)Google Scholar
- 18.Tversky, B.: Spatial schemas in depictions. In: Gattis, M. (ed.) Spatial Schemas in Abstract Thought, pp. 79–111. MIT Press (2001)Google Scholar
- 28.Cox, R., Grawemeyer, B.: The mental organisation of external representations. In: Schmalhofer, F., Young, R., Katz, G. (eds.) Proceedings of the 1st European Cognitive Science Conference (EuroCogSci 2003), Lawrence Erlbaum Associates, Osnabrück (2003)Google Scholar
- 31.Lockwood, A.: A visual survey of graphs, maps, charts and diagrams for the graphic designer. Studio Vista, London (1969)Google Scholar
- 33.Cheng, P.C.-H.: Functional roles for the cognitive analysis of diagrams in problem solving. In: Cottrell, G.W. (ed.) Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society, pp. 207–212. Lawrence Erlbaum Associates, Mahweh (1996)Google Scholar