Abstract
There is no visual model of the world in our heads. Over the past few years the phenomena of change blindness and inattentional blindness as well as studies of the capacity of visual working memory all point to the fact that we do not retain much about the world from one fixation to the next. The impression we have of a detailed visual environment comes from our ability to make rapid eye movements and sample the environment at will. What we see at any given instant in time is determined by what we are trying to accomplish. We see what we need to see. If we need to find a path through a crowd we see the openings. If we are trying to find a friend we see the faces. We can think of this process of seeing as the execution of a continuous stream of visual queries on the environment. Depending on the task at hand the brain constructs a visual query and we execute a visual search to satisfy that query. Making visual queries a central concept opens the door to a theory of how we think visually with interactive displays. The process can be thought of as constructing and executing queries on displays. Problem components are formulated into questions (or hypotheses) that can be answered (or tested) by means of pattern discovery. These are formulated into visual queries having the form of search patterns. Visual eye-movement scanning strategies are used to search the display. Within each fixation, active attention determines which patterns are pulled from visual cortex subsystems that do pattern analysis. Patterns and objects are formed as transitory object files from a proto-pattern space. Elementary visual queries can be executed at a rate of 40 msec per simple pattern. Links to non-visual propositional information are activated by icons or familiar patterns, bringing visual information simultaneously into verbal working memory.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baddeley, A.D., Logie, R.H.: Working Memory: The Multiple-Component Model. In: Miyake, A., Shah, P. (eds.) Models of Working Memory, pp. 28–61. Cambridge University Press, New York (1999)
Baddeley, A.D., Hitch, G.J.: Working memory. In: Bower, G.H. (ed.) The psychology of learning and motivation: Advances in research and theory, vol. 8, pp. 647–667. Erlbaum, Hillsdale (1974)
Becker, R.A., Cleveland, W.S.: Brushing scatterplots. Technometrics 29(2), 127–142 (1987)
Hutchins, E.: Distributed Cognition. MIT Press, Cambridge (1995)
Jonides, J.: Voluntary versus automatic control over the mind’s eye. In: Long, J., Baddeley, A.D. (eds.) Attention and Performance, vol. 9, pp. 187–203. Erlbaum, Hillsdale (1981)
Kahneman, D., Triesman, A., Gibbs, B.J.: The reviewing of object files: Object-specific integration of information. Cognitive Psychology 24, 175–219 (1992)
Mack, A., Rock, I.: Inattentional Blindness. MIT Press, Cambridge (1998)
Munzner, T., Guimbretière, F., Robertson, G.: Constellation: A Visualization Tool for Linguistic Queries from Mindnet. In: Keim, D., Wills, G. (eds.) Proceedings of the 1999 IEEE Symposium on Information Visualization, pp. 132–135. IEEE CS Press, Washington (1999)
O’Regan, J.K.: Solving the “real” mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology 46, 461–488 (1992)
Postma, A., De Haan, E.H.F.: What was where? Memory for Object locations. Quarterly Journal of Experimental Psychology 49A(1), 178–199 (1996)
Rensink, R.A.: The dynamic representation of scenes. Visual Cognition 7, 17–42 (2000)
Rensink, R.A., O’Reagan, J.K., Clark, J.J.: To see or not to see: The need for attention to perceive changes in scenes. Psychological Science 8(5), 368–373 (1997)
Rensink, R.A.: Change Detection. Annual Review of Psychology 53, 245–277 (2002)
Rock, I., Gutman, D.: The effect of inattention on form perception. Journal of Experimental Psychology: Human Perception and Performance 7(2), 275–285 (1981)
Simons, D.J., Levin, D.T.: Failure to detect changes to people during a real-world interaction. Psychonomic Bulletin and Review 5, 644–649 (1998)
Triesman, A.: Preattentive processing in vision. Computer Vision, Graphics and Image Processing 31, 156–177 (1985)
Vogel, E.K., Woodman, G.F., Luck, S.J.: Storage of features, conjunctions and objects in visual working memory. Journal of Experimental Psychology: Human Perception and Performance 27(1), 92–114 (2001)
Ware, C.: Information Visualization: Perception for Design, 2nd edn. Morgan Kaufman, San Francisco (2004)
Ware, C., Bobrow, R.: Motion to support rapid interactive queries on node-link diagrams. ACM Transactions on Applied Perception 1(1), 3–18 (2004)
Wolfe, J.M., Gancarz, G.G.: Guided Search 3.0. A model of visual search catches up with Jay Enoch 40 Years Later. In: Lakshminarayanan, V. (ed.) Basic and Clinical Applications of Vision Science, pp. 189–192. Kluwer Academic, Dordrecht (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Ware, C. (2005). Visual Queries: The Foundation of Visual Thinking. In: Tergan, SO., Keller, T. (eds) Knowledge and Information Visualization. Lecture Notes in Computer Science, vol 3426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11510154_2
Download citation
DOI: https://doi.org/10.1007/11510154_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26921-2
Online ISBN: 978-3-540-31962-7
eBook Packages: Computer ScienceComputer Science (R0)