Abstract
There is much empirical evidence showing that factors other than the relative positions of objects in Euclidean space are important in the comprehension of a wide range of spatial prepositions in English and other languages. We first the overview the functional geometric framework [11] which puts “what” and “where” information together to underpin the situation specific meaning of spatial terms. We then outline an implementation of this framework. The computational model for the processing of visual scenes and the identification of the appropriate spatial preposition consists of three main modules: (1) Vision Processing, (2) Elman Network, (3) Dual-Route Network. Mirroring data from experiments with human participants, we show that the model is both able to predict what will happen to objects in a scene, and use these judgements to influence the appropriateness of over/under/above/below to describe where objects are located in the scene. Extensions of the model to other prepositions and quantifiers are discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ballard, D.H., Hayhoe, M.M., Pook, P.K., Rao, R.P.N.: Deictic codes for the embodiment of cognition. Behavioural and Brain Sciences 20, 723–767 (1997)
Barsalou, L.W.: Perceptual symbol systems. Behavioral and Brain Sciences 22(4), 577–660 (1999)
Cangelosi (in press). Grounding symbols in perceptual and sensorimotor categories: Connectionist and embodied approaches. In: Cohen, H., Lefebvre, C. (eds.) Categorization in Cognitive Science. Elsevier, Amsterdam
Cangelosi, A., Greco, A., Harnad, S.: From robotic toil to symbolic theft: Grounding transfer from entry-level to higher-level categories. Connection Science 12(2), 143–162 (2000)
Carlson-Radvansky, L.A., Covey, E.S., Lattanzi, K.M.: “What” effects on “where”: Functional influences on spatial relations. Psychological Science 10(6), 516–521 (1999)
Carlson-Radvansky, L.A., Radvansky, G.A.: The influence of functional relations on spatial term selection. Psychological Science 7, 56–60 (1996)
Carlson-Radvansky, L.A., Tang, Z.: Functional influences on orienting a reference frame. Memory & Cognition 28, 812–820 (2000)
Coventry, K.R.: Spatial prepositions, functional relations and lexical specification. In: Olivier, P., Gapp, K.-P. (eds.) Representation and Processing of Spatial Expressions, pp. 247–262. Lawrence Erlbaum Associates, Mahwah (1998)
Coventry, K.R., Cangelosi, A., et al.: (in submission) Spatial language and perceptual symbol systems: Implementing the functional geometric framework
Coventry, K.R., Carmichael, R., Garrod, S.C.: Spatial prepositions, object-specific function and task requirements. Journal of Semantics 11, 289–309 (1994)
Coventry, K.R., Garrod, S.C.: Saying, Seeing and Acting. The Psychological Semantics of Spatial Prepositions. Essays in Cognitive Psychology Series. Lawrence Erlbaum, Mahwah (2004)
Coventry, K.R., Garrod, S.C. (in press). Spatial prepositions and the functional geometric framework. Towards a classification of extra-geometric influences. In: Carlson, L.A., van der Zee, E. (eds.) Functional features in language and space: Insights from perception, categorization and development. Oxford University Press, Oxford
Coventry, K.R., Mather, G.: The real story of ‘over’? In: Coventry, K.R., Olivier, P. (eds.) Spatial Language: Cognitive and Computational Aspects, Kluwer Academic Publishers, Dordrecht (2002)
Coventry, K.R., Prat-Sala, M.: Object-specific function, geometry and the comprehension of ‘in’ and ‘on’. European Journal of Cognitive Psychology 13(4), 509–528 (2001)
Coventry, K.R., Prat-Sala, M., Richards, L.V.: The interplay between geometry and function in the comprehension of ‘over’, ‘under’, ‘above’ and ‘below’. Journal of Memory and Language 44, 376–398 (2001)
Deco, G., Lee, T.S.: A Unified Model of Spatial and Object Attention Based on Inter-cortical Biased Competition. Neurocomputing: An international journal 44-46, 775–781 (2002)
Edelman, S.: Representation and Recognition in Vision. MIT Press, Cambridge (1999)
Edelman, S.: Constraining the Neural Representation of the Visual World. Trends in Cognitive Sciences 6, 125–131 (2002)
Elman, J.L.: Finding structure in time. Cognitive Science 14, 179–211 (1990)
Feist, M.I., Gentner, D.: On Plates, Bowls, and Dishes: Factors in the Use of English ‘in’ and ‘on’. In: Proceedings of the Twentieth Annual Conference of the Cognitive Science Society, pp. 345–349 (1998)
Ferenz, K.S.: The role of nongeometric information in spatial language. PhD Thesis, Dartmouth College, Hanover, New Hampshire (2000)
Freyd, J., Pantzer, T., Cheng, J.: Representing statics as forces in equilibrium. Journal of Experimental Psychology: General 117, 395–407 (1988)
Gapp, K.P.: Angle, distance, shape and their relationship to projective relations. In: Moore, J.D., Lehman, J.F. (eds.) Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society, pp. 112–117. Lawrence Erlbaum Associates Inc., Mahwah (1995)
Garrod, S., Ferrier, G., Campbell, S.: In and on: Investigating the functional geometry of spatial prepositions. Cognition 72, 167–189 (1999)
Glenberg, A.M.: What memory is for. Behavioral and Brain Sciences 20(1), 1–55 (1997)
Glenberg, A.M., Kaschak, M.: Grounding language in action. Psychonomic Bulletin and Review 9(3), 558–565 (2002)
Grush, R. (in press). The emulation theory of representation: motor control, imagery, and perception. Behavioral and Brain Sciences
Herskovits, A.: Language and Spatial Cognition. An interdisciplinary study of the prepositions in English. Cambridge University Press, Cambridge (1986)
Hormann, H.: Then calculating listener, or how many are einige, mehrere and ein paar (some, several and a few). In: Bauerle, R., Schwarze, C., von Stechow, A. (eds.) Meaning, use and interpretation of language. De Gruyter, Berlin (1983)
Jeannerod, M.: The representing brain: Neural correlates of motor intention and imagery. Behavioral and Brain Sciences 17(2), 187–245 (1994)
Jeannerod, M.: Neural simulation of action: A unifying mechanism for motor cognition. NeuroImage 14, S103–S109 (2001)
Joyce, D., Richards, L., Cangelosi, A., Coventry, K.R.: Object representation-by-fragments in the visual system: A neurocomputational model. In: Wang, L., Rajapakse, J.C., Fukushima, K., Lee, S.Y., Yao, X. (eds.) Proceedings of the 9th International Conference on Neural Information Processing (ICONP 2002). IEEE Press, Singapore (2002)
Joyce, D.W., Richards, L.V., Cangelosi, A., Coventry, K.R.: On the foundations of perceptual symbol systems: Specifying embodied representations via connectionism. In: Dretje, F., Dorner, D., Schaub, H. (eds.) The Logic of Cognitive Systems. Proceedings of the Fifth International Conference on Cognitive Modelling, pp. 147–152. Universitats-Verlag, Bamberg (2003)
Landau, B., Jackendoff, R.: ’What’ and ’where’ in spatial language and cognition. Behavioural and Brain Sciences 16(2), 217–265 (1993)
Logan, G.D., Sadler, D.D.: A computational analysis of the apprehension of spatial relations. In: Bloom, P., Peterson, M.A., Nadel, L., Garrett, M.F. (eds.) Language and Space, pp. 493–530. MIT Press, Cambridge (1996)
Markman, E.M.: How children constrain the possible meanings of words. In: Concepts and conceptual development: Ecological and intellectual factors in categorization, Cambridge University Press, Cambridge (1987)
Moxey, L.M., Sanford, A.J.: Communicating Quantities. A Psychological Perspective. Lawrence Erlbaum Associates, Hove (1993)
Newstead, S.E., Coventry, K.R.: The role of context and functionality in the interpretation of quantifiers. European Journal of Cognitive Psychology 12(2), 243–259 (2000)
Plunkett, K., Sinha, C., Moller, M.F., Strandsry, O.: Symbol grounding or the emergence of symbols? Vocabulary grouth in children and a connectionist net. Connection Science 4(3-4), 293–312 (1992)
Regier, T.: The human semantic potential: Spatial language and constrained connectionism. MIT Press, Cambridge (1996)
Regier, T., Carlson, L.A.: Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology: General 130(2), 273–298 (2001)
Schwartz, D.L.: Physical imagery: Kinematic versus dynamic models. Cognitive Psychology 38, 433–464 (1999)
Talmy, L.: How language structures space. In: Pick, H., Acredolo, L. (eds.) Spatial Orientation: Theory, research and application, pp. 225–282. Plenum Press, New York (1983)
Ullman, S.: Visual routines. Cognition 18, 97–159 (1984)
Ullman, S.: High-level Vision. Object recognition and visual cognition. MIT Press, Cambridge (1996)
Ungderleider, l., Mishkin, M.: Two cortical visual systems. In: Ingle, D., Goodale, M., Mansfield, R. (eds.) Analysis of Visual Behaviour. MIT Press, Cambridge (1982)
Williamson, J.R.: Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps. Neural Networks 9(5), 881–897 (1996)
van der Zee, E., Watson, M. (in press). Between function and space: How functional and spatial features determine the comprehension of between. In: Carlson, L.A., van der Zee, E. (eds.) Functional features in language and space: Insights from perception, categorization and development. Oxford University Press, Oxford
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Coventry, K.R. et al. (2005). Spatial Prepositions and Vague Quantifiers: Implementing the Functional Geometric Framework. In: Freksa, C., Knauff, M., Krieg-Brückner, B., Nebel, B., Barkowsky, T. (eds) Spatial Cognition IV. Reasoning, Action, Interaction. Spatial Cognition 2004. Lecture Notes in Computer Science(), vol 3343. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-32255-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-32255-9_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25048-7
Online ISBN: 978-3-540-32255-9
eBook Packages: Computer ScienceComputer Science (R0)