Abstract
This paper addresses the key question of this book by apply- ing the chaotic dynamics found in biological brains to design of a strictly sequential artificial neural network-based natural language understand- ing (NLU) system. The discussion is in three parts. The first part ar- gues that, for NLU, two foundational principles of generative linguistics, mainstream cognitive science, and much of artificial intelligence -that natural language strings have complex syntactic structure processed by structure-sensitive algorithms, and that this syntactic structure deter- mines string semantics- are unnecessary, and that it is sufficient to pro- cess strings purely as symbol sequences. The second part then describes neuroscientific work which identifies chaotic attractor trajectory in state space as the fundamental principle of brain function at a level above that of the individual neuron, and which indicates that sensory process- ing, and perhaps higher cognition more generally, are implemented by cooperating attractor sequence processes. Finally, the third part sketches a possible application of this neuroscientific work to design of an a se- quential NLU system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allen J. (1995) Natural Language Understanding. Benjamin / Cummings, Redwood City, California
Bechtel W., Abrahamsen A.(1991) Connectionism and the Mind. Basil Blackwell
Beer R. (1995) A Dynamical Systems Perspective on Environment Agent Interactions. Artificial Intelligence 72:173–215
Beer R.(2000) Dynamical Approaches to Cognitive Science. Trends in Cognitive Sciences 4(3):91–99
Briscoe T.(1996) Robust Parsing. In [24]
Brooks R.(1991) Intelligence without Representation. Artificial Intelligence 47:139–59
Carbonell J., Hayes P. (1992) Natural Language Understanding. In [78]
Carroll J., Long D. (1989) Theory of Finite Automata. Prentice-Hall, Englewood Cliffs, New Jersey
Chalmers D. (1996) Minds, Machines, and Mathematics. Psyche 2. http://psyche.cs.monash.edu.au/psyche-index-v2.html
Chiel H., Beer R. (1997) The Brain has a Body: Adaptive Behaviour Emerges from Interactions of nervous System, Body, and Environment. Trends in Neurosciences 20:553–7
Chierchia G., McConnell-Ginet S. (2000) Meaning and Grammar: an Introduction to Semantics. 2nd ed. MIT Press, Cambridge, MA
Chomsky N. (1957) Syntactic Structures;. Mouton, s’Gravenhage
Chomsky N. (1959) On Certain Formal Properties of Grammars. Information and Control 1:91–112
Chomsky N. (1961) On the Notion ‘Rule of Grammar’. Proceedings of the 12th Symposium in Applied Mathematics, American Mathematical Society
Chomsky N., Miller G. (1965) Finitary Models of Language Users’, Readings in Mathematical Psychology 2, ed. Bush R., Galanter E., Luce D. John Wiley, New York
Christiansen M. (1992) The (Non)-necessity of Recursion in Natural Language Processing. Proceedings of The 14th Annual Conference of the Cognitive Science Society, University of Indiana
Christiansen M., Chater N. (1999) Toward a Connectionist Model of Recursion in Human Linguistic Performance. Cognitive Science 23:157–205
Church K. (1980) On Memory Limitations in Natural Language Processing. TR MIT/CS/TR-45, Massachusetts Institute of Technology
Church K., Ejerhed E. (1983) Finite State Parsing. Papers from the Seventh Scandinavian Conference of Linguistics, University of Helsinki
Cisek P. (1999) Beyond the Computer Metaphor: Behaviour as Interaction. In [62]
Clark A. (1989) Microcognition: Philosophy, Cognitive Science, and Parallel Distributed Processing. MIT Press, Cambridge MA
Clark A. (1993) Associative Engines: Connectionism, Concepts, and Representational change. MIT Press, Cambridge MA
Clark A. (1997) Being There. Putting Brain, Body, and World Together Again. MIT Press, Cambridge MA
Cole R., Mariani J., Uszkoreit H., Zaenen A., Zue V. (1996) Survey of the State of the Art in Human Language Technology. Centre for Spoken Language Understanding, Oregon Graduate Institute of Science and Technology. http://cslu.cse.ogi.edu/HLTsurvey/
Craig E. (ed) (1998) Routledge Encyclopedia of Philosophy. Routledge, London
Cruse D. (2000) Meaning in Language: an Introduction to Semantics and Pragmatics. Oxford University Press, Oxford
Dale R., Moisl H., Somers H. (eds) (2000) Handbook of Natural Language Processing. Marcel Dekker, New York
Dorffner G., Prem E. (1993) Connectionism, Symbol Grounding, and Autonomous Agents. Proceedings of the 15th Annual Conference of the Cognitive Science Society
Dorffner G. (ed) Neural Networks and a New Artificial Intelligence. International Thomson Computer Press, London
Dreyfus H. (1992) What Computers Still Can’t Do. 2nd ed. MIT Press, Cambridge MA
Finlay J., Dix A. (1996) An Introduction to Artificial Intelligence. UCL Press, London
Fodor J., Pylyshyn Z. (1988) Connectionism and Cognitive Architecture: a Critical Analysis. Cognition 28:3–71
Freeman W. (1991) The Physiology of Perception. Scientific American 264(2):78–85
Freeman W. (1992) Tutorial in Neurobiology: from Single Neurons to Brain Chaos. International Journal of Bifurcation and Chaos 2:451–82
Freeman W. (1994)Chaos in the CNS: Theory and Practice. Flexibility and Constraint in Behavioral Systems, ed. Greenspan R., Kyriacou C. John Wiley, New York
Freeman W. (1994) Qualitative Overview of Population Neurodynamics. Neural Modeling and Neural Networks, ed. Ventriglia F. Pergamon, Oxford
Freeman W. (1999) Consciousness, Intentionality, and Causality. In [62]0
Freeman W. (1999) How Brains Make Up their Minds. Weidenfeld and Nicholson, London
Freeman W., Nunez R. (1999) Restoring to Cognition the Forgotten Primacy of Action, Intention, and Emotion’. In [62]
Gardner H. (1985) The Mind’s New Science. A History of the Cognitive Revolution. Basic Books, New York
Gazdar G., Pullum G. (1985) Computationally Relevant Properties of Natural Languages and their Grammars. New Generation Computing 3:273–306
Gazdar G., Mellish C. (1989) Natural Language Processing in LISP. Addison-Wesley, Wokingham, UK
Haugeland J. (1985) Artificial Intelligence: the Very Idea. MIT Press, Cambridge MA
Hopcroft J., Ullman J. (1979) Introduction to Automata Theory, Languages, and Computation. Addison Wesley, Wokingham, UK
Horwich P. (1998) Meaning. Clarendon Press, Oxford
Hurley S. (1998) Consciousness in Action. MIT Press, Cambridge MA
Johnson M. (1987) The Body in the Mind: the Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, Chicago
Kelso J.A.S. (1995) Dynamic Patterns: the Self-organization of Brain and Behavior. MIT Press, Cambridge MA
Kramer B., Mylopoulos J. (1992) Knowledge Representation. In [78]
Krawer S., Tombe L. (1981) Transducers and Grammars as Theories of Language. Theoretical Linguistics 10:173–202
Langendoen D. (1975) Finite State Parsing of Phrase-structure Languages and the Status of Readjustment Rules in Grammar. Linguistic Inquiry 6:533–54
Langendoen D., Langsam Y. (1984) The Representation of Constituent Structure for Finite State Parsing. Proceedings of the Conference for Computational Linguistics, COLING 84
Langendoen D., Postal P. (1984b) The Vastness of Natural Languages. Blackwell, Oxford
Lappin S. (1996) The Handbook of Contemporary Semantic Theory. Blackwell, Oxford
Larson R., Segal G. (1995) Knowledge of Meaning. MIT Press, Cambridge, MA
Lochbaum K., Grosz B., Sidner C. (2000) Discourse Structure and Intention Recognition. In [27]
Luger G., Stubblefield W. (1998) Artificial Intelligence. Structures for Complex Problem Solving. Addison Wesley Longman, Harlow, UK
McClelland J., Rumelhart D. (1986) Parallel Distributed Processing. Explorations in the Microstructure of cognition. MIT Press, Cambridge MA
Moisl H. (1992) Connectionist Finite-state Natural Language Processing. Connection Science 2:67–91
Moisl H (2000) NLP Based on Artificial Neural Networks: Introduction. In [27]
Newell A., Simon H. (1976) Computer Science as Empirical Enquiry: Symbols and Search. Communications of the Association for Computing Machinery 19:113–26
Nunez R., Freeman W. (1999) Reclaiming Cognition. Imprint Academic,Thorverton, UK
Partee B., ter Meulen a., Wall R. (1990) Mathematical Methods in Linguistics. Kluwer, Boston
Penrose R. (1989) The Emperor’s New Mind. Oxford University Press, Oxford
Penrose R. (1994) Shadows of the Mind. Oxford University Press, Oxford
Pereira F. (1996) Sentence modeling and parsing. In [24]
Petrick S. (1992) Parsing. In [78]
Poesio M. (2000) Semantic analysis. In [27]
Port R., van Gelder T. (1995) Mind as Motion. Explorations in the Dynamics of Cognition. MIT Press, Cambridge MA
Pulman S. (1986) Grammars, Parsers, and Memory Limitations. Language and Cognitive Processes 1:197–225
Pulman S. (1996) Semantics. In [24]
Pylyshyn Z. (1986) Computation and Cognition. MIT Press, Cambridge MA
Pylyshyn Z. (1992) Cognitive science. In [78]
Reich P. (1969) The Finiteness of Natural Language. Language 45:831–43
Roche E., Schabes Y. (1997) Finite-state Language Processing. MIT Press, Cambridge MA
Saeed J. (1997) Semantics. Blackwell, Oxford
Samuelsson C., Wiren M. (2000) Parsing Techniques. In [27]
Shapiro S. (1992) Encyclopedia of Artificial Intelligence. 2nd ed. John Wiley and Sons, New York
Shieber S. (1985) Evidence against the Context Freeness of Natural Language. Linguistics and Philosophy 8:333–43
Skarda C. (1999) The Perceptual Form of Life. In [62]
Skarda C., Freeman W. (1987) How Brains Make Chaos in order to Make Sense of the World. Behavioral and Brain Sciences 10(2):161–95
Steels L., Brooks R. (1995) The Artificial Life Route to Artificial Intelligence. Lawrence Erlbaum, Hove, UK
Thelen E., Smith L. (1994) A Dynamic Systems Approach to the Development of Cognition and Action. MIT Press, Cambridge MA
van Gelder T. (1998) Cognitive Architecture: What choice do we have? In Constraining cognitive theories: issues and opinions, ed. Pylyshyn Z. Ablex, Norwood NJ
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Moisl, H. (2001). Linguistic Computation with State Space Trajectories. In: Wermter, S., Austin, J., Willshaw, D. (eds) Emergent Neural Computational Architectures Based on Neuroscience. Lecture Notes in Computer Science(), vol 2036. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44597-8_32
Download citation
DOI: https://doi.org/10.1007/3-540-44597-8_32
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42363-8
Online ISBN: 978-3-540-44597-5
eBook Packages: Springer Book Archive