Skip to main content
SpringerLink
Log in

On the Proper Treatment of Connectionism

  • Chapter
Philosophy, Mind, and Cognitive Inquiry

Part of the book series: Studies in Cognitive Systems ((COGS,volume 3))

Abstract

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models.

Higher-level analyses of these connectionist models reveal subtle relations to symbolic models. Parallel connectionist memory and linguistic processes are hypothesized to give rise to processes that are describable at a higher level as sequential rule application. At the lower level, computation has the character of massively parallel satisfaction of soft numerical constraints; at the higher level, this can lead to competence characterizable by hard rules. Performance will typically deviate from this competence since behavior is achieved not by interpreting hard rules but by satisfying soft constraints. The result is a picture in which traditional and connectionist theoretical constructs collaborate intimately to provide an understanding of cognition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ackley, D.H., Hinton, G.E. and Sejnowski, T.J. (1985) A learning algorithm for Boltzmann machines. Cognitive Science 9: 147–69.

    Article  Google Scholar 

  • Anderson, J.R. (1981) Cognitive skills and their acquisition. Erlbaum.

    Google Scholar 

  • Anderson, J.R. (1983) The architecture of cognition. Harvard University Press.

    Google Scholar 

  • Anderson, J.R. (1985) Cognitive Science 9(1): Special issue on connectionist models and their applications.

    Google Scholar 

  • Ballard, D.H. (1966) Cortical connections and parallel processing: Structure and function. Behavioral and Brain Sciences 9: 67–120.

    Article  Google Scholar 

  • Ballard, D.H. and Hayes, P.J. (1984) Parallel logical inference. Proceedings of the Sixth Conference of the Cognitive Science Society.

    Google Scholar 

  • Cohen, M.S. (1986) Design of a new medium for volume holographic information processing. Applied Optics 14: 2288–94.

    Article  Google Scholar 

  • Crick, F. and Asanuma, C. (1986) Certain aspects of the anatomy and physiology of the cerebral cortex. In: Parallel distributed prcoessing: Explorations in the microstructure of cognition. Vol. 2: Psychological and biological models, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Dell, G.S. (1985) Positive feedback in hierarchical connectionist models: Applications to language production. Cognitive Science 9: 3–23.

    Article  Google Scholar 

  • Derthick, M.A. (1986) A connectionist knowledge representation system. Thesis proposal, Computer Science Department, Carnegie-Mellon University.

    Google Scholar 

  • Feldman, J.A. (1961) A connectionist model of visual memory. In: Parallel models of associative memory, ed. C.E. Hinton and J.A. Anderson. Erlbaum.

    Google Scholar 

  • Feldman, J.A. (1985) Four frames suffice: A provisional model of vision and space. Behavioral and Brain Sciences 8: 265–89.

    Article  Google Scholar 

  • Feldman, J.A. (1986) Neural representation of conceptual knowledge. Technical Report 189, Department of Computer Science. University of Rochester.

    Google Scholar 

  • Feldman, J.A. and Ballard, D.H. (1982) Connectionist models and their properties. Cognitive Science 6: 205–54.

    Article  Google Scholar 

  • Feldman, J.A., Ballard, D.H., Brown, C.M. and Dell, G.S. (1985) Rochester connectionist papers: 1979–1985. Technical Report 172, Department of Computer Science, University of Rochester.

    Google Scholar 

  • Fodor, J.A. (1975) The language of thought. Harvard University Press.

    Google Scholar 

  • Fodor, J.A. (1987) Why there still has to be language of thought. In: Psychosemantics, ed. J.A. Fodor. MIT Press/Bradford Books.

    Google Scholar 

  • Fodor, J.A. and Pylyshyn, Z.W. (1988) Connectionism and cognitive architecture: A critical analysis. Cognition 28: 3–71.

    Article  Google Scholar 

  • Geman, S. and Geman, D. (1964) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6: 721–41.

    Article  Google Scholar 

  • Haugeland, J. (1978) The nature and plausibility of cognitivism. Behavioral and Brain Sciences 1: 215–26.

    Article  Google Scholar 

  • Hebb, D.O. (1949) The organization of behavior. Wiley.

    Google Scholar 

  • Hinton, G.E. and Anderson, J.A. eds. (1961) Parallel models of associative memory. Erlbaum.

    Google Scholar 

  • Hinton, G.E., McClelland, J.L. and Rumelhart, D.E. (1986) Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Hinton, G.E. and Sejnowski, T.J. (1983a) Analyzing cooperative computation. Proceedings of the Fifth Annual Conference of the Cognitive Science Society.

    Google Scholar 

  • Hinton, G.E. and Sejnowski, T.J. (1983b) Optimal perceptual inference. Proceedings of th I.E.E.E. Conference on Computer Vision and Pattern Recognition.

    Google Scholar 

  • Hinton, G.E. and Sejnowski, T.J. (1986) Learning and relearning in Boltzmann machines. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Hofstadter, D.R. (1979), Godel, Escher, Bach: An eternal golden braid. Basic Books.

    Google Scholar 

  • Hofstadter, D.R. (1985a) Variations on a theme as the crux of creativity. In: Metamagical themas. Basic Books.

    Google Scholar 

  • Hofstadter, D.R. (1985b) Waking up from the Boolean dream, or, subcognition as computation. In: Metamagical themas. Basic Books.

    Google Scholar 

  • Hopcroft, J.E. and Ullman, J.D. (1979) Introduction to automata theory, languages, and computation. Addison-Wesley.

    Google Scholar 

  • Jordan, M.I. (1986) Attractor dynamics and parallelism in a connectionist sequential machine. Proceedings of the Eighth Meeting of the Cognitive Science Society.

    Google Scholar 

  • Kant, I. (1787/1963) Critique of pure reason. N. Kemp Smith, trans., 2nd ed. Macmillan.

    Google Scholar 

  • Larkin, J.H., McDermott, J., Simon, D.P. and Simon, H.A. (1980) Models of competence in solving physics problems. Cognitive Science 4: 317–45.

    Article  Google Scholar 

  • Lashley, K. (1950) In search of the engram. In: Psychological mechanisms in animal behavior, Symposia of the Society for Experimental Biology, No. 4, Academic Press.

    Google Scholar 

  • Lewis, C.H. (1978) Production system models of practice effects.

    Google Scholar 

  • McClelland, J.L. and Rumelhart, D.E. (1981) An interactive activation model of context effects in letter perception: Part 1. An account of the basic findings. Psychological Review 88: 375–407.

    Article  Google Scholar 

  • McClelland, J.L., Rumelhart, D.E. and the PDP Research Group (1986) Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 2: Psychological and biological models. MIT Press/Bradford Books.

    Google Scholar 

  • Minsky, M. (1963) Steps toward artificial intelligence. In: Computers and thought, ed. E.A. Feigenbaum and J. Feldman. McGraw-Hill.

    Google Scholar 

  • Minsky, M. (1975) A framework for representing knowledge. In: The psychology of computer vision, ed. P.H. Winston, McGraw-Hill.

    Google Scholar 

  • Minsky, M. and Papert, S. (1969) Perceptrons MIT Press.

    Google Scholar 

  • Newell, A. (1980) Physical symbol systems. Cognitive Science 4: 135–83.

    Article  Google Scholar 

  • Newell, A. and Simon, H.A. (1972) Human problem solving. Prentice Hall.

    Google Scholar 

  • Pearl, J. (1985) Bayesian networks: A model of self-activated memory for evidential reasoning. Proceedings of the Seventh Conference of the Cognitive Science Society.

    Google Scholar 

  • Pylyshyn, Z.W. (1984) Computation and cognition: Toward a foundation for cognitive science. MIT Press/Bradford Books.

    Google Scholar 

  • Riley, M.S. and Smolensky, P. (1984) A parallel model of (sequential) problem solving. Proceedings of the Sixth Annual Conference of the Cognitive Science Society.

    Google Scholar 

  • Rumelhart, D.E. (1975) Notes on a schema for stories. In: Representation and understanding, ed. D.G. Bobrow and A. Collins. Academic Press.

    Google Scholar 

  • Rumelhart, D.E. (1980) Schemata: The building blocks of cognition. In: Theoretical issues in reading comprehension, ed. R. Spiro, B. Bruce and W. Brewer. Erlbaum.

    Google Scholar 

  • Rumelhart, D.E., Hinton, G.E. and Williams, R.J. (1986) Learning and internal representations by error propagation. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Rumelhart, D.E. and McClelland, J.L. (1982) An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some texts and extensions of the model. Psychological Review 89: 60–94.

    Article  Google Scholar 

  • Rumelhart, D.E. and McClelland, J.L. (1986) On learning the past tense of English verbs. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 2: Psychological and biological models, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/ Bradford Books.

    Google Scholar 

  • Rumelhart, D.E., McClelland, J.L. and the PDP Research Group (1986) Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations. MIT Press/Bradford Books.

    Google Scholar 

  • Rumelhart, D.E. Smolensky, P., McClelland, J.L. and Hinton, G.E. (1986) Schemata and sequential thought processes in parallel distributed processing models. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 2: Psychological and biological models, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/ Bradford Books.

    Google Scholar 

  • Sejnowski, T.J. (1976) On the stochastic dynamics of neuronal interactions. Biological Cybernetics 22: 203–11.

    Article  Google Scholar 

  • Sejnowski, T.J. and Rosenberg, C.R. (1986) NETtalk: A parallel network that learns to read aloud. Technical Report JHU/EECS-86/01, Department of ElectricalEngineering and Computer Science, John Hopkins Unversity.

    Google Scholar 

  • Shastri, L. (1985) Evidential reasoning in semantic networks: A formal theory and its parallel implementations. Technical Report TR 166, Department of Computer Science, University of Rochester.

    Google Scholar 

  • Shepard, R.N. (1962) The analysis of proximities: Multidimensional scaling with an unknown distance function. I and II. Psychometrika 27: 125–40, 219–46.

    Google Scholar 

  • Smolensky, P. (1983) Schema selection and stochastic inference in modular environments. Proceedings of the National Conference on Artificial Intelligence.

    Google Scholar 

  • Smolensky, P. (1984a) Harmony theory: Thermal parallel models in a computational context. In: Harmony theory: Problem solving, parallel cognitive models, and thermal physics, ed. P. Smolensky and M.S. Riley. Technical Report 8404, Institute for Cognitive Science, University of California at San Diego.

    Google Scholar 

  • Smolensky, P. (1984b) The mathematical role of self-consistency in parallel computation. Proceedings of the Sixth Annual Conference of the Cognitive Science Society.

    Google Scholar 

  • Smolensky, P. (1986a) Information processing in dynamical systems: Foundations of harmony theory. In: Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Smolensky, P. (1986b) Neural and conceptual interpretations of parallel distributed processing models. In Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 2: Psychological and biological models, ed. J.L. McClelland, D.E. Rumelhart and the PDP Research Group. MIT Press/Bradford Books.

    Google Scholar 

  • Smolensky, P. (1986c) Formal modeling of subsymbolic processes: An introduction to harmony theory. In: Directions in the science of cognition, ed. N.E. Sharkey. Ellis Horwood.

    Google Scholar 

  • Smolensky, P. (1987) On variable binding and the representation of symbolic structures in connectionist systems. Technical Report CU-CS-355-87, Department of Computer Science, University of Colorado at Boulder.

    Google Scholar 

  • Smolensky, P. (1988) The constituent structure of connectionist mental states: A reply to Fodor and Pylyshyn. Southern Journal of Philosophy. Special issue on connectionism and the foundations of cognitive science.

    Google Scholar 

  • Toulouse, G., Dehaene, S. and Changeux, J.-P. (1986) A spin glass model of learning by selection. Technical Report, Unite de Neurobiologie Moleculaire, Institut Pasteur, Paris.

    Google Scholar 

  • Touretzky, D.S. (1986) BolzCONS: Reconciling connectionism with the recursive nature of stacks and trees. Proceedings of the Eighth Conference of the Cognitive Science Society.

    Google Scholar 

  • Touretzky, D.S. and Hinton, G.E. (1985) Symbols among the neurons: Details of a connectionist inference architecture. Proceedings of the International Joint Conference on Artificial Intelligence.

    Google Scholar 

  • Turing, A. (1936) On computable numbers, with an application to Entscheidungs problem. Proceedings of the London Mathematical Society (Ser. 2) 42:230–65 and 43: 544–46.

    Google Scholar 

  • Waldrop, M.M. (1984) Artificial intelligence in parallel. Science 225: 608–10.

    Article  Google Scholar 

  • Waltz, D.L. (1978) An English language question answering system for a large relational database. Communications of the Association for Computing Machinery 21: 526–39.

    Article  Google Scholar 

  • Waltz, D.L. and Pollack, J.B. (1985) Massively parallel parsing: A strongly interactive model of natural language interpretation. Cognitive Science 9: 51–74.

    Article  Google Scholar 

Download references

Authors
  1. Paul Smolensky
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Philosophy, University of Minnesota, Duluth, USA

    David J. Cole

  2. Department of Philosophy, University of Minnesota, Duluth, USA

    James H. Fetzer

  3. IBM AI Support Center, Palo Alto, California, USA

    Terry L. Rankin

Rights and permissions

Reprints and permissions

Copyright information

© 1990 Kluwer Academic Publishers

About this chapter

Cite this chapter

Smolensky, P. (1990). On the Proper Treatment of Connectionism. In: Cole, D.J., Fetzer, J.H., Rankin, T.L. (eds) Philosophy, Mind, and Cognitive Inquiry. Studies in Cognitive Systems, vol 3. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-1882-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-1882-5_6

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-7340-0

  • Online ISBN: 978-94-009-1882-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation