Skip to main content

The Constituent Structure of Connectionist Mental States: A Reply to Fodor and Pylyshyn

  • Chapter

Part of the book series: Studies in Cognitive Systems ((COGS,volume 9))

Abstract

The primary purpose of this article is to reply to the central point of (1988) critique of connectionism. The direct reply to their critique comprises Section 2 of this paper. In short, I argue that Fodor and Pylyshyn are simply mistaken in their claim that connectionist mental states lack the necessary constituent structure, and that the basis of this mistake is a failure to appreciate the significance of distributed representations in connectionist models. Section 3 is a broader response to the bottom line of their critique, which is that connectionists should re-orient their work towards implementation of the classical symbolic cognitive architecture. I argue instead that connectionist research should develop new formalizations of the fundamental computational notions that have been given one particular formal shape in the traditional symbolic paradigm.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ackley, D. H., Hinton, G. E., and Sejnowski, T. J.: 1985, ‘A Learning Algorithm for Boltzmann Machines’, Cognitive Science 9, 147–169.

    Article  Google Scholar 

  • Ballard, D. and Hayes, P. J.: 1984, — 8;Parallel Logical Inference’, Proceedings of the Sixth Annual Conference of the Cognitive Science Society, Rochester, NY, June.

    Google Scholar 

  • Barto, A. G, Sutton, R. S., and Anderson, C. W.: 1983, ‘Neuronlike Elements That Can Solve Difficult Learning Control Problems’, IEEE Transactions on Systems, Man, and Cybernetics SMC-13, 834–846.

    Article  Google Scholar 

  • Bever, T. G., Carrithers, C., and Townsend, D. J.: 1987, ‘A Tale of Two Brains: The Sinistral Quasimodularity of Language’, Proceedings of the Ninth Annual Conference of the Cognitive Science Society, Seattle, WA, July, 764–773.

    Google Scholar 

  • Chomsky, N.: 1965, Aspects of the Theory of Syntax, MIT Press, Cambridge, MA.

    Google Scholar 

  • Cohen, M. A. and Grossberg, S.: 1983, ‘Absolute Stability of Global Pattern Formation and Parallel Memory Storage by Competitive Neural Networks’, IEEE Transactions on Systems, Man, and Cybernetics SMC-13, 815–826.

    Article  Google Scholar 

  • Dreyfus, S. E. and Dreyfus, H. L.: 1986, Mind Over Machine: The Power of Human Intuition and Expertise in the Era of the Computer, Free Press, New York.

    Google Scholar 

  • Fodor, J. A. and Pylyshyn, Z. W.: 1988, ‘Connectionism and Cognitive Architecture: A Critical Analysis’, Cognition 28, 2–71.

    Article  Google Scholar 

  • Feldman, J. A. and Ballard, D. H.: 1982, ‘Connectionist Models and Their Properties’, Cognitive Science 6, 205–254.

    Article  Google Scholar 

  • Geman, S. and Geman, D.: 1984, ‘Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images’, IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721–741.

    Article  Google Scholar 

  • Gerken, L. and Bever, T. G.: 1986, ‘Linguistic Intuitions are the Result of Interactions between Perceptual Processes and Linguistic Universals’, Cognitive Science 10, 457–476.

    Article  Google Scholar 

  • Golden, R.: 1988, ‘A Unified Framework for Connectionist Systems’, Biological Cybernetics, in press.

    Google Scholar 

  • Greeno, J. G.: 1987, ‘The Cognition Connection’, The New York Times, Jan. 4, p. 28.

    Google Scholar 

  • Grossberg, S.: 1987, ‘Competitive Learning: From Interactive Activation to Adaptive Resonance’, Cognitive Science 11, 23–63.

    Article  Google Scholar 

  • Gupta, M., Ragade, R., and Yager, R. (eds.): 1979, Advances in Fuzzy Set Theory and Applications, North-Holland, Amsterdam.

    Google Scholar 

  • Hinton, G. E.: 1987, ‘Learning Distributed Representations of Concepts’, Proceedings of the Eighth Annual Meeting of the Cognitive Science Society, 1–12.

    Google Scholar 

  • Hinton, G. E., McClelland, J. L. and Rumelhart, D. E.: 1986, ‘Distributed Representations’, in J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Hinton, G. E. and Sejnowski, T. J.: 1983a, ‘Analyzing Cooperative Computation’, Proceedings of the Fifth Annual Conference of the Cognitive Science Society, Rochester, NY.

    Google Scholar 

  • Hopfield, J. J.: 1982, ‘Neural Networks and Physical Systems with Emergent Collective Computational Abilities’, Proceedings of the National Academy of Sciences, USA 79, 2554–2558.

    Google Scholar 

  • McClelland, J. L., Rumelhart, D. E., and the PDP Research Group: 1986, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Rosenberg, C. R.: 1987, ‘Revealing the Structure of NETtalk’s Internal Representations,’ Proceedings of the Ninth Annual Meeting of the Cognitive Science Society, Seattle, WA, July, 537–554.

    Google Scholar 

  • Rumelhart, D. E., Hinton, G. E., and Williams, R. J.: 1986, ‘Learning Internal Representations by Error Propogation’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Rumelhart, D. E., Hinton, G. E., and McClelland, J. L.: 1986, ‘A General Framework for Parallel Distributed Processing’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Rumelhart, D. E., McClelland, J. L., and the PDP Research Group: 1986, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Rumelhart, D. E. and Zipser, D.: 1986, ‘Feature Discovery by Competitive Learning’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Shastri, L. and Feldman, J. A.: 1985, ‘Evidential Reasoning in Semantic Networks: A Formal Theory’, Proceedings of the International Joint Conference on Artificial Intelligence, Los Angeles, CA.

    Google Scholar 

  • Shortliffe, E. H.: 1976, Computer-based Medical Consultations: MYCIN, American Elsevier, New York.

    Google Scholar 

  • Smolensky, P.: 1983, ‘Schema Selection and Stochastic Inference in Modular Environments’, Proceedings of the National Conference on Artificial Intelligence, Washington, D. C.

    Google Scholar 

  • Smolensky, P.: 1986a, ‘Information Processing in Dynamical Systems: Foundations of Harmony Theory’, in D. E. Rumelhart, J. L. McClelland and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Smolensky, P.: 1986b, ‘Neural and Conceptual Interpretations of Parallel Distributed Processing Models’, in J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Smolensky, P.: 1987, ‘On Variable Binding and the Representation of Symbolic Structures in Connectionist Systems’, Technical Report CU-CS-355-87, Department of Computer Science, University of Colorado at Boulder, February. (Revised version to appear in Artificial Intelligence).

    Google Scholar 

  • Smolensky, P.: 1988a, ‘On the Proper Treatment of Connectionism’, The Behavioral and Brain Sciences 11(1), in press.

    Google Scholar 

  • Smolensky, P.: 1988b, ‘Putting Together Connectionism-Again’, The Behavioral and Brain Sciences 11(1), in press.

    Google Scholar 

  • Smolensky, P.: (forthcoming), Lectures on Connectionist Cognitive Modeling, Lawrence Erlbaum, Hillsdale, N. J.

    Google Scholar 

  • Stone, G. O.: 1986, ‘An Analysis of the Delta Rule and Learning Statistical Associations’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.

    Google Scholar 

  • Sutton, R. S.: 1987, ‘Learning to Predict by the Methods of Temporal Differences’, Technical Report 87-509.1, GTE Laboratories, Waltham, MA.

    Google Scholar 

  • Zadeh, L. A.: 1965, ‘Fuzzy Sets’, Information and Control 8, 338–353.

    Article  Google Scholar 

  • Zadeh, L. A.: 1975, ‘Fuzzy Logic and Approximate Reasoning’, Synthese 30, 407–428.

    Article  Google Scholar 

  • Zadeh, L. A.: 1983, ‘Role of Fuzzy Logic in the Management of Uncertainty in Expert Systems’, Fuzzy Sets and Systems 11, 199–227.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Smolensky, P. (1991). The Constituent Structure of Connectionist Mental States: A Reply to Fodor and Pylyshyn. In: Horgan, T., Tienson, J. (eds) Connectionism and the Philosophy of Mind. Studies in Cognitive Systems, vol 9. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3524-5_13

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-3524-5_13

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5559-8

  • Online ISBN: 978-94-011-3524-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics