Abstract
The primary purpose of this article is to reply to the central point of (1988) critique of connectionism. The direct reply to their critique comprises Section 2 of this paper. In short, I argue that Fodor and Pylyshyn are simply mistaken in their claim that connectionist mental states lack the necessary constituent structure, and that the basis of this mistake is a failure to appreciate the significance of distributed representations in connectionist models. Section 3 is a broader response to the bottom line of their critique, which is that connectionists should re-orient their work towards implementation of the classical symbolic cognitive architecture. I argue instead that connectionist research should develop new formalizations of the fundamental computational notions that have been given one particular formal shape in the traditional symbolic paradigm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ackley, D. H., Hinton, G. E., and Sejnowski, T. J.: 1985, ‘A Learning Algorithm for Boltzmann Machines’, Cognitive Science 9, 147–169.
Ballard, D. and Hayes, P. J.: 1984, — 8;Parallel Logical Inference’, Proceedings of the Sixth Annual Conference of the Cognitive Science Society, Rochester, NY, June.
Barto, A. G, Sutton, R. S., and Anderson, C. W.: 1983, ‘Neuronlike Elements That Can Solve Difficult Learning Control Problems’, IEEE Transactions on Systems, Man, and Cybernetics SMC-13, 834–846.
Bever, T. G., Carrithers, C., and Townsend, D. J.: 1987, ‘A Tale of Two Brains: The Sinistral Quasimodularity of Language’, Proceedings of the Ninth Annual Conference of the Cognitive Science Society, Seattle, WA, July, 764–773.
Chomsky, N.: 1965, Aspects of the Theory of Syntax, MIT Press, Cambridge, MA.
Cohen, M. A. and Grossberg, S.: 1983, ‘Absolute Stability of Global Pattern Formation and Parallel Memory Storage by Competitive Neural Networks’, IEEE Transactions on Systems, Man, and Cybernetics SMC-13, 815–826.
Dreyfus, S. E. and Dreyfus, H. L.: 1986, Mind Over Machine: The Power of Human Intuition and Expertise in the Era of the Computer, Free Press, New York.
Fodor, J. A. and Pylyshyn, Z. W.: 1988, ‘Connectionism and Cognitive Architecture: A Critical Analysis’, Cognition 28, 2–71.
Feldman, J. A. and Ballard, D. H.: 1982, ‘Connectionist Models and Their Properties’, Cognitive Science 6, 205–254.
Geman, S. and Geman, D.: 1984, ‘Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images’, IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721–741.
Gerken, L. and Bever, T. G.: 1986, ‘Linguistic Intuitions are the Result of Interactions between Perceptual Processes and Linguistic Universals’, Cognitive Science 10, 457–476.
Golden, R.: 1988, ‘A Unified Framework for Connectionist Systems’, Biological Cybernetics, in press.
Greeno, J. G.: 1987, ‘The Cognition Connection’, The New York Times, Jan. 4, p. 28.
Grossberg, S.: 1987, ‘Competitive Learning: From Interactive Activation to Adaptive Resonance’, Cognitive Science 11, 23–63.
Gupta, M., Ragade, R., and Yager, R. (eds.): 1979, Advances in Fuzzy Set Theory and Applications, North-Holland, Amsterdam.
Hinton, G. E.: 1987, ‘Learning Distributed Representations of Concepts’, Proceedings of the Eighth Annual Meeting of the Cognitive Science Society, 1–12.
Hinton, G. E., McClelland, J. L. and Rumelhart, D. E.: 1986, ‘Distributed Representations’, in J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.
Hinton, G. E. and Sejnowski, T. J.: 1983a, ‘Analyzing Cooperative Computation’, Proceedings of the Fifth Annual Conference of the Cognitive Science Society, Rochester, NY.
Hopfield, J. J.: 1982, ‘Neural Networks and Physical Systems with Emergent Collective Computational Abilities’, Proceedings of the National Academy of Sciences, USA 79, 2554–2558.
McClelland, J. L., Rumelhart, D. E., and the PDP Research Group: 1986, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.
Rosenberg, C. R.: 1987, ‘Revealing the Structure of NETtalk’s Internal Representations,’ Proceedings of the Ninth Annual Meeting of the Cognitive Science Society, Seattle, WA, July, 537–554.
Rumelhart, D. E., Hinton, G. E., and Williams, R. J.: 1986, ‘Learning Internal Representations by Error Propogation’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Rumelhart, D. E., Hinton, G. E., and McClelland, J. L.: 1986, ‘A General Framework for Parallel Distributed Processing’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Rumelhart, D. E., McClelland, J. L., and the PDP Research Group: 1986, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Rumelhart, D. E. and Zipser, D.: 1986, ‘Feature Discovery by Competitive Learning’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Shastri, L. and Feldman, J. A.: 1985, ‘Evidential Reasoning in Semantic Networks: A Formal Theory’, Proceedings of the International Joint Conference on Artificial Intelligence, Los Angeles, CA.
Shortliffe, E. H.: 1976, Computer-based Medical Consultations: MYCIN, American Elsevier, New York.
Smolensky, P.: 1983, ‘Schema Selection and Stochastic Inference in Modular Environments’, Proceedings of the National Conference on Artificial Intelligence, Washington, D. C.
Smolensky, P.: 1986a, ‘Information Processing in Dynamical Systems: Foundations of Harmony Theory’, in D. E. Rumelhart, J. L. McClelland and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Smolensky, P.: 1986b, ‘Neural and Conceptual Interpretations of Parallel Distributed Processing Models’, in J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 2: Psychological and Biological Models, MIT Press/Bradford Books, Cambridge, MA.
Smolensky, P.: 1987, ‘On Variable Binding and the Representation of Symbolic Structures in Connectionist Systems’, Technical Report CU-CS-355-87, Department of Computer Science, University of Colorado at Boulder, February. (Revised version to appear in Artificial Intelligence).
Smolensky, P.: 1988a, ‘On the Proper Treatment of Connectionism’, The Behavioral and Brain Sciences 11(1), in press.
Smolensky, P.: 1988b, ‘Putting Together Connectionism-Again’, The Behavioral and Brain Sciences 11(1), in press.
Smolensky, P.: (forthcoming), Lectures on Connectionist Cognitive Modeling, Lawrence Erlbaum, Hillsdale, N. J.
Stone, G. O.: 1986, ‘An Analysis of the Delta Rule and Learning Statistical Associations’, in D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press/Bradford Books, Cambridge, MA.
Sutton, R. S.: 1987, ‘Learning to Predict by the Methods of Temporal Differences’, Technical Report 87-509.1, GTE Laboratories, Waltham, MA.
Zadeh, L. A.: 1965, ‘Fuzzy Sets’, Information and Control 8, 338–353.
Zadeh, L. A.: 1975, ‘Fuzzy Logic and Approximate Reasoning’, Synthese 30, 407–428.
Zadeh, L. A.: 1983, ‘Role of Fuzzy Logic in the Management of Uncertainty in Expert Systems’, Fuzzy Sets and Systems 11, 199–227.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Smolensky, P. (1991). The Constituent Structure of Connectionist Mental States: A Reply to Fodor and Pylyshyn. In: Horgan, T., Tienson, J. (eds) Connectionism and the Philosophy of Mind. Studies in Cognitive Systems, vol 9. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3524-5_13
Download citation
DOI: https://doi.org/10.1007/978-94-011-3524-5_13
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-5559-8
Online ISBN: 978-94-011-3524-5
eBook Packages: Springer Book Archive