Neural Networks, Fuzzy Models and Dynamic Logic

  • Leonid I. Perlovsky
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 209)


The paper discusses possible relationships between computational intelligence, known mechanisms of the mind, semiotics, and computational linguistics. Mathematical mechanisms of concepts, emotions, and goals are described as a part of information processing in the mind and are related to language and thought processes in which an event (signals from surrounding world, text corpus, or inside the mind) is understood as a concept. Previous attempts in artificial intelligence at describing thought processes are briefly reviewed and their fundamental (mathematical) limitations are analyzed. The role of emotional signals in overcoming these past limitations is emphasized. The paper describes mathematical mechanisms of concepts applicable to sensory signals and linguistics; they are based on measures of similarities between models and signals. Linguistic similarities are discussed that can utilize various structures and rules proposed in computational linguistic literature. A hierarchical structure of the proposed method is capable of learning and recognizing concepts from textual data, from the level of words and up to sentences, groups of sentences, and towards large bodies of text. I briefly discuss a role of concepts as a mechanism unifying thinking and language and their possible role in language acquisition. A thought process is related to semiotic notions of signs and symbols. It is further related to understanding, imagination, intuition, and other processes in the mind. The paper briefly discusses relationships between the mind and brain and applications to understanding-based search engines.


Input Signal Similarity Measure Fuzzy Model Dynamic Logic Linguistic Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Aristotle. Metaphysics. In J. Barnes, editor, Complete Works of Aristotle. Princeton University Press, Princeton, NJ, 1995.Google Scholar
  2. [2]
    R. E. Bellman. Adaptive Control Processes. Princeton University Press, Princeton, NJ, 1961.zbMATHGoogle Scholar
  3. [3]
    G. A. Carpenter and S. Grossberg. A Massively Parallel Architecture for a Self-organizing Neural Pattern Recognition Machine. Computer Vision, Graphics and Image Processing, 37:54–115, 1987.CrossRefGoogle Scholar
  4. [4]
    N. Chomsky. Language and Mind. Harcourt Brace Javanovich, New York, 1972.Google Scholar
  5. [5]
    N. Chomsky. Principles and Parameters in Syntactic Theory. In N. Hornstein and D. Lightfoot, editors, Explanation in Linguistics. The Logical Problem of Language Acquisition. Longman, London, 1981.Google Scholar
  6. [6]
    A. R. Damasio. Descartes' Error: Emotion, Reason, and the Human Brain. Avon, New York, 1995.Google Scholar
  7. [7]
    T. W. Deacon. The Symbolic Species: The Co-Evolution of Language and the Brain. W. W. Norton & Company, 1998.Google Scholar
  8. [8]
    V. A. Dmitriev and L. I. Perlovsky. Art Form as an Object of Cognitive Modeling (Towards Development of Vygotsky's Semiotics Model). In Proceedings of the 1996 Conference on Intelligent Systems and Semiotics, volume 2, pages 385–389, Gaithersburg, 1996.Google Scholar
  9. [9]
    W. J. Freeman. Mass Action in the Nervous System. Academic Press, New York, 1975.Google Scholar
  10. [10]
    S. Grossberg. Neural Networks and Natural Intelligence. MIT Press, Cambridge, MA, 1988.Google Scholar
  11. [11]
    S. Grossberg. Linking Mind to Brain: The Mathematics of Biological Intelligence. Notices of the American Mathematical Society, 47:1361–1372, 2000.zbMATHMathSciNetGoogle Scholar
  12. [12]
    S. Grossberg and D. S. Levine. Neural Dynamics of Attentionally Modulated Pavlovian Conditioning: Blocking, Inter-stimulus Interval, and Secondary Reinforcement. Psychobiology, 15(3):195–240, 1987.Google Scholar
  13. [13]
    S. Grossberg and N. A. Schmajuk. Neural Dynamics of Attentionally Modulated Pavlovian Conditioning: Conditioned Reinforcement, Inhibition, and Opponent Processing. Psychobiology, 15(3):195–240, 1987.Google Scholar
  14. [14]
    S. R. Hamero. Toward a Scientific Basis for Consciousness. MIT Press, Cambridge, MA, 1994.Google Scholar
  15. [15]
    D. Hebb. Organization of Behavior. J. Wiley & Sons, New York, 1949.Google Scholar
  16. [16]
    R. Jackendo. Foundations of Language: Brain, Meaning, Grammar, Evolution. Oxford University Press, New York, 2002.Google Scholar
  17. [17]
    J.-S. R. Jang, C.-T. Sun, and E. Mizutani. Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, Upper Saddle River, 1996.Google Scholar
  18. [18]
    B. D. Josephson. An Integrated Theory of Nervous System Functioning Embracing Nativism and Constructivism. In International Complex Systems Conference, Nashua, NH, September 21–26 1997.Google Scholar
  19. [19]
    C. G. Jung. Archetypes of the Collective Unconscious. In The Collected Works, volume 9.II of Bollingen Series XX, 1969. Princeton University Press, Princeton, NJ, 1934.Google Scholar
  20. [20]
    I. Kant. Critique of Judgment. Macmillan & Co., London, 2nd edition, 1914.Google Scholar
  21. [21]
    I. Kant. Critique of Pure Reason. Wiley Book, New York, 1943.Google Scholar
  22. [22]
    I. Kant. Critique of Practical Reason. Hafner, 1986.Google Scholar
  23. [23]
    C. Koch and I. Segev, editors. Methods in Neuronal Modeling: From Ions to Networks. MIT Press, Cambridge, MA, 1998.Google Scholar
  24. [24]
    A. Mehler. A Multiresolutional Approach to Fuzzy Text Meaning. A First Attempt. In A. Meystel, editor, Proceedings of the 1996 International Multidisciplinary Conference on Intelligent Systems: A Semiotic Perspective, volume I, pages 261–273, Gaithersburg, 1996. National Institute of Standards and Technology.Google Scholar
  25. [25]
    A. Mehler. Components of a Model of Context-Sensitive Hypertexts. Journal of Universal Computer Science, 8(10):924–943, 2002.Google Scholar
  26. [26]
    A. Mehler. Hierarchical Orderings of Textual Units. In Proceedings of the 19th International Conference on Computational Linguistics, COLING' 02, Taipei, pages 646–652, San Francisco, 2002. Morgan Kaufmann.Google Scholar
  27. [27]
    A. Meystel. Semiotic Modeling and Situational Analysis. AdRem, Bala Cynwyd, PA, 1995.Google Scholar
  28. [28]
    A. M. Meystel and J. S. Albus. Intelligent Systems: Architecture, Design, and Control. Wiley, New York, 2001.Google Scholar
  29. [29]
    M. Minsky. The Society of Mind. MIT Press, Cambridge, MA, 1988.Google Scholar
  30. [30]
    C. Morris. Writings on the General Theory of Signs. Mouton, The Hague, 1971.Google Scholar
  31. [31]
    A. Newell. Intellectual Issues in the History of Artificial Intelligence. In F. Machlup and U. Mansfield, editors, The Study of Information. J. Wiley, New York, 1983.Google Scholar
  32. [32]
    C. S. Peirce. Collected Papers of Charles Sanders Peirce. Harvard University Press, Cambridge, MA, 1935–66.Google Scholar
  33. [33]
    R. Penrose. Shadows of the Mind. Oxford University Press, Oxford, 1994.Google Scholar
  34. [34]
    L. I. Perlovsky. Gödel Theorem and Semiotics. In Proceedings of the 1996 Conference on Intelligent Systems and Semiotics, volume 2, pages 14–18, Gaithersburg, 1996.Google Scholar
  35. [35]
    L. I. Perlovsky. Mathematical Concepts of Intellect. In Proceedings of the World Congress on Neural Networks, pages 1013–1016, San Diego, 1996. Lawrence Erlbaum Associates.Google Scholar
  36. [36]
    L. I. Perlovsky. Towards Quantum Field Theory of Symbol. In Proceedings of the 1997 Conference on Intelligent Systems and Semiotics, pages 295–300, Gaithersburg, 1997.Google Scholar
  37. [37]
    L. I. Perlovsky. Conundrum of Combinatorial Complexity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(6):666–670, 1998.CrossRefGoogle Scholar
  38. [38]
    L. I. Perlovsky. Cyberaesthetics: Aesthetics, learning, and control. In STIS'98, Gaithersburg, 1998.Google Scholar
  39. [39]
    L. I. Perlovsky. Emotions, Learning, and Control. In Proceedings of the International Symposium on Intelligent Control, Intelligent Systems & Semiotics, pages 131–137, Cambridge, MA, 1999.Google Scholar
  40. [40]
    L. I. Perlovsky. Neural Networks and Intellect: Using Model-based Concepts. Oxford University Press, New York, 2001.Google Scholar
  41. [41]
    J. Piaget. The Psychology of the Child. Basic Books, 2000.Google Scholar
  42. [42]
    J. P. e. Pickett, editor. The American Heritage College Dictionary. Houghton Mifiin, Boston, MA, 3rd edition, 2000.Google Scholar
  43. [43]
    S. Pinker. The Language Instinct: How the Mind Creates Language. Harper Perennial, 2000.Google Scholar
  44. [44]
    S. Pinker. Words and Rules: The Ingredients of Language. Harper Perennial, 2000.Google Scholar
  45. [45]
    K. Pribram. Languages of the Brain. Prentice Hall, 1971.Google Scholar
  46. [46]
    B. B. Rieger. Empirical Semantics II. A Collection of New Approaches in the Field. In Quantitative Linguistics, volume 13. Brockmeyer, Bochum, 1981.Google Scholar
  47. [47]
    B. B. Rieger. Situation Semantics and Computational Linguistics: Towards Informational Ecology. In K. Kornwachs and K. Jacoby, editors, Information. New Questions to a Multidisciplinary Concept, pages 285–315. Akademie-Verlag, Berlin, 1995.Google Scholar
  48. [48]
    B. B. Rieger. Tree-like Dispositional Dependency Structures for Nonpropositional Semantic Inferencing: A SCIP Approach to Natural Language Understanding by Machine. In B. Bouchon-Meunier and R. Yager, editors, Proceedings of the 7th International Conference on Information Processing and Management of Uncertainty in Knowledge-based Systems (IPMU-198), pages 351–358, Paris, 1998.Google Scholar
  49. [49]
    T. A. Sebeok. Sign: An Introduction to Semiotics. University of Toronto Press, Toronto, 1995.Google Scholar
  50. [50]
    R. S. Westfall. Never at Rest: A Biography of Isaac Newton. Cambridge University Press, Cambridge, 1983.zbMATHGoogle Scholar
  51. [51]
    L. A. Zadeh. Information Granulation and its Centrality in Human and Machine Intelligence. In Proceedings of the 1997 Conference on Intelligent Systems and Semiotics, pages 26–30, Gaithersburg, 1997.Google Scholar
  52. [52]
    S. Zeki. A Vision of the Brain. Blackwell, Oxford, 1993.Google Scholar

Copyright information

© Springer 2007

Authors and Affiliations

  • Leonid I. Perlovsky
    • 1
  1. 1.Air Force Research LabUSA

Personalised recommendations