Modeling by Non-Parametric Regression

  • Igor Grabec
  • Wolfgang Sachse
Part of the Springer Series in Synergetics book series (SSSYN, volume 68)


In the previous chapter on the adaptive modeling of natural laws it was stated that tasks associated with such modeling included the estimation and storage of the probability distribution, as well as the development of a method for its effective application. The fundamental problem related to the application of a natural law is the formulation of a method by which some unknown property of Nature can be predicted on the basis of information obtained by partial observation and a known natural law. If a natural law which is expressed as a functional relationship between various physical variables is to be applied, the task is to find the values of some variables from the given values of others by arithmetic procedures. If a natural law is represented by a model contained in a certain physical system then this task corresponds to the projection of a set of inputs into a set of outputs. However, this concept must be generalized when a natural law is represented by a probability density. To do this, we use some of the fundamental concepts of prediction theory which will be briefly reviewed in the next part of this section. The main goal of this chapter is to demonstrate the solution of several problems related with an optimal application of empirical information, stored as a set of representative points in a discrete memory of a modeler.


Acoustic Emission Reinforced Concrete Iteration Process Acoustic Emission Signal Vector Quantizer 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    W. B. Davenport, JR.: Probability and Random Processes, An Introduction for Applied Scientists and Engineers ( McGraw-Hill, New York 1970 )zbMATHGoogle Scholar
  2. 2.
    R. O. Duda, P. E. Hart: Pattern Classifìcation and Scene Analysis ( John Wiley & Sons, New York 1973 )zbMATHGoogle Scholar
  3. 3.
    I. Grabec, W. Sachse: “Experimental Characterization of Ultrasonic Phenomena by a Learning System”, J. Appi. Phys., 66, 3993–4000 (1989)ADSCrossRefGoogle Scholar
  4. 4.
    I. Grabec, W. Sachse: “Application of an Intelligent Signal Processing System to AE Analysis”, J. Acoust. Soc. Am., 85, 1226–1235 (1989)ADSCrossRefGoogle Scholar
  5. 5.
    I. Grabec, W. Sachse: “Automatic Modeling of Physical Phenomena: Application to Ultrasonic Data”, J. Appl. Phys., 69, (9), 6233–6244 (1991)ADSCrossRefGoogle Scholar
  6. 6.
    I. Grabec, W. Sachse: “Automatic Modeling of Ultrasonic Phenomena”, Conf. Proc. Ultrasonics International’91, La Touquet, France, 1991 ( Butterworth, London 1991 ), pp. 633–636Google Scholar
  7. 7.
    I. Grabec: “Automatic Modeling of Acoustic Emission Phenomena by Neural Networks”, in Dynamic, Genetic and Chaotic Programming, The Sixth Generation, ed. by B. Soucek and IRIS Group ( John Wiley & Sons, New York 1992 ), pp. 144–163Google Scholar
  8. 8.
    I. Grabec: “Prediction of Chaotic Dynamical Phenomena by a Neural Network”, in Dynamic, Genetic and Chaotic Programming, The Sixth Generation, ed. by B. Soucek and IRIS Group ( John Wiley & Sons, New York 1992 ), pp. 470–500Google Scholar
  9. 9.
    I. Grabec: “Self-Organization of Neurons Described by the Maximum-Entropy Principle”, Biol. Cyb., 63, 403–409 (1990)zbMATHCrossRefGoogle Scholar
  10. 10.
    I. Grabec: “Modeling of Chaos by a Self-Organizing Neural Network, Artificial Neural Networks”, Proc. ICANN, Espoo, Finland, ed. by T. Kohonen, K. Mäkisara, O. Simula, J. Kangas (Elsevier Science Publishers B. V., North- Holland 1991), Vol. 1, pp. 151–156Google Scholar
  11. 11.
    I. Grabec, D. Grošelj: “Prognosis of Periodontal Disease Healing Process”, Proc. CADAM-95 Workshop, Bled, Slovenia, 1995, ed. by N. Lavrac (IJS Sci. Pub., IJS-SP-95-1), pp. 146–154Google Scholar
  12. 12.
    D. Grošelj: Evaluation of Periodontal Tissue Therapy Using Tooth Mobility Measurements, PhD Disertation (Medical Faculty, Department of Dentistry, University of Ljubljana 1990 )Google Scholar
  13. 13.
    D. Grošelj, I. Grabec: “Modeling of a Periodontal Disease Healing Process”, Abstracts Booklet of 32 nd Annual Meeting CED/IADR, Ljubljana, Slovenia, 1995, ( Continental European Division/International Association for Dental Research ), Rep. No. 082Google Scholar
  14. 14.
    H. Haken: Synergetics, An Introduction, Springer Series in Synergetics, Vol. 1 (Springer, Berlin 1983 ), p. 181Google Scholar
  15. 15.
    H. Haken: Synergetic Computers and Cognition, A Top-Down Approach to Neural Nets, Springer Series in Synergetics, Vol. 50 (Springer, Berlin 1991), Ch. 13Google Scholar
  16. 16.
    J. J. Hopfield: “Neural Networks and Physical Systems with Emergent Collective Computational Abilities”, Proc. Natl. Acad. Sci. USA, 79, 2554–2558 (1982)MathSciNetADSCrossRefGoogle Scholar
  17. 17.
    J. J. Hopfield: “Neurons with Graded Response have Collective Computational Properties like those of Two State Neurons”, Proc. Natl. Acad. Sci. USA, 81, 3088–3092 (1984)ADSCrossRefGoogle Scholar
  18. 18.
    T. Kohonen: Self-Organization and Associative Memory ( Springer, Berlin 1989 )Google Scholar
  19. 19.
    I. D. Lefas, M. D. Kotsovos, N. N. Ambraseys: “Behavior of Reinforced Concrete Structural Wals: Strength, Deformation Characteristics, and Failure Mechanism”, ACI Structural Journal, 87, 23–31 (1990)Google Scholar
  20. 20.
    Nondestructive Testing Handbook, ed. by R. K. Miller, P. Mclntire (American Society for Nondestructive Testing, Columbus, OH 1987), Vol. 5Google Scholar
  21. 21.
    G. Nicolis, I. Prigogine: Self-Organization in Nonequilibrium Systems, From Dissipative Structure to Order through Fluctuations ( John Wiley & Sons, New York 1977 )Google Scholar
  22. 22.
    Y. H. Pao, W. Sachse: J. Acoust. Soc. Am., 56, 1478 (1974)ADSCrossRefGoogle Scholar
  23. 23.
    I. Peruš, P. Fajfar, I. Grabec: “Prediction of the Seismic Capacity of RC Structural Walls by a Neural Network”, the article in print at ACI Structural JournalGoogle Scholar
  24. 24.
    W. Sachse, S. Golan: in Elastic Waves and Non-Destructive Testing of Materials, ed. by Y. H. Pao (ASME, New York, 1978), AMD Vol. 29, pp. 11–31Google Scholar
  25. 25.
    D. E. Rumelhart, J. McClelland, and The PDP Research Group: Parallel Distributed Processing ( MIT Press, Cambridge, MA 1986 )Google Scholar
  26. 26.
    H. Schiøler, U. Hartmann: “Mapping Neural Network Derived from the Parzen Window Estimator”, Neural Networks, 5, 903–909 (1992)CrossRefGoogle Scholar
  27. 27.
    D. F. Specht: “Probabilistic Neural Networks”, Neural Networks, 3, 109–118 (1990)CrossRefGoogle Scholar
  28. 28.
    D. F. Specht: “A General Regression Neural Network”, IEEE Trans, on Neural Networks, 2, No. 6, 568, (1991)CrossRefGoogle Scholar
  29. 29.
    A. Tarantola: Inverse Problem Theory, Methods for Data Fitting and Model Parameter Estimation ( Elsevier, Amsterdam 1987 )zbMATHGoogle Scholar
  30. 30.
    S. L. Wood: “Shear Strength of Low-rise Reinforced Concrete Walls”, ACI Structural Journal, 87, 99–107 (1990)Google Scholar
  31. 31.
    S. L. Wood: “Observed Behavoir of Slender Reinforced Concrete Walls Subjected to Cyclic Loading”, in Earthquake-resistant Concrete Structures, Inelastic Response and Design, ed. by S. K. Ghosh, ACI SP 127–11, 453–477 (1991)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Igor Grabec
    • 1
  • Wolfgang Sachse
    • 2
  1. 1.Faculty of Mechanical EngineeringUniversity of LjubljanaLjubljanaSlovenia
  2. 2.Theoretical and Applied MechanicsCornell UniversityIthacaUSA

Personalised recommendations