# Modeling by Non-Parametric Regression

## Abstract

In the previous chapter on the adaptive modeling of natural laws it was stated that tasks associated with such modeling included the estimation and storage of the probability distribution, as well as the development of a method for its effective application. The fundamental problem related to the application of a natural law is the formulation of a method by which some unknown property of Nature can be predicted on the basis of information obtained by partial observation and a known natural law. If a natural law which is expressed as a functional relationship between various physical variables is to be applied, the task is to find the values of some variables from the given values of others by arithmetic procedures. If a natural law is represented by a model contained in a certain physical system then this task corresponds to the projection of a set of inputs into a set of outputs. However, this concept must be generalized when a natural law is represented by a probability density. To do this, we use some of the fundamental concepts of prediction theory which will be briefly reviewed in the next part of this section. The main goal of this chapter is to demonstrate the solution of several problems related with an optimal application of empirical information, stored as a set of representative points in a discrete memory of a modeler.

## Keywords

Acoustic Emission Reinforced Concrete Iteration Process Acoustic Emission Signal Vector Quantizer## Preview

Unable to display preview. Download preview PDF.

## References

- 1.W. B. Davenport, JR.:
*Probability and Random Processes, An Introduction for Applied Scientists and Engineers*( McGraw-Hill, New York 1970 )zbMATHGoogle Scholar - 2.R. O. Duda, P. E. Hart:
*Pattern Classifìcation and Scene Analysis*( John Wiley & Sons, New York 1973 )zbMATHGoogle Scholar - 3.I. Grabec, W. Sachse: “Experimental Characterization of Ultrasonic Phenomena by a Learning System”, J. Appi. Phys.,
**66**, 3993–4000 (1989)ADSCrossRefGoogle Scholar - 4.I. Grabec, W. Sachse: “Application of an Intelligent Signal Processing System to AE Analysis”, J. Acoust. Soc. Am.,
**85**, 1226–1235 (1989)ADSCrossRefGoogle Scholar - 5.I. Grabec, W. Sachse: “Automatic Modeling of Physical Phenomena: Application to Ultrasonic Data”, J. Appl. Phys.,
**69**, (9), 6233–6244 (1991)ADSCrossRefGoogle Scholar - 6.I. Grabec, W. Sachse: “Automatic Modeling of Ultrasonic Phenomena”, Conf. Proc.
*Ultrasonics International’91*, La Touquet, France, 1991 ( Butterworth, London 1991 ), pp. 633–636Google Scholar - 7.I. Grabec: “Automatic Modeling of Acoustic Emission Phenomena by Neural Networks”, in
*Dynamic, Genetic and Chaotic Programming, The Sixth Generation*, ed. by B. Soucek and IRIS Group ( John Wiley & Sons, New York 1992 ), pp. 144–163Google Scholar - 8.I. Grabec: “Prediction of Chaotic Dynamical Phenomena by a Neural Network”, in
*Dynamic, Genetic and Chaotic Programming, The Sixth Generation*, ed. by B. Soucek and IRIS Group ( John Wiley & Sons, New York 1992 ), pp. 470–500Google Scholar - 9.I. Grabec: “Self-Organization of Neurons Described by the Maximum-Entropy Principle”, Biol. Cyb.,
**63**, 403–409 (1990)zbMATHCrossRefGoogle Scholar - 10.I. Grabec: “Modeling of Chaos by a Self-Organizing Neural Network, Artificial Neural Networks”,
*Proc. ICANN*, Espoo, Finland, ed. by T. Kohonen, K. Mäkisara, O. Simula, J. Kangas (Elsevier Science Publishers B. V., North- Holland 1991), Vol. 1, pp. 151–156Google Scholar - 11.I. Grabec, D. Grošelj: “Prognosis of Periodontal Disease Healing Process”,
*Proc. CADAM-95 Workshop*, Bled, Slovenia, 1995, ed. by N. Lavrac (IJS Sci. Pub., IJS-SP-95-1), pp. 146–154Google Scholar - 12.D. Grošelj:
*Evaluation of Periodontal Tissue Therapy Using Tooth Mobility Measurements*, PhD Disertation (Medical Faculty, Department of Dentistry, University of Ljubljana 1990 )Google Scholar - 13.D. Grošelj, I. Grabec: “Modeling of a Periodontal Disease Healing Process”,
*Abstracts Booklet of 32**nd**Annual Meeting CED/IADR*, Ljubljana, Slovenia, 1995, ( Continental European Division/International Association for Dental Research ), Rep. No. 082Google Scholar - 14.H. Haken:
*Synergetics, An Introduction*, Springer Series in Synergetics, Vol. 1 (Springer, Berlin 1983 ), p. 181Google Scholar - 15.H. Haken:
*Synergetic Computers and Cognition, A Top-Down Approach to Neural Nets*, Springer Series in Synergetics, Vol. 50 (Springer, Berlin 1991), Ch. 13Google Scholar - 16.J. J. Hopfield: “Neural Networks and Physical Systems with Emergent Collective Computational Abilities”, Proc. Natl. Acad. Sci. USA,
**79**, 2554–2558 (1982)MathSciNetADSCrossRefGoogle Scholar - 17.J. J. Hopfield: “Neurons with Graded Response have Collective Computational Properties like those of Two State Neurons”, Proc. Natl. Acad. Sci. USA,
**81**, 3088–3092 (1984)ADSCrossRefGoogle Scholar - 18.T. Kohonen:
*Self-Organization and Associative Memory*( Springer, Berlin 1989 )Google Scholar - 19.I. D. Lefas, M. D. Kotsovos, N. N. Ambraseys: “Behavior of Reinforced Concrete Structural Wals: Strength, Deformation Characteristics, and Failure Mechanism”, ACI Structural Journal,
**87**, 23–31 (1990)Google Scholar - 20.
*Nondestructive Testing Handbook*, ed. by R. K. Miller, P. Mclntire (American Society for Nondestructive Testing, Columbus, OH 1987), Vol. 5Google Scholar - 21.G. Nicolis, I. Prigogine:
*Self-Organization in Nonequilibrium Systems, From Dissipative Structure to Order through Fluctuations*( John Wiley & Sons, New York 1977 )Google Scholar - 22.Y. H. Pao, W. Sachse: J. Acoust. Soc. Am.,
**56**, 1478 (1974)ADSCrossRefGoogle Scholar - 23.I. Peruš, P. Fajfar, I. Grabec: “Prediction of the Seismic Capacity of RC Structural Walls by a Neural Network”, the article in print at ACI Structural JournalGoogle Scholar
- 24.W. Sachse, S. Golan: in
*Elastic Waves and Non-Destructive Testing of Materials*, ed. by Y. H. Pao (ASME, New York, 1978), AMD Vol. 29, pp. 11–31Google Scholar - 25.D. E. Rumelhart, J. McClelland, and The PDP Research Group:
*Parallel Distributed Processing*( MIT Press, Cambridge, MA 1986 )Google Scholar - 26.H. Schiøler, U. Hartmann: “Mapping Neural Network Derived from the Parzen Window Estimator”, Neural Networks,
**5**, 903–909 (1992)CrossRefGoogle Scholar - 27.D. F. Specht: “Probabilistic Neural Networks”, Neural Networks,
**3**, 109–118 (1990)CrossRefGoogle Scholar - 28.D. F. Specht: “A General Regression Neural Network”, IEEE Trans, on Neural Networks,
**2**, No. 6, 568, (1991)CrossRefGoogle Scholar - 29.A. Tarantola:
*Inverse Problem Theory, Methods for Data Fitting and Model Parameter Estimation*( Elsevier, Amsterdam 1987 )zbMATHGoogle Scholar - 30.S. L. Wood: “Shear Strength of Low-rise Reinforced Concrete Walls”, ACI Structural Journal,
**87**, 99–107 (1990)Google Scholar - 31.S. L. Wood: “Observed Behavoir of Slender Reinforced Concrete Walls Subjected to Cyclic Loading”, in
*Earthquake-resistant Concrete Structures, Inelastic Response and Design*, ed. by S. K. Ghosh, ACI SP 127–11, 453–477 (1991)Google Scholar