A Stochastic EM Learning Algorithm for Structured Probabilistic Neural Networks
The EM-algorithm is a general procedure to get maximum likelihood estimates if part of the observations on the variables of a network are missing. In this paper a stochastic version of the algorithm is adapted to probabilistic neural networks describing the associative dependency of variables. These networks have a probability distribution, which is a special case of the distribution generated by probabilistic inference networks. Hence both types of networks can be combined allowing to integrate probabilistic rules as well as unspecified associations in a sound way. The resulting network may have a number of interesting features including cycles of probabilistic rules, and hidden ‘unobservable’ variables.
Unable to display preview. Download preview PDF.
- Anderson, J.A., Rosenfeld, E. (1988) Neurocomputing: Foundations of Research. MIT Press, Cambridge, Ma.Google Scholar
- Aarts, E., Korst, J. (1988): Simulated Annealing and Boltzmann Machines. Wiley, ChichesterGoogle Scholar
- Besag, J. (1974): Spatial Interaaction and Statistical Analysis of Lattice Systems. Journal of The Royal Statistical Society, Series B., p. 192–236Google Scholar
- Celeux, G., Diebolt, J. (1988): A Random Imputation Principle: The Stochastic EM Algorithm. Tech. Rep. No.901, INRIA, 78153 Le Chesnay, FranceGoogle Scholar
- Dempster, A.P., Laird, N.M., Rubin, D.B. (1977): Maximum Likelihood from Incomplete Data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Vol.B-39, p. 1–38Google Scholar
- Kindermann, R., Snell, J.L. (1980): Markov Random Fields and their Applications. American Math. Society, Providence, R.I.Google Scholar
- Paass, G. (1988): Probabilistic Logic. In: Smets, P., A. Mamdani, D. Dubois, H. Prade (eds.) Non-Standard Logics for Automated Reasoning, Academic press, London, p. 213–252Google Scholar
- Paass, G. (1989): Structured Probabilistic Neural Networks. Proc. Neuro-Nimes ‘89p. 345–359Google Scholar
- Pearl, J. (1988): Probabilistic Reasoning in Intelligent Systems, Morgan Kaufmann, San Mateo, Cal.Google Scholar