Improved Center Point Selection for Probabilistic Neural Networks
Probabilistic neural networks (PNN) typically learn more quickly than many neural network models and have had success on a variety of applications. However, in their basic form, they tend to have a large number of hidden nodes. One common solution to this problem is to keep only a randomly selected subset of the original training data in building the network. This paper presents an algorithm called the reduced probabilistic neural network (RPNN) that seeks to choose a better than random subset of the available instances to use as center points of nodes in the network. The algorithm tends to retain non-noisy border points while removing nodes with instances in regions of the input space that are highly homogeneous. In experiments on 22 datasets, the RPNN had better average generalization accuracy than two other PNN models, while requiring an average of less than one-third the number of nodes.
KeywordsRadial Basis Function Hide Node Probabilistic Neural Network Training Instance Decision Node
Unable to display preview. Download preview PDF.
- J. MacQueen. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematics, Stistics and Probability, pages 281–297, Berkeley, CA, 1967.Google Scholar
- C.J. Merz and P.M. Murphy. UCI machine learning databases. Technical report, Irvine, CA: University of California, Department of Information and Computer Science, 1996. Internet:http://www.ics.uci.edu/mlearn/MLRepository.html.Google Scholar
- D.E. Rumelhart and J.L. McClelland. Parallel Distributed Processing. MIT Press, 1986.Google Scholar
- D.F. Specht. Enhancements to probabilistic neural networks. In Proceedings of the International Joint Conference on Neural Networks, volume 1, pages 761–786, 1992.Google Scholar
- C. Stanfill and D. Waltz. Toward memory-based reasoning. Communications of the ACM, 29, 1986.Google Scholar
- P.D. Wasserman. Advanced Methods in Neural Computing. Van Nostrand Reinhold, New York, NY, 1996.Google Scholar
- D.R. Wilson and T.R. Martinez. Heterogeneous radial basis functions. In Proceedings of the International Conference on Neural Networks, volume 2, pages 1263–1267, 1996.Google Scholar