Abstract
Probabilistic neural networks (PNN) typically learn more quickly than many neural network models and have had success on a variety of applications. However, in their basic form, they tend to have a large number of hidden nodes. One common solution to this problem is to keep only a randomly selected subset of the original training data in building the network. This paper presents an algorithm called the reduced probabilistic neural network (RPNN) that seeks to choose a better than random subset of the available instances to use as center points of nodes in the network. The algorithm tends to retain non-noisy border points while removing nodes with instances in regions of the input space that are highly homogeneous. In experiments on 22 datasets, the RPNN had better average generalization accuracy than two other PNN models, while requiring an average of less than one-third the number of nodes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J.A. Leonard, M.A. Kramer, and L.H. Ungar. Using radial basis functions to approximate a function and its error bounds. IEEE Transactions on Neural Networks, 3(4):624–627, 1992.
J. MacQueen. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematics, Stistics and Probability, pages 281–297, Berkeley, CA, 1967.
C.J. Merz and P.M. Murphy. UCI machine learning databases. Technical report, Irvine, CA: University of California, Department of Information and Computer Science, 1996. Internet:http://www.ics.uci.edu/mlearn/MLRepository.html.
O.J. Rawlings. Applied Regression Analysis. Wadsworth and Brook/Cole, Pacific Grove, CA, 1988.
D.E. Rumelhart and J.L. McClelland. Parallel Distributed Processing. MIT Press, 1986.
D.F. Specht. Enhancements to probabilistic neural networks. In Proceedings of the International Joint Conference on Neural Networks, volume 1, pages 761–786, 1992.
C. Stanfill and D. Waltz. Toward memory-based reasoning. Communications of the ACM, 29, 1986.
P.D. Wasserman. Advanced Methods in Neural Computing. Van Nostrand Reinhold, New York, NY, 1996.
D.R. Wilson and T.R. Martinez. Heterogeneous radial basis functions. In Proceedings of the International Conference on Neural Networks, volume 2, pages 1263–1267, 1996.
D.R. Wilson and T.R. Martinez. Improved heterogeneous distance functions. Journal of Artificial Intelligence, 6(1):1–34, 1997.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Wien
About this paper
Cite this paper
Wilson, D.R., Martinez, T.R. (1998). Improved Center Point Selection for Probabilistic Neural Networks. In: Artificial Neural Nets and Genetic Algorithms. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6492-1_113
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6492-1_113
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83087-1
Online ISBN: 978-3-7091-6492-1
eBook Packages: Springer Book Archive