Abstract
In this paper, we present new probabilistic neural network (PNN) training procedure for classification problems. Proposed procedure utilizes the State-Action-Reward-State-Action algorithm (SARSA in short), which is the implementation of the reinforcement learning method. This algorithm is applied to the adaptive selection and computation of the smoothing parameter of the PNN model. PNNs with different forms of the smoothing parameter are regarded. The prediction ability for all the models is assessed by computing the test error with the use of a 10-fold cross validation (CV) procedure. The obtained results are compared with state-of-the-art methods for PNN training.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Specht, D.F.: Probabilistic neural networks. Neural Networks 3, 109–118 (1990)
Maglogiannis, I., Zafiropoulos, E., Anagnostopoulos, I.: An intelligent system for automated breast cancer diagnosis and prognosis using SVM based classifiers. Applied Intelligence 30, 24–36 (2009)
Mantzaris, D., Anastassopoulos, G., Adamopoulos, A.: Genetic algorithm pruning of probabilistic neural networks in medical disease estimation. Neural Networks 24, 831–835 (2011)
Orr, R.K.: Use of a Probabilistic Neural Network to Estimate the Risk of Mortality after Cardiac Surgery. Medical Decision Making 17, 178–185 (1997)
Chtioui, Y., Panigrahi, S., Marsh, R.: Conjugate gradient and approximate Newton methods for an optimal probabilistic neural network for food color classification. Optical Engineering 37, 3015–3023 (1998)
Kyriacou, E., Pattichis, M.S., Pattichis, C.S., et al.: Classification of atherosclerotic carotid plaques using morphological analysis on ultrasound images. Applied Intelligence 30, 3–23 (2009)
Ramakrishnan, S., Selvan, S.: Image texture classification using wavelet based curve fitting and probabilistic neural network. International Journal of Imaging Systems and Technology 17, 266–275 (2007)
Adeli, H., Panakkat, A.: A probabilistic neural network for earthquake magnitude prediction. Neural Networks 22, 1018–1024 (2009)
Rutkowski, L.: Adaptive Probabilistic Neural Networks for Pattern Classification in Time-Varying Environment. IEEE Transactions on Neural Networks 15, 811–827 (2004)
Specht, D.F., Romsdahl, H.: Experience with adaptive probabilistic neural networks and adaptive general regression neural networks. In: IEEE International Conference on Neural Networks, Orlando, pp. 1203–1208 (1994)
Georgiou, L.V., Pavlidis, N.G., Parsopoulos, K.E., Alevizos, P.D., Vrahatis, M.N.: New Self-adaptive Probabilistic Neural Networks in Bioinformatic and Medical Tasks. International Journal on Artificial Intelligence Tools 15, 371–396 (2006)
Georgiou, L.V., Alevizos, P.D., Vrahatis, M.N.: Novel Approaches to Probabilistic Neural Networks Through Bagging and Evolutionary Estimating of Prior Probabilities. Neural Processing Letters 27, 153–162 (2008)
Kusy, M., Zajdel, R.: Probabilistic neural network training procedure based on Q(0)-learning algorithm in medical data classification. Applied Intelligence 41, 837–854 (2014)
Kusy, M., Zajdel, R.: Application of Reinforcement Learning Algorithms for the Adaptive Computation of the Smoothing Parameter for Probabilistic Neural Network. IEEE Transactions on Neural Networks and Learning System (in print), doi:10.1109/TNNLS.2014.2376703
UCI Machine Learning Repository, archive.ics.uci.edu/ml/datasets.html
Sutton, R.S., Barto, A.G.: Reinforcement learning: An Introduction. MIT Press, Cambridge (1998)
Rummery, G., Niranjan, M.: On line q-learning using connectionist systems. Technical Report CUED/F-INFENG/TR 166, Cambridge University Engineering Department (1994)
Singh, S.P., Sutton, R.S.: Reinforcement Learning with Replacing Eligibility Traces. Machine Learning 22, 123–158 (1996)
Chang, R.K.Y., Loo, C.K., Rao, M.V.C.: A Global k-means Approach for Autonomous Cluster Initialization of Probabilistic Neural Network. Informatica 32, 219–225 (2008)
Chandra, B., Naresh Babu, K.V.: An Improved Architecture for Probabilistic Neural Networks. In: International Conference on Neural Networks, San Jose (2011)
Temurtas, H., Yumusak, N., Temurtas, F.: A comparative study on diabetes disease diagnosis using neural networks. Expert Systems with Applications 36, 8610–8615 (2009)
Azar, A.T., El-Said, S.A.: Probabilistic neural network for breast cancer classification. Neural Computing & Applications 23, 1737–1751 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Kusy, M., Zajdel, R. (2015). Probabilistic Neural Network Training Procedure with the Use of SARSA Algorithm. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2015. Lecture Notes in Computer Science(), vol 9119. Springer, Cham. https://doi.org/10.1007/978-3-319-19324-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-19324-3_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19323-6
Online ISBN: 978-3-319-19324-3
eBook Packages: Computer ScienceComputer Science (R0)