Abstract
In this paper, a procedure for rule extraction from radial basis function networks (RBFNs) is proposed. The algorithm is based on the use of a support vector machine (SVM) as a frontier pattern selector. By using geometric methods, centers of the RBF units are combined with support vectors in order to construct regions (ellipsoids or hyper-rectangles) in the input space, which are later translated to if-then rules. Additionally, the support vectors are used to determine overlapping between classes and to refine the rule base. The experimental results indicate that a very high fidelity between RBF network and the extracted set of rules can be achieved with low overlapping between classes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Andrews, R., Diederich, J., Tickle, A.: A Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks. Knowledge-Based Systems. 8(6) (1995) 373–389
Bishop, C.: Neural Networks for Pattern Recognition. Oxford University Press, Inc., New York (1995)
Brotherton, T., Chadderdon, G., Grabill, P.: Automated Rule Extraction for Engine Vibration Analysis. Proc. 1999 IEEE Aerospace Conference. Vol. 3 (1999) 29–38
Cortes, C., Vapnik, V.: Support-Vector Networks. Machine Learning. 20 (1995) 237–297.
Craven, M. Shavlik, J.: Using Neural Networks for Data Mining. Future Generation Computer Systems. 13 (1997) 211–229
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press, Cambridge (2000)
Domingos, P.: Unifying Instance-Based and rule-Based Induction. Machine Learning. 24 (1991) 141–168
Duda, R. O., Hart, P. E., Stork, D.G.: Pattern Recognition. John Wiley & Sons, Inc., New York (2001)
Fu, X., Wang, L.: Rule Extraction by Genetic Algorithms Based on a Simplified RBF Neural Network. Proc. of the 2001 Congress on Evolutionary Computation. Vol. 2 (2001) 753–758
Girosi, F., Poggio, T.: Networks and the best approximation property. Biological Cybernetics. 63 (1990) 169–176
Haykin, S.: Neural Networks: A comprehensive foundation. Macmillan, New York (1994)
Huber, K., Berthold, M.: Building Precise Classifiers with Automatic Rule Extraction. Proc. IEEE International Conference on Neural Networks. Vol 3 (1995) 1263–1268
McGarry, K., Wermter, S., MacIntyre, J.: Knowledge Extraction from Local Function Networks. Proc. IJCAI. (2001) 765–770
Merz, C. J., Murphy, P. M.: UCI Repository for Machine Learning Data-Bases. Irvine, CA: University of California, Department of Information and Computer Science, http://www.ics.uci.edu/~mlearn/MLRepository.html] (1998)
Mitra, S., Pal, S. K., Mitra, P.: Data Mining in Soft Computing Framework: A survey. IEEE Transactions on Neural Networks. 13 (1) (2002) 3–14.
Moody, J., Darken, C.J.: Fast Learning in Networks of Locally-Tuned Processing Units. Neural Computation. 1 (1989) 281–294
Park, J., Sandberg, I.W.: Universal approximation using radial basis function networks. Neural Computation. 3 (2) (1991) 246–257
Roger, J.-S., Sun, C.-T.: Functional Equivalence Between Radial Basis Function Networks and Fuzzy Inference Systems. IEEE Transactions on Neural Networks. 4 (1) (1993) 156–158
Salzberg, S.: A Nearest Hyperrectangle Learning Method. Machine Learning. 6 (1991) 251–276
Tickle, A., Maire, F., Bologna, G., Andrews, R.; Diederich, J.: Lessons from Past, Current Issues, and Future Research Directions in Extracting the Knowledge Embedded Artificial Neural Networks,.In: Wermter, S., Sun, R. (eds): Hybrid Neural Systems. Springer-Verlag, Berlin (2000)
Tickle. A., Andrews, R., Mostefa, G., Diederich, J.: The Truth will come to light: Directions and Challenges in Extracting the Knowledge Embedded within Trained Artificial Neural Networks. IEEE Transactions on Neural Networks. 9 (6) (1998) 1057–1068
Vapnik, V.: Statistical Learning Theory. John Wiley&Sons, Inc., New York (1998)
Wermter, S. Sun, R. (eds): Hybrid Neural Systems. Springer-Verlag, Berlin (2000)
Witten, I. H., Frank, E.: Data Mining. Practical Machine Learning Tools and Techniques with Java Implementations. Academic Press, San Diego (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Núñez, H., Angulo, C., Català, A. (2002). Rule Extraction from Radial Basis Function Networks by Using Support Vectors. In: Garijo, F.J., Riquelme, J.C., Toro, M. (eds) Advances in Artificial Intelligence — IBERAMIA 2002. IBERAMIA 2002. Lecture Notes in Computer Science(), vol 2527. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36131-6_45
Download citation
DOI: https://doi.org/10.1007/3-540-36131-6_45
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00131-7
Online ISBN: 978-3-540-36131-2
eBook Packages: Springer Book Archive