Abstract
We propose a Top-Down Inferring algorithm Tdinfer for artificial neural network rule extraction. These rules formalize the decision process of a standard multi-layer network and make its prediction explicit and understandable. They do not involve any weight values and no restrictions are made on the activation values. The algorithm is applied to a speech and character recognition problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mouria-Beji, F.: CODEPHON-NN: A context-dependent phonemic model based on neural networks. In Proc. IEEE Int. multiconference on Computational Engineering in Systems Applications. IEEE-SMC, April (1998).
Mouria-Beji, F.: Neural network use in a non-linear vectorial interpolation technique for speaker recognition. In IEEE World Congress on Computational Intelligence, IEEE/IJCNN. vol. 2, pp. 1200–1205, Anchorage, Alaska. May (1998).
Peifer, H., Gutknecht, M. and Stolze, M.: Cooperative hybrid systems. In Proceedings of 11th IJCAI, pages 824–829, (1991).
Choi, E. C. Y. and Gedeon, T. D.: Comparison of extracted rules from multiple networks. IEEE Transactions on Neural Networks, 6, January (1995).
Mitrad, S.: Puzzy multi-Iayer perceptron, inferencing and rule generation. IEEE Transactions on Neural Networks, 6(1), January (1995).
Terrace, H. M. K. and Ridge, K.: Integating rules and neural computation. IEEE Transactions on Neural Networks, 6, January (1995).
Quinlan, J. R.: Comparing connectionist and symbolic learning methods. In Drastall, G.A., Hanson, S.J. and Rivest, R.I., editors, Computational Learning Theory and Natural Learning Systems. MIT Press, Cambrige, Mass., (1994).
Mooney, R.J., Shavilk, J.W. and Towell, G.G.: Symbolic and neural learning algorithms: An experimental comparison. Machine Learning, 6(2):111–143, Mar. (1991).
Yamashita, K., Hirose, Y. and Hijiya, S.: Back propagation algorithm wich varies the number of hidden unitsintegating rules and neural computation. Transactions on Neural Networks, 4:61–66, January (1991).
Towell, G. G. and Shavlik, J. W., Extracting refined rules from knowledge-based neural networks. Machine Learning, 13(1):71–101, Oct. (1993).
Pu, K. S.: Error-correcting parsing for syntactic pattern recognition. In Klinger, A., Pu, K. S. and Kunii, T. L., editors, Data Structures, Computer Graphics, and Pattern Recognition, pages 449–492. Academic Press, Inc., (1977).
Mouria-Beji, F. and Boulahia, J.: ANNREX: An algorithm for neural network rule extraction. In Proc. IEEE Int. multiconference on Computational Engineering in Systems Applications. IEEE-SMC, April (1998).
Sima, J.: Neural expert systems. Transactions on Neural Networks, 8(2):261–271, January (1995).
Hayes, S., Ciesielsk, U. and Kelly, B.: Comparaison of an expert system and a hybrid neural network. In AAAI-92 Workshop on Integrating Neural and Symbolic Process, the Cognitive Dimension, San Jose, California, (1992).
Pellegrini, C., Hilario, M. and Alexandre, F.: Modular integration of connexioniste and symbolic processing in knowledge based systems. In Proceedings of Int. Symposium on Integrating Knowledge and Neural Heuristics, pages 824–829, Pensacola Beach, Florida, (1994).
Hinton, G. E., Rummelhart, D. E. and Williams, R. J.: Learning representations by error propagation. In Mc Clelland, J. L., Rummelhart, D. E. and the PDP Research Group, editors, Parallel Distributed Processing. Mc Graw-Hill Book Company, Cambrige, MA, MIT Press.
Mouria-Beji, F. and Boulahia, J.: Extraction and insertion rules during the training process of a neural network. In the International Conference on Artificial and Computational Intelligence for Decision, Control and Automation in Engineering and Industrial Applications, March (2000).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Wien
About this paper
Cite this paper
Mouria-Beji, F. (2001). Symbolic Representation of a Multi-Layer Perceptron. In: Kůrková, V., Neruda, R., Kárný, M., Steele, N.C. (eds) Artificial Neural Nets and Genetic Algorithms. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6230-9_50
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6230-9_50
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83651-4
Online ISBN: 978-3-7091-6230-9
eBook Packages: Springer Book Archive