Abstract
Fuzzy decision trees have been substantiated to be a valuable tool and more efficient than neural networks for pattern recognition task due to some facts like computation in making decisions are simpler and important features can be selected automatically during the design process. Here we present a feed forward neural network which learns fuzzy decision trees during the descent along the branches for its classification. Every decision instances of decision tree are represented by a node in neural network. The neural network provides the degree of membership of each possible move to the fuzzy set < < good move > > corresponding to each decision instance. These fuzzy values constitute the core of the probability of selecting the move out of the set of the children of the current node. This results in a natural way for driving the sharp discrete-state process running along the decision tree by means of incremental methods on the continuous-valued parameters of the neural network. A simulation program in C has been deliberated and developed for analyzing the consequences. The effectiveness of the learning process is tested through experiments with three real-world classification problems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Quinlan, J.R.: Induction of decision trees. Machine Learning 1, 81–106 (1986)
Zadeh, L.A.: Fuzzy Sets. Information and Control 8(3), 338–353 (1965)
Schalkoff, R.: Pattern Recognition: Statistical, Structural and Neural Appraoches. John Wiley & Sons, New Work (1992)
Olaru, C., Wehenkel, L.: A Complete Fuzzy Decision Tree Technique. Fuzzy Sets and Systems 138, 221–254 (2003)
Valiant, L.: A theory of the learnable. Communication of ACM 27, 1134–1142 (1984)
Kushilevitz, E., Mansour, Y.: Learning decision trees using the Fourier spectrum. Siam Journal of Computer Science 22(6), 1331–1348 (1993)
Hancock, T.: Learning 2m DNF and km decision trees. In: 4th COLT, pp. 199–308 (1991)
Bellare, M.: A technique for upper bounding the spectral norm with application to learning. In: 5th Annual Workshop on Computational Learning Theory, pp. 62–70 (1992)
Sakay, Y., Takimoto, E., Maruoka, A.: Proper learning algorithm for functions of k-terms under smooth distributions. In: Proc. of the 8th Workshop on Computational Learning Theory, pp. 206–213. Morgan Kaufmann, San Francisco (1995)
Erenfeucht, A., Haussler, D.: Learning decision trees from random examples. Inform. and Comp. 82(3), 231–246 (1989)
Hopfield, J., Tank, D.: Neural computations of decisions in optimization problems. Biological Cybernetics 52(3), 141–152 (1985)
Saylor, J., Stork, D.: Parallel analog neural networks for tree searching. In: Proc. Neural Networks for Computing, pp. 392–397 (1986)
Szczerbicki, E.: Decision trees and neural networks for reasoning and knowledge acquisition for autonomous agents. International Journal of Systems Science 27(2), 233–239 (1996)
Sethi, I.: Entropy nets: from decision trees to neural networks. Proceedings of the IEEE 78, 1605–1613 (1990)
Ivanova, I., Kubat, M.: Initialization of neural networks by means of decision trees. Knowledge-Based systems 8(6), 333–344 (1995)
Geurts, P., Wehenkel, L.: Investigation and reduction of discretization variance in decision tree induction. In: Lopez de Mantaras, R., Plaza, E. (eds.) ECML 2000. LNCS (LNAI), vol. 1810, pp. 162–170. Springer, Heidelberg (2000)
Anderson, E.: The Irises of the Gaspe peninsula, Bulletin America, IRIS Soc. (1935)
Budihardjo, A., Grzymala-Busse, J., Woolery, L.: Program LERS_LB 2.5 as a tool for knowledge acquisition in nursing. In: Proceedings of the 4th Int. Conference on Industrial & Engineering Applications of AI & Expert Systems, pp. 735–740 (1991)
Jain, M., Butey, P.K., Singh, M.P.: Classification of Fuzzy-Based Information using Improved backpropagation algorithm of Artificial Neural Networks. International Journal of Computational Intelligence Research 3(3), 265–273 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Singh, M.P. (2011). Dynamic Successive Feed-Forward Neural Network for Learning Fuzzy Decision Tree. In: Kuznetsov, S.O., Ślęzak, D., Hepting, D.H., Mirkin, B.G. (eds) Rough Sets, Fuzzy Sets, Data Mining and Granular Computing. RSFDGrC 2011. Lecture Notes in Computer Science(), vol 6743. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21881-1_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-21881-1_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21880-4
Online ISBN: 978-3-642-21881-1
eBook Packages: Computer ScienceComputer Science (R0)