Skip to main content

Dynamic Successive Feed-Forward Neural Network for Learning Fuzzy Decision Tree

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6743))

Abstract

Fuzzy decision trees have been substantiated to be a valuable tool and more efficient than neural networks for pattern recognition task due to some facts like computation in making decisions are simpler and important features can be selected automatically during the design process. Here we present a feed forward neural network which learns fuzzy decision trees during the descent along the branches for its classification. Every decision instances of decision tree are represented by a node in neural network. The neural network provides the degree of membership of each possible move to the fuzzy set < < good move > > corresponding to each decision instance. These fuzzy values constitute the core of the probability of selecting the move out of the set of the children of the current node. This results in a natural way for driving the sharp discrete-state process running along the decision tree by means of incremental methods on the continuous-valued parameters of the neural network. A simulation program in C has been deliberated and developed for analyzing the consequences. The effectiveness of the learning process is tested through experiments with three real-world classification problems.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Quinlan, J.R.: Induction of decision trees. Machine Learning 1, 81–106 (1986)

    Google Scholar 

  2. Zadeh, L.A.: Fuzzy Sets. Information and Control 8(3), 338–353 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  3. Schalkoff, R.: Pattern Recognition: Statistical, Structural and Neural Appraoches. John Wiley & Sons, New Work (1992)

    Google Scholar 

  4. Olaru, C., Wehenkel, L.: A Complete Fuzzy Decision Tree Technique. Fuzzy Sets and Systems 138, 221–254 (2003)

    Article  MathSciNet  Google Scholar 

  5. Valiant, L.: A theory of the learnable. Communication of ACM 27, 1134–1142 (1984)

    Article  MATH  Google Scholar 

  6. Kushilevitz, E., Mansour, Y.: Learning decision trees using the Fourier spectrum. Siam Journal of Computer Science 22(6), 1331–1348 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  7. Hancock, T.: Learning 2m DNF and km decision trees. In: 4th COLT, pp. 199–308 (1991)

    Google Scholar 

  8. Bellare, M.: A technique for upper bounding the spectral norm with application to learning. In: 5th Annual Workshop on Computational Learning Theory, pp. 62–70 (1992)

    Google Scholar 

  9. Sakay, Y., Takimoto, E., Maruoka, A.: Proper learning algorithm for functions of k-terms under smooth distributions. In: Proc. of the 8th Workshop on Computational Learning Theory, pp. 206–213. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  10. Erenfeucht, A., Haussler, D.: Learning decision trees from random examples. Inform. and Comp. 82(3), 231–246 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  11. Hopfield, J., Tank, D.: Neural computations of decisions in optimization problems. Biological Cybernetics 52(3), 141–152 (1985)

    MathSciNet  MATH  Google Scholar 

  12. Saylor, J., Stork, D.: Parallel analog neural networks for tree searching. In: Proc. Neural Networks for Computing, pp. 392–397 (1986)

    Google Scholar 

  13. Szczerbicki, E.: Decision trees and neural networks for reasoning and knowledge acquisition for autonomous agents. International Journal of Systems Science 27(2), 233–239 (1996)

    Article  MATH  Google Scholar 

  14. Sethi, I.: Entropy nets: from decision trees to neural networks. Proceedings of the IEEE 78, 1605–1613 (1990)

    Article  Google Scholar 

  15. Ivanova, I., Kubat, M.: Initialization of neural networks by means of decision trees. Knowledge-Based systems 8(6), 333–344 (1995)

    Article  Google Scholar 

  16. Geurts, P., Wehenkel, L.: Investigation and reduction of discretization variance in decision tree induction. In: Lopez de Mantaras, R., Plaza, E. (eds.) ECML 2000. LNCS (LNAI), vol. 1810, pp. 162–170. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  17. Anderson, E.: The Irises of the Gaspe peninsula, Bulletin America, IRIS Soc. (1935)

    Google Scholar 

  18. Budihardjo, A., Grzymala-Busse, J., Woolery, L.: Program LERS_LB 2.5 as a tool for knowledge acquisition in nursing. In: Proceedings of the 4th Int. Conference on Industrial & Engineering Applications of AI & Expert Systems, pp. 735–740 (1991)

    Google Scholar 

  19. Jain, M., Butey, P.K., Singh, M.P.: Classification of Fuzzy-Based Information using Improved backpropagation algorithm of Artificial Neural Networks. International Journal of Computational Intelligence Research 3(3), 265–273 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Singh, M.P. (2011). Dynamic Successive Feed-Forward Neural Network for Learning Fuzzy Decision Tree. In: Kuznetsov, S.O., Ślęzak, D., Hepting, D.H., Mirkin, B.G. (eds) Rough Sets, Fuzzy Sets, Data Mining and Granular Computing. RSFDGrC 2011. Lecture Notes in Computer Science(), vol 6743. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21881-1_46

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-21881-1_46

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21880-4

  • Online ISBN: 978-3-642-21881-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics