Optimising Decision Classifications Using Genetic Algorithms

  • Keeley A. Crockett
  • Zuhair Bandar
  • Akeel Al-Attar
Conference paper


A difficult problem associated with traditional decision tree rule induction algorithms is how to achieve common currency between the actual classification accuracy and the distribution of this accuracy between the outcome classes. This paper introduces a novel method which successfully shows that it is possible to attain decision trees which exhibit both good performance and balance. The method first involves the induction of a decision tree, which is then fuzzified using a Genetic Algorithm (GA). Each solution generated by the GA produces a set of fuzzy regions which are mapped onto all nodes in the tree. The GA’s fitness function consists of two components: classification accuracy and balance which are optimised concurrently. Three alternative functions are defined, each of which opposes different penalties on the classification accuracy depending on the selected weighting associated with the balance component. The method is applied to two real world data sets and is shown to achieve a high degree of common currency between accuracy and balance.


Genetic Algorithm Membership Function Classification Accuracy Fitness Function Common Currency 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Crockett. K, Bandar. Z, Al-Attar. A, A Genetically Optimised Fuzzy Inference Algorithm. International Conference on Artificial Intelligence and Soft Computing, Mexico, 1998.Google Scholar
  2. [2]
    Crockett. K, Bandar. Z, Al-Attar. A, A Fuzzy Inference Framework For Induced Decision Trees. ECAI 98. 13th European Conference on Artificial Intelligence, Brighton, UK. Eds. H. Prade. John Wiley & Sons Ltd, 425–429, 1998Google Scholar
  3. [3]
    Zadeh, L. Knowledge Representation In Fuzzy Logic. An Introduction To Fuzzy Logic Applications In Intelligent systems, edted by Yager, R and Zadeh, L., Kluwer Academic Publishers, 1992.Google Scholar
  4. [4]
    Klir, G. Folder, T. Fuzzy Sets, Uncertainty and Information. Prentice Hall, 1988.Google Scholar
  5. [5]
    Grefenstette, J. Genetic Algorithms For Machine Learning, A Special Issue of Machine Learning. Machine Learning Vol. 13, Nos. 2-3. Kluwer Academic Publishers, 1993Google Scholar
  6. [6]
    Goldberg, D. A Meditation on the Application of Genetic Algorithms. IlliGal Technical Report No. 8003. Solution: http://gal4.ge.uiuc.edu/illigal.home.html, Feb 1998
  7. [7]
    Holland, J. Adaptation in Natural and Artificial Systems. University of Michigan, 1975.Google Scholar
  8. [8]
    Karr, C. Freeman, L. Meredith, D. Improved Fuzzy Process Control Of Spacecraft Autonomous Rendezvous Using A GA, SPIE Vol 1196 Intelligent Control and Adaptive Systems, 1989Google Scholar
  9. [9]
    Mahmood, A. Meashio, Y. Singer, G. A Genetic Algorithm Based Fuzzy Logic Controller For Non-Linear Systems, GALESIA-97 Genetic Algorithms in Engineering Systems Innovations and Applications, Conference Publication 446, IEE, 30–35, 1997Google Scholar
  10. [10]
    Crockett. K, Bandar. Z, Al-Attar. A, Fuzzy Rule Induction From Data Sets. Proceedings of The 10th International Florida Artificial Intelligence Research Symposium, 332–336, 1997Google Scholar
  11. [11]
    Quinlan, J, R. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, 1993Google Scholar
  12. [12]
    Quinlan, J, R. C5.0 An Informal Tutorial. http://www.rulequest.com/see5-unix.html#XVAL, 1997
  13. [13]
    XpertRule, Attar Software, Newlands Road, Leigh, Lancashire, WN7 4HN, UKGoogle Scholar

Copyright information

© Springer-Verlag Wien 1999

Authors and Affiliations

  • Keeley A. Crockett
    • 1
  • Zuhair Bandar
    • 1
  • Akeel Al-Attar
    • 2
  1. 1.The Intelligent Systems GroupThe Manchester Metropolitan UniversityManchesterUK
  2. 2.Attar Software LimitedLeigh, LancashireUK

Personalised recommendations