Generating Effective Classifiers with Supervised Learning of Genetic Programming

  • Been-Chian Chien
  • Jui-Hsiang Yang
  • nd Wen-Yang Lin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2737)


A new approach of learning classifiers using genetic programming has been developed recently. Most of the previous researches generate classification rules to classify data. However, the generation of rules is time consuming and the recognition accuracy is limited. In this paper, an approach of learning classification functions by genetic programming is proposed for classification. Since a classification function deals with numerical attributes only, the proposed scheme first transforms the nominal data into numerical values by rough membership functions. Then, the learning technique of genetic programming is used to generate classification functions. For the purpose of improving the accuracy of classification, we proposed an adaptive interval fitness function. Combining the learned classification functions with training samples, an effective classification method is presented. Numbers of data sets selected from UCI Machine Learning repository are used to show the effectiveness of the proposed method and compare with other classifiers.


Genetic Programming Classification Function Association Rule Mining Positive Instance Nominal Attribute 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blake, C., Keogh, E., Merz, C.J.: UCI repository of machine learning database, Irvine, University of California, Department of Information and Computer Science (1998),
  2. 2.
    Bramrier, M., Banzhaf, W.: A Comparison of Linear Genetic Programming and Neural Networks in Medical Data Mining. IEEE Transaction on Evolutionary Computation 5(1), 17–26 (2001)CrossRefGoogle Scholar
  3. 3.
    Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, John and Sons Incorporated Publisher, New York (1973) zbMATHGoogle Scholar
  4. 4.
    Freitas, A.A.: A Genetic Programming Framework for Two Data Mining Tasks: Classification and Generalized Rule Induction. In: Proc. the 2nd Annual Conf. Genetic Programming, pp. 96–101. Morgan Kaufmann Publishers, Stanford University (1997)Google Scholar
  5. 5.
    Heckerman, D.M., Wellman, P.: Bayesian Networks. Communications of the ACM 38(3), 27–30 (1995)CrossRefGoogle Scholar
  6. 6.
    Kishore, J.K., Patnaik, L.M., Agrawal, V.K.: Application of Genetic Programming for Multicategory Pattern Classification. IEEE Transactions on Evolutionary Computation 4(3), 242–258 (2000)CrossRefGoogle Scholar
  7. 7.
    Kohavi, R.: Scaling Up the Accuracy of Naïve-Bayes Classifiers: a Decision-Tree Hybrid. Proc. Int. Conf. Knowledge Discovery & Data Mining. pp.202-207. AAAI Press/MIT Press Publishers, Cambridge/Menlo Park (1996)Google Scholar
  8. 8.
    Koza, J.R.: Genetic Programming: On the programming of computers by means of Natural Selection. MIT Press Publishers, Cambridge (1992)zbMATHGoogle Scholar
  9. 9.
    Koza, J.R.: Introductory Genetic Programming Tutorial. In: Proc. the First Annual Conf. Genetic Programming. MIT Press Publishers, Stanford University (1996)Google Scholar
  10. 10.
    Liu, B., Hsu, W., Ma, Y.: Integrating Classification and Association Rule Mining. In: Proc. the Fourth Int. Conf. Knowledge Discovery and Data Mining, pp. 443–447. AAAI Press Publishers, Menlo Park (1998)Google Scholar
  11. 11.
    Loveard, T., Ciesielski, V.: Representing Classification Problems in Genetic Programming. In: Proc. the Congress on Evolutionary Computation, COEX Center, Seoul, Korea, pp. 1070–1077 (2001)Google Scholar
  12. 12.
    Pawlak, Z.: Rough Sets. International Journal of Computer and Information Sciences 11, 341–356 (1982)zbMATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    Pawlak, Z., Skowron, A.: Rough Membership Functions. In: Yager, R.R., Fedrizzi, M., Kacprzyk, J. (eds.) Advances in the Dempster-Shafer Theory of Evidence, pp. 251–271 (1994)Google Scholar
  14. 14.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo (1993)Google Scholar
  15. 15.
    Singleton, A.: Genetic Programming with C++ Byte, pp. 171–176 (February 1994),
  16. 16.
    Xie, Z., Hsu, W., Liu, Z., Lee, M.L.: SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning. In: Proc. the sixth Pacific-Asia Conf. on Advances in Knowledge Discovery and Data Mining, pp. 104–114 (2002)Google Scholar
  17. 17.
    Zhang, G.P.: Neural Networks for Classification: a Survey. IEEE Transaction on Systems, Man, And Cybernetics-Part C: Applications and Reviews 30(4), 451–462 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Been-Chian Chien
    • 1
  • Jui-Hsiang Yang
    • 1
  • nd Wen-Yang Lin
    • 2
  1. 1.Institute of Information EngineeringI-Shou UniversityKaohsiung CountyTaiwan, R.O.C.
  2. 2.Department of Information ManagementI-Shou UniversityKaohsiung CountyTaiwan, R.O.C.

Personalised recommendations