Ensemble Learning Classifier System and Compact Ruleset

  • Yang Gao
  • Lei Wu
  • Joshua Zhexue Huang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4247)


The aim of this paper is twofold, to improve the generalization ability, and to improve the readability of learning classifier system. Firstly, an ensemble architecture of LCS (LCSE) is described in order to improve the generalization ability of the original LCS. Secondly, an algorithm is presented for compacting the final classifier population set in order to improve the readability of LCSE, which is an amendatory version of CRA brought by Wilson. Some test experiments are conducted based on the benchmark data sets of UCI repository. The experimental results show that LCSE has better generalization ability than single LCS, decision tree, neural network and their bagging methods. Comparing with the original population rulesets, compact rulesets have readily interpretable knowledge like decision tree, whereas decrease the prediction precision lightly.


Ensemble Learn Decision Tree Algorithm Prediction Precision System Ensemble Good Generalization Ability 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1. (last visit July 23, 2006)
  2. 2.
    Dixon, P.W., Corne, D., Oates, M.J.: A ruleset reduction algorithm for the xcs learning classifier system. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2003. LNCS (LNAI), vol. 2661, pp. 20–29. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  3. 3.
    Gao, Y., Huang, J.Z., Rong, H., Gu, D.: Learning classifier system ensemble for data mining. In: Genetic and Evolutionary Computation Conference (GECCO2005) workshop program, Washington, pp. 63–66. ACM Press, New York (2005)Google Scholar
  4. 4.
    Booker, L., Goldberg, D.E., Holland, J.H.: Classifier systems and genetic algorithms. Artificial Intelligence 40(1-3), 235–282 (1989)CrossRefGoogle Scholar
  5. 5.
    Wilson, S.W.: Zcs: A zeroth level classifier system. Evolutionary Computation 2(1), 1–18 (1994)CrossRefGoogle Scholar
  6. 6.
    Wilson, S.W.: Classifier fitness based on accuracy. Evolutionary Computation 3(2), 149–175 (1995)CrossRefGoogle Scholar
  7. 7.
    Wilson, S.W.: Get real! xcs with continous-valued inputs. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 1999. LNCS (LNAI), vol. 1813, pp. 209–219. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  8. 8.
    Wilson, S.W.: Compact rulesets from xcsi. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2001. LNCS (LNAI), vol. 2321, pp. 192–210. Springer, Heidelberg (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yang Gao
    • 1
  • Lei Wu
    • 1
  • Joshua Zhexue Huang
    • 2
  1. 1.State Key Laboratory for Novel Software TechnologyNanjing UniversityChina
  2. 2.E-business Technology InstituteThe University of Hong KongChina

Personalised recommendations