Advertisement

Do We Really Need to Estimate Rule Utilities in Classifier Systems?

  • Lashon B. Booker
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1813)

Abstract

Classifier systems have traditionally used explicit measures of utility (strength, predicted payoff, accuracy, etc.) to quantify the performance and fitness of classifier rules. Much of the effort in designing and implementing classifier systems has focused on getting these utilities “right”. One alternative worth exploring is the idea of using endogenous fitness; that is, reinforcing successful performance with “resources” that rules need in order to reproduce. Under this regime, the best rules are those that accumulate the most resources over their lifetime and, consequently, have the most offspring. This paper describes a classifier system designed along these lines. Rules have no associated utility measure. Instead, each rule has one or more reservoirs that can be used to store resources. When enough resources have been accumulated, a rule utilizes some of its resources to reproduce and the reservoir level is reduced accordingly. Preliminary tests of this system on the multiplexor problem show that it performs as well as utility-based classifier systems such as XCS.

Keywords

Reinforcement Event Reservoir Level Input String Average Reward Rule Discovery 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Booker, L. B. Classifier systems that learn internal world models. Machine Learning 3 (1988), 161–192.Google Scholar
  2. 2.
    Booker, L. B. Triggered rule discovery in classifier systems. In Proceedings of the Third International Conference on Genetic Algorithms (ICGA89) (Fairfax, VA, 1989), J. D. Schaffer, Ed., Morgan Kaufmann, pp. 265–274.Google Scholar
  3. 3.
    Holland, J. H. Adaptation. In Progress in theoretical biology, R. Rosen and F. M. Snell, Eds., vol. 4. Academic Press, New York, 1976.Google Scholar
  4. 4.
    Holland, J. H. Escaping brittleness: The possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In Machine learning: An artificial intelligence approach, R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Eds., vol. II. Morgan Kaufmann, Los Altos, CA, 1986, ch. 20, pp. 593–623.Google Scholar
  5. 5.
    Holland, J. H. Echoing emergence: Objectives, rough definitions, and speculations for Echo-class models. In Complexity: Metaphors, Models, and Reality, G. Cowan, D. Pines, and D. Melzner, Eds., vol. XIX of Santa Fe Institute Studies in the Sciences. of Complexity. Addison-Wesley, Reading, MA, 1994, pp. 309–342.Google Scholar
  6. 6.
    Horn, J., Goldberg, D. E., and Deb, K. Implicit niching in a learning classifier system: Nature’s way. Evolutionary Computation 2,1 (1994), 37–66.CrossRefGoogle Scholar
  7. 7.
    Smith, R. E., Forrest, S., and Perelson, A. S. Searching for diverse, cooperative populations with genetic algorithms. Evolutionary Computation 1,2 (1993), 127–149.CrossRefGoogle Scholar
  8. 8.
    Wilson, S. W. Classifier fitness based on accuracy. Evolutionary Computation 3,2 (1995), 149–175.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Lashon B. Booker
    • 1
  1. 1.The MITRE CorporationMcLeanUSA

Personalised recommendations