Abstract
Classifier systems have traditionally used explicit measures of utility (strength, predicted payoff, accuracy, etc.) to quantify the performance and fitness of classifier rules. Much of the effort in designing and implementing classifier systems has focused on getting these utilities “right”. One alternative worth exploring is the idea of using endogenous fitness; that is, reinforcing successful performance with “resources” that rules need in order to reproduce. Under this regime, the best rules are those that accumulate the most resources over their lifetime and, consequently, have the most offspring. This paper describes a classifier system designed along these lines. Rules have no associated utility measure. Instead, each rule has one or more reservoirs that can be used to store resources. When enough resources have been accumulated, a rule utilizes some of its resources to reproduce and the reservoir level is reduced accordingly. Preliminary tests of this system on the multiplexor problem show that it performs as well as utility-based classifier systems such as XCS.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Booker, L. B. Classifier systems that learn internal world models. Machine Learning 3 (1988), 161–192.
Booker, L. B. Triggered rule discovery in classifier systems. In Proceedings of the Third International Conference on Genetic Algorithms (ICGA89) (Fairfax, VA, 1989), J. D. Schaffer, Ed., Morgan Kaufmann, pp. 265–274.
Holland, J. H. Adaptation. In Progress in theoretical biology, R. Rosen and F. M. Snell, Eds., vol. 4. Academic Press, New York, 1976.
Holland, J. H. Escaping brittleness: The possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In Machine learning: An artificial intelligence approach, R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Eds., vol. II. Morgan Kaufmann, Los Altos, CA, 1986, ch. 20, pp. 593–623.
Holland, J. H. Echoing emergence: Objectives, rough definitions, and speculations for Echo-class models. In Complexity: Metaphors, Models, and Reality, G. Cowan, D. Pines, and D. Melzner, Eds., vol. XIX of Santa Fe Institute Studies in the Sciences. of Complexity. Addison-Wesley, Reading, MA, 1994, pp. 309–342.
Horn, J., Goldberg, D. E., and Deb, K. Implicit niching in a learning classifier system: Nature’s way. Evolutionary Computation 2,1 (1994), 37–66.
Smith, R. E., Forrest, S., and Perelson, A. S. Searching for diverse, cooperative populations with genetic algorithms. Evolutionary Computation 1,2 (1993), 127–149.
Wilson, S. W. Classifier fitness based on accuracy. Evolutionary Computation 3,2 (1995), 149–175.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Booker, L.B. (2000). Do We Really Need to Estimate Rule Utilities in Classifier Systems?. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds) Learning Classifier Systems. IWLCS 1999. Lecture Notes in Computer Science(), vol 1813. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45027-0_6
Download citation
DOI: https://doi.org/10.1007/3-540-45027-0_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67729-1
Online ISBN: 978-3-540-45027-6
eBook Packages: Springer Book Archive