Abstract
We analyze generalization with the XCS classifier system when the system is applied to animat problems in grid-worlds. Our aim is to give a unified view of generalization with XCS, in order to explain some of the phenomena reported in the literature. Initially, we apply XCS to two environments. Our results show that there are situations in which the generalization mechanism of XCS may prevent the system from converging to optimum. Accordingly, we study XCS's generalization mechanism analyzing the conditions under which the system may fail to evolve an optimal solution. We draw a hypothesis in order to explain the results reported so far. Our hypothesis suggests that XCS fails to learn an optimal solution when, due to the environment structure and to the exploration strategy employed, the system does not explore all the areas of the environment frequently. We thus introduce a meta exploration strategy that is used as theoretical tool to validate our hypothesis experimentally.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Dave Cliff and Susi Ross. Adding memory to ZCS. Adaptive Behaviour, 3(2):101–150, 1994.
Pier Luca Lanzi. A Model of the Environment to Avoid Local Learning (An Analysis of the Generalization Mechanism of XCS). Technical Report 97.46, Dipartimento di Elettronica e Informazione — Politecnico di Milano, 1997. Available at http://www.elet.polimi.it/people/lanzi/listpub.html.
Pier Luca Lanzi. Solving Problems in Partially Observable Environments with Classifier Systems (Experiments on Adding Memory to XCS). Technical Report 97.45, Dipartimento di Elettronica e Informazione — Politecnico di Milano, 1997. Available at http://www.elet.polimi.it/people/lanzi/listpub.html.
Pier Luca Lanzi. A Study on the Generalization Capabilities of XCS. In Proceedings of the Seventh International Conference on Genetic Algorithms. Morgan Kaufmann, 1997.
Stewart W. Wilson. ZCS: a zeroth level classifier system. Evolutionary Computation, 1(2):1–18, 1994.
Stewart W. Wilson. Classifier fitness based on accuracy. Evolutionary Computation, 3(2):149–175, 1995.
Stewart W. Wilson. Personal communication. 1997.
Stewart W. Wilson. Generalization in the XCS classifier system. In MIT Press, editor, Proceedings of the Third Annual Genetic Programming Conference (GP-98), 1998.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lanzi, P.L. (1998). Generalization in Wilson's classifier system. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, HP. (eds) Parallel Problem Solving from Nature — PPSN V. PPSN 1998. Lecture Notes in Computer Science, vol 1498. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0056892
Download citation
DOI: https://doi.org/10.1007/BFb0056892
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65078-2
Online ISBN: 978-3-540-49672-4
eBook Packages: Springer Book Archive