Abstract
The use and benefits of self-adaptive parameters, particularly mutation, are well-known within evolutionary computing. In this paper we examine the use of parameter self-adaptation in Michigan-style Classifier Systems with the aim of improving their performance and ease of use. We implement a fully self-adaptive ZCS classifier and examine its performance in a multi-step environment. It is shown that the mutation rate, learning rate, discount factor and tax rate can be developed along with an appropriate solution/rule-base, resulting in improved performance over results using fixed rate parameters. We go on to show that the benefits of self-adaptation are particularly marked in non-stationary environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Angeline, P. J., Fogel, D. B., Fogel, L. J. (1996) A Comparison of Self-Adaptation Methods for Finite State Machines in a Dynamic Environment. In L. J. Fogel, P. J. Angeline, & T. Bäck (eds.) Evolutionary Programming V, MIT Press, pp. 441–449.
Bäck, T. (1992) Self-Adaptation in Genetic Algorithms. In F.J. Varela & P. Bourgine (eds.) Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life, MIT Press, pp263–271.
Bäck, T. (1998) On the Behaviour of Evolutionary Algorithms in Dynamic Environments. In Proceedings of the Fifth IEEE Conference on Evolutionary Computation, IEEE Press, pp.446–451.
Bull, L. & Hurst, J. (2000) Self-Adaptive Mutation in ZCS Controllers. In S. Cagnoni, R. Poli, G. Smith, D. Corne, M. Oates, E. Hart, P-L. Lanzi, E. Willem, Y. Li, B. Paecther & T. C. Fogarty (eds) Real-World Applications of Evolutionary Computing: Proceedings of the EvoNet Workshops-EvoRob 2000. Springer, pp339–346.
Bull, L. Hurst, J. & Tomlinson, A. (2000) Self-Adaptive Mutation in Classifier System Controllers. In J-A. Meyer, A. Berthoz, D. Floreano, H. Roitblatt & S. W. Wilson (eds) From Animals to Animats 6-The Sixth International Conference on the Simulation of Adaptive Behaviour, MIT Press.
Fogel, D. B. (1992) Evolving Artificial Intelligence. PhD dissertation, University of California.
Hartley, A. R. (1999) Accuracy-based Fitness Allows Similar Performance to Humans in Static and Dynamic Classification Environments. In W. Banzaff, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela & R. E. Smith (eds) Proceedings of the Genetic and Evolutionary Computation Conference-Gecco’99, Morgan Kauffman, pp. 266–273.
Holland, J. H. (1975) Adaptation in Natural and Artificial Systems. University of Michigan Press.
Holland, J. H., Holyoak, K. J., Nisbett, R. E. & Thagard, P. R. (1986) Induction: Processes of Inference, Learning and Discovery.
Hurst, J., Bull, L. Using a self-adaptive learning rate in ZCS (2000) to appear in University of West of England CSM Technical Reports 2000.
Koza, J. R. (1991) Genetic Programming. MIT Press.
Rechenberg, I. (1973) Evolutionsstrategie; Optimierung technischer Systeme nach Prinzipen der biologischen Evolution. Frommann-Holzboog Verlag.
Ross, S., Cliff, D. (1995) “Adding temporary memory to ZCS”, Adaptive Behavior, 3(2):101–150, MIT Press
Watkins, C. (1989) Learning from Delayed Rewards. PhD dissertation, University of Cambridge.
Wilson, S. W. (1985) Knowledge Growth in an Artificial Animal. In J. J. Grefenstette (ed.) Proceedings of the First International Conference on Genetic Algorithms and their Applications, Lawrence Erlbaum Associates, pp 16–23.
Wilson, S.W. (1987) Classifier Systems and the Animat Problem. Machine Learning 2:199–228.
Wilson, S. W. (1994) ZCS: A Zeroth-level Classifier System. Evolutionary Computation 2(1):1–18.
Wilson, S. W. (1995) Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2):149–177.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hurst, J., Bull, L. (2001). A Self-Adaptive Classifier System. In: Luca Lanzi, P., Stolzmann, W., Wilson, S.W. (eds) Advances in Learning Classifier Systems. IWLCS 2000. Lecture Notes in Computer Science(), vol 1996. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44640-0_6
Download citation
DOI: https://doi.org/10.1007/3-540-44640-0_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42437-6
Online ISBN: 978-3-540-44640-8
eBook Packages: Springer Book Archive