Abstract
This article describes several modifications performed to the credit assignment mechanism of Goldberg’s Simple Classifier System [4] and the results obtained when solving a problem that requires the formation of classifier chains. The first set of these modifications included changes to the formula used to compute the effective bid of a classifier by taking into consideration the reputation of the classifier and the maximum bid of the previous auction in which a classifier was active. Noise was made proportional to the strength of the classifier and specificity was incorporated as an additional term in the formula that is independent from the bid coefficient. A second set of changes was related to the manner in which classifiers belonging to a chain may receive a payoff or a penalty from the environment in addition to the payments obtained from succeeding classifiers. We also tested the effect that bridge classifiers [13] have in the solution of the example problem by allowing the creation of shorter chains. Some experiments in which classifiers were better informed gave better results than those in which only the noise and the specificity were included in the computation of the effective bid.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barry, A.: Aliasing in XCS and the Consecutive State Problem: 1 - Effects. In: Banzhaf, W., et al. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference GECO 1999, pp. 19–26. Morgan Kauffman, San Francisco (1999)
Barry, A.: Aliasing in XCS and the Consecutive State Problem: 2 - Solutions. In: Banzhaf, W., et al. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference GECO 1999, pp. 27–34. Morgan Kauffman, San Francisco (1999)
Compiani, M., Montanari, D., Serra, R.: Asymptotic Dynamics of Classifier Systems. In: Schaeffer, J.D. (ed.) Proceedings of the Third International Conference on Genetic Algorithms, pp. 298–303. Morgan Kaufmann, San Francisco (1989)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, Reading (1989)
Goldberg, D.E.: Probability Matching, the Magnitude of Reinforcement, and Classifier System Bidding. Machine Learning 5, 407–425 (1990)
Grefenstette, J.J.: Multilevel Credit Assignment in a Genetic Learning System. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms, pp. 202–209. Lawerence Erlbaum Assoc., Mahwah (1987)
Grefenstette, J.J., Ramsey, C.L., Schultz, A.C.: Learning Sequential Decision Rules Using Simulation Models and Competition. Machine Learning 5, 355–381 (1990)
Holland, J.H.: Genetic Algorithms and Classifier Systems: Foundations and Future Directions. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms, pp. 82–89. Lawerence Erlbaum Assoc., Mahwah (1987)
Huang, D.: A Framework for the Credit-Apportionment Process in Rule-Based Systems. IEEE Transactions on Systems, Man and Cybernetics 19(3), 289–4998 (1989)
Miller, I., Freund, J.: Probability and Statistics for Engineers. Prentice Hall, Englewood Cliffs (1986)
Orellana-Moyao, D.R.: Modificaciones al Mecanismo de Asignación de Crédito de un Sistema Clasificador Básico, Instituto Tecnológico Autónomo de México: México, D.F (1998)
Richards, R.A.: Zeroth-order Shape Optimization Utilizing a Learning Classifier System. In: Mechanical Engineering Department. Stanford University, Stanford (1995)
Riolo, R.L.: Bucket Brigade Performance: I. Long Sequences of Classifiers. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms, pp. 184–195. Lawerence Erlbaum Assoc., Mahwah (1987)
Riolo, R.L.: Bucket Brigade Performance: II. Default Hierarchies. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms, pp. 196–201. Lawerence Erlbaum Assoc., Mahwah (1987)
Twardowski, K.: Credit Assignment for Pole Balancing with Learning Classifier Systems. In: Forrest, S. (ed.) Proceedings of the Fifth International Conference on Genetic Algorithms, pp. 238–245 (1993)
Watkins, C.J.C.H.: Learning from Delayed Rewards. Cambridge University, Cambridge (1989)
Westerdale, T.H.: Altruism in the Bucket Brigade. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms, pp. 22–26. Lawerence Erlbaum Assoc., Mahwah (1987)
Westerdale, T.H.: A Defense of the Bucket Brigade. In: Schaeffer, J.D. (ed.) Proceedings of the Third International Conference on Genetic Algorithms, pp. 282–290. Morgan Kaufmann, San Francisco (1989)
Wilson, S.W.: ZCS: A Zeroth Level Classifier System. Evolutionary Computation 2(1), 1–18 (1994)
Wilson, S.W.: Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2), 149–175 (1995)
Wilson, S.W., Goldberg, D.E.: A Critical Review of Classifier Systems. In: Schaeffer, J.D. (ed.) Proceedings of the Third International Conference on Genetic Algorithms, pp. 244–255. Morgan Kaufmann, San Francisco (1989)
Yates, D.F., Farley, A.: An Investigation into Possible Causes of, and Solutions to, Rule Strength Distortion Due to the Bucket Brigade Algorithm. In: Forrest, S. (ed.) Proceedings of the Fifth International Conference on Genetic Algorithms, pp. 246–253. Morgan Kaufmann, San Francisco (1993)
Zozaya-Gorostiza, C., Díaz-Infante, E.: Planning by Merging Totally Ordered Object Plans. Journal of Expert Systems with Applications 14(1/2) (1998)
Zozaya-Gorostiza, C., Estrada, L.F.: Incorporating Heuristics and a Meta-Architecture in a Genetic Algorithm for Harness Design. In: Gero, J., Sudweeks, F. (eds.) Advances in Formal Design Methods for Computer Aided Design (1994); IFIP WG5.2
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zozaya-Gorostiza, C., Orellana-Moyao, D.R. (2000). Modifications to the Credit Apportionment Mechanism of a Simple Classifier System. In: Cairó, O., Sucar, L.E., Cantu, F.J. (eds) MICAI 2000: Advances in Artificial Intelligence. MICAI 2000. Lecture Notes in Computer Science(), vol 1793. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10720076_22
Download citation
DOI: https://doi.org/10.1007/10720076_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67354-5
Online ISBN: 978-3-540-45562-2
eBook Packages: Springer Book Archive