Abstract
XCS with computed prediction, namely XCSF, extends XCS by replacing the classifier prediction with a parametrized prediction function. Although several types of prediction functions have been introduced, so far XCSF models are still limited to evolving classifiers with the same prediction function. In this paper, we introduce XCSF with heterogeneous predictors, XCSFHP, which allows the evolution of classifiers with different types of prediction function within the same population. We compared XCSFHP to XCSF on several problems. Our results suggest that XCSFHP generally performs as XCSF with the most appropriate prediction function for the given problem. In particular, XCSFHP seems able to evolve, in each problem subspace, the most adequate type of prediction function.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bagnall, A.J., Smith, G.D.: Using an Adaptive Agent to Bid in a Simplified Model of the UK Market in Electricity. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), p. 774 (1999); One page poster paper
Boyan, J.A., Moore, A.W.: Generalization in reinforcement learning: Safely approximating the value function. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (eds.) Advances in Neural Information Processing Systems 7, pp. 369–376. MIT Press, Cambridge (1995)
Bull, L.: On using ZCS in a Simulated Continuous Double-Auction Market. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 83–90 (1999)
Bull, L., Studley, M., Bagnall, A., Whittley, I.: Learning classifier system ensembles with rule-sharing. IEEE Transactions on Evolutionary Computation 11(4), 496–502 (2007)
Bull, L., Studley, M., Bagnall, T., Whittley, I.: On the use of rule-sharing in learning classifier system ensembles. In: The 2005 IEEE Congress on Evolutionary Computation, 2005, vol. 1, pp. 612–617 (2005)
Butz, M.V.: Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system. In: Beyer, H.-G., O’Reilly, U.-M., Arnold, D.V., Banzhaf, W., Blum, C., Bonabeau, E.W., Cantu-Paz, E., Dasgupta, D., Deb, K., Foster, J.A., de Jong, E.D., Lipson, H., Llora, X., Mancoridis, S., Pelikan, M., Raidl, G.R., Soule, T., Tyrrell, A.M., Watson, J.-P., Zitzler, E. (eds.) GECCO 2005: Proceedings of the 2005 conference on Genetic and evolutionary computation, 25-29 June 2005, vol. 2, pp. 1835–1842. ACM Press, Washington (2005)
Butz, M.V., Wilson, S.W.: An Algorithmic Description of XCS. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2000. LNCS (LNAI), vol. 1996, pp. 253–272. Springer, Heidelberg (2001)
Dorigo, M., Colombetti, M.: Robot Shaping: An Experiment in Behavior Engineering. MIT Press/Bradford Books (1998)
Lanzi, P.L.: The XCS library (2002), http://xcslib.sourceforge.net
Lanzi, P.L., Loiacono, D.: XCSF with neural prediction. In: Evolutionary Computation, 2006. CEC 2006. IEEE Congress on, pp. 2270–2276 (2006)
Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: Extending XCSF beyond linear approximation. In: Genetic and Evolutionary Computation – GECCO-2005, pp. 1859–1866. ACM Press, Washington (2005)
Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: XCS with computed prediction for the learning of boolean functions. In: Proceedings of the IEEE Congress on Evolutionary Computation – CEC-2005, Edinburgh, UK, September 2005, pp. 588–595. IEEE, Los Alamitos (2005)
Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: XCS with computed prediction in continuous multistep environments. In: Proceedings of the IEEE Congress on Evolutionary Computation – CEC-2005, Edinburgh, UK, September 2005, pp. 2032–2039. IEEE, Los Alamitos (2005)
Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: XCS with computed prediction in multistep environments. In: GECCO 2005: Proceedings of the 2005 conference on Genetic and evolutionary computation, pp. 1859–1866. ACM Press, New York (2005)
Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: Generalization in the XCSF classifier system: Analysis, improvement, and extension. Evolutionary Computation 15(2), 133–168 (2007)
Llora, X., Wilson, S.W.: Mixed decision trees: Minimizing knowledge representation bias in LCS. In: Deb, K., Poli, R., Banzhaf, W., Beyer, H.-G., Burke, E.K., Darwen, P.J., Dasgupta, D., Floreano, D., Foster, J.A., Harman, M., Holland, O., Lanzi, P.L., Spector, L., Tettamanzi, A., Thierens, D., Tyrrell, A.M. (eds.) GECCO 2004. LNCS, vol. 3103, pp. 797–809. Springer, Heidelberg (2004)
Loiacono, D., Lanzi, P.L.: Evolving neural networks for classifier prediction with XCSF. In: Proceedings of the Second Italian Workshop on Evolutionary Computation, ISSN 1970–5077 (2006)
Loiacono, D., Marelli, A., Lanzi, P.L.: Support vector regression for classifier prediction. In: GECCO 2007: Proceedings of the 9th annual conference on Genetic and evolutionary computation, pp. 1806–1813. ACM Press, New York (2007)
Widrow, B., Hoff, M.E.: Neurocomputing: Foundation of Research. In: Adaptive Switching Circuits, pp. 126–134. MIT Press, Cambridge (1988)
Wilson, S.W.: Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2), 149–175 (1995)
Wilson, S.W.: Mining Oblique Data with XCS. In: Proceedings of the International Workshop on Learning Classifier Systems (IWLCS-2000), in the Joint Workshops of SAB 2000 and PPSN 2000, pp. 158–174 (2000)
Wilson, S.W.: Classifiers that approximate functions. Journal of Natural Computing 1(2-3), 211–234 (2002)
Wilson, S.W.: Classifier systems for continuous payoff environments. In: Deb, K., et al. (eds.) GECCO 2004. LNCS, vol. 3103, pp. 824–835. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lanzi, P.L., Loiacono, D., Zanini, M. (2008). Evolving Classifiers Ensembles with Heterogeneous Predictors. In: Bacardit, J., Bernadó-Mansilla, E., Butz, M.V., Kovacs, T., Llorà , X., Takadama, K. (eds) Learning Classifier Systems. IWLCS IWLCS 2006 2007. Lecture Notes in Computer Science(), vol 4998. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88138-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-88138-4_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88137-7
Online ISBN: 978-3-540-88138-4
eBook Packages: Computer ScienceComputer Science (R0)