On Improving Generalisation in Genetic Programming

  • Dan Costelloe
  • Conor Ryan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5481)


This paper is concerned with the generalisation performance of GP. We examine the generalisation of GP on some well-studied test problems and also critically examine the performance of some well known GP improvements from a generalisation perspective. From this, the need for GP practitioners to provide more accurate reports on the generalisation performance of their systems on problems studied is highlighted. Based on the results achieved, it is shown that improvements in training performance thanks to GP-enhancements represent only half of the battle.


Test Problem Genetic Program Generalisation Performance Linear Scaling Unseen Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Keijzer, M.: Improving Symbolic Regression with Interval Arithmetic and Linear Scaling. In: Ryan, C., Soule, T., Keijzer, M., Tsang, E., Poli, R., Costa, E. (eds.) EuroGP 2003. LNCS, vol. 2610, pp. 70–82. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  2. 2.
    Gustafson, S., Burke, E.K., Krasnogor, N.: On improving genetic programming for symbolic regression. In: Corne, D., Michalewicz, Z., Dorigo, M., Eiben, G., Fogel, D., Fonseca, C., Greenwood, G., Chen, T.K., Raidl, G., Zalzala, A., Lucas, S., Paechter, B., Willies, J., Guervos, J.J.M., Eberbach, E., McKay, B., Channon, A., Tiwari, A., Volkert, L.G., Ashlock, D., Schoenauer, M. (eds.) Proceedings of the 2005 IEEE Congress on Evolutionary Computation, Edinburgh, UK, vol. 1, pp. 912–919. IEEE Press, Los Alamitos (2005)CrossRefGoogle Scholar
  3. 3.
    Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)zbMATHGoogle Scholar
  4. 4.
    Luke, S., Panait, L.: Is the perfect the enemy of the good? In: GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 820–828. Morgan Kaufmann Publishers Inc., San Francisco (2002)Google Scholar
  5. 5.
    Vanneschi, L., Tomassini, M., Collard, P., Clergue, M.: A survey of problem difficulty in genetic programming. In: Bandini, S., Manzoni, S. (eds.) AI*IA 2005. LNCS, vol. 3673, pp. 66–77. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  6. 6.
    Costelloe, D.: gpsr: Genetic Programming for Symbolic Regression,
  7. 7.
    Fernandez, T., Evett, M.: Numeric mutation as an improvement to symbolic regression in genetic programming. In: William Porto, V., Saravanan, N., Waagen, D., Eiben, A.E. (eds.) EP 1998. LNCS, vol. 1447, pp. 251–260. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  8. 8.
    Topchy, A., Punch, W.F.: Faster genetic programming based on local gradient search of numeric leaf values. In: Spector, L., Goodman, E.D., Wu, A., Langdon, W.B., Voigt, H.-M., Gen, M., Sen, S., Dorigo, M., Pezeshk, S., Garzon, M.H., Burke, E. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2001), pp. 155–162. Morgan Kaufmann, San Francisco (2001)Google Scholar
  9. 9.
    Keijzer, M.: Scaled symbolic regression. Genetic Programming and Evolvable Machines 5(3), 259–269 (2004)CrossRefGoogle Scholar
  10. 10.
    Raja, A., Azad, R.M.A., Flanagan, C., Ryan, C.: Real-time, non-intrusive evaluation of voIP. In: Ebner, M., O’Neill, M., Ekárt, A., Vanneschi, L., Esparcia-Alcázar, A.I. (eds.) EuroGP 2007. LNCS, vol. 4445, pp. 217–228. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  11. 11.
    Majeed, H., Ryan, C.: A re-examination of a real world blood flow modeling problem using context-aware crossover. In: Riolo, R.L., Soule, T., Worzel, B. (eds.) Genetic Programming Theory and Practice IV, May 11-13, 2006. Genetic and Evolutionary Computation, ch.14, vol. 5. Springer, Ann Arbor (2006)Google Scholar
  12. 12.
    Valigiani, G., Fonlupt, C., Collet, P.: Analysis of GP improvement techniques over the real-world inverse problem of ocean color. In: Keijzer, M., O’Reilly, U.-M., Lucas, S., Costa, E., Soule, T. (eds.) EuroGP 2004. LNCS, vol. 3003, pp. 174–186. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  13. 13.
    Wasserman, L.: All of Statistics: A Concise Course in Statistical Inference (Springer Texts in Statistics). Springer, Heidelberg (2004)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Dan Costelloe
    • 1
  • Conor Ryan
    • 1
  1. 1.BDS Group, Department of Computer Science and Information SystemsUniversity of LimerickLimerickIreland

Personalised recommendations