Skip to main content

Finding Building Blocks through Eigenstructure Adaptation

  • Conference paper
  • First Online:
Genetic and Evolutionary Computation — GECCO 2003 (GECCO 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2724))

Included in the following conference series:

Abstract

A fundamental aspect of many evolutionary approaches to synthesis of complex systems is the need to compose atomic elements into useful higher-level building blocks. However, the ability of genetic algorithms to promote useful building blocks is based critically on genetic linkage — the assumption that functionally related alleles are also arranged compactly on the genome. In many practical problems, linkage is not known a priori or may change dynamically. Here we propose that a problem’s Hessian matrix reveals this linkage, and that an eigenstructure analysis of the Hessian provides a transformation of the problem to a space where first-order genetic linkage is optimal. Genetic algorithms that dynamically transforms the problem space can operate much more efficiently. We demonstrate the proposed approach on a real-valued adaptation of Kaufmann’s NK landscapes and discuss methods for extending it to higher-order linkage.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chen, Y.-P., Goldberg, D.E. Introducing start expression genes to the linkage learning genetic algorithm. Proceedings of the Parallel Problem Solving from Nature Conference (PPSN VII). Berlin, Germany: Springer, 351–360, 2002.

    Chapter  Google Scholar 

  2. Cristianini N., Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, 2000.

    Google Scholar 

  3. De Jong, K. An analysis of the behaviour of a class of genetic adaptive systems. PhD thesis, University of Michigan, 1975.

    Google Scholar 

  4. Goldberg, D., Korb, B., and Deb, K. Messy Genetic Algorithms: Motivation, Analysis, and First Results. Complex Systems, 4:415–444, 1989.

    MathSciNet  Google Scholar 

  5. Holland, J.H. Adaptation in Natural and Artificial Systems University of Michigan Press, Ann Arbor, 1975.

    Google Scholar 

  6. Kauffman, S. The Origins of Order: Self-Organization and Selection in Evolution. Oxford University Press, 1993.

    Google Scholar 

  7. Koza J. Hierarchical genetic algorithms operating on populations of computer programs. 11th Int. joint conference on genetic algorithms, 768–774, 1989.

    Google Scholar 

  8. Lipson H., Siegelmann H.T. High Order Eigentensors as Symbolic Rules in Competitive Learning. in Hybrid Neural Systems, S. Wermter, R. Sun (Eds.) Springer, LNCS 1778, 286–297, 2002.

    Chapter  Google Scholar 

  9. Mahfoud S. Niching Methods for Genetic Algorithms. IlliGAL Report No. 95001, University of Illinois at Urbana-Champaign, 77–80, 1995.

    Google Scholar 

  10. Watson, R.A., Pollack, J.B. A Computational Model of Symbiotic Composition in Evolutionary Transitions Biosystems. to appear in 2003.

    Google Scholar 

  11. Harik, G., and Goldberg, D.E. Learning linkage. Foundations of Genetic Algorithms 4:247–262, 1997.

    Google Scholar 

  12. Kargupta, H. The gene expression messy genetic algorithm. Proceedings of the 1996 IEEE International Conference on Evolutionary Computation. Nagoya University, Japan, 631–636, 1996.

    Chapter  Google Scholar 

  13. Bertsekas, D.P. Non-linear Programming. Athena Scientific, Belmont, MA, 134–141, 1995.

    Google Scholar 

  14. Shanno, D.F. Conditioning of quasi-Newton methods for function minimization. Mathematics of Computation 24:647–656, 1970.

    Article  MathSciNet  Google Scholar 

  15. Stanley, K.O., Miikkulainen, R. Achieving High-Level Functionality Through Complexification. Proceedings of the AAAI 2003 Spring Symposium on Computational Synthesis. Stanford, CA: AAAI Press, 2003.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wyatt, D., Lipson, H. (2003). Finding Building Blocks through Eigenstructure Adaptation. In: Cantú-Paz, E., et al. Genetic and Evolutionary Computation — GECCO 2003. GECCO 2003. Lecture Notes in Computer Science, vol 2724. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45110-2_23

Download citation

  • DOI: https://doi.org/10.1007/3-540-45110-2_23

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40603-7

  • Online ISBN: 978-3-540-45110-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics