Advertisement

Automatic synthesis of both the topology and numerical parameters for complex structures using genetic programming

  • John R. Koza
Chapter

Abstract

This chapter demonstrates that genetic programming can automatically create complex structures from a high-level statement of the structure’s purpose. The chapter presents results produced by genetic programming that are from problem areas where there is no known general mathematical technique for automatically creating a satisfactory structure. The results include automatically synthesising (designing) both the topology (graphical arrangement of components) and sizing (component values) for two illustrative analog electrical circuits and automatically synthesising both the topology and tuning (component values) for a controller. Genetic programming not only succeeds in producing the required structure, but the structure is competitive with that produced by creative human designers. The claim that genetic programming has produced human-competitive results is supported by the fact that the automatically created results infringe on previously issued patents, improve on previously patented inventions, or duplicate the functionality of previously patented inventions.

Keywords

Genetic Programming Fitness Measure Preparatory Step Automatic Synthesis Fitness Case 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Dorf RC, Bishop RH. Modern control systems. 8th ed. Menlo Park (CA): Addison-Wesley, 1998.MATHGoogle Scholar
  2. [2]
    Voit EO. Computational analysis of biochemical systems. Cambridge: Cambridge University Press, 2000.Google Scholar
  3. [3]
    Koza JR. Genetic programming: on the programming of computers by means of natural selection. Cambridge (MA): MIT Press, 1992.MATHGoogle Scholar
  4. [4]
    Koza JR, Rice JP. Genetic programming: the movie. Cambridge (MA): MIT Press, 1992.Google Scholar
  5. [5]
    Koza JR. Genetic programming II: automatic discovery of reusable programs. Cambridge (MA): MIT Press, 1994.MATHGoogle Scholar
  6. [6]
    Koza JR. Genetic programming II videotape: the next generation. Cambridge (MA): MIT Press, 1994.Google Scholar
  7. [7]
    Koza JR, Bennett FH III, Andre D, Keane MA. Genetic programming III: Darwinian invention and problem solving. San Francisco (CA): Morgan Kaufmann, 1999.Google Scholar
  8. [8]
    Koza JR, Bennett FH III, Andre D, Keane MA, Brave S. Genetic programming III videotape: human-competitive machine intelligence. San Francisco (CA): Morgan Kaufmann, 1999.Google Scholar
  9. [9]
    Holland JH. Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. Ann Arbor (MI): University of Michigan Press, 1975 [2nd ed. Cambridge (MA): MIT Press, 1992].Google Scholar
  10. [10]
    Banzhaf W, Nordin P, Keller RE, Francone FD. Genetic programming — an introduction. San Francisco (CA)/Heidelberg: Morgan Kaufmann/dpunkt, 1998.MATHCrossRefGoogle Scholar
  11. [11]
    Langdon WB. Genetic programming and data structures: genetic programming + data structures = automatic programming! Amsterdam: Kluwer, 1998.MATHCrossRefGoogle Scholar
  12. [12]
    Ryan C. Automatic re-engineering of software using genetic programming. Amsterdam: Kluwer, 1999.Google Scholar
  13. [13]
    Wong ML, Leung KS. Data mining using grammar based genetic programming and applications. Amsterdam: Kluwer, 2000 [ISBN: 0–7923–7746-X].MATHGoogle Scholar
  14. [14]
    Kinnear KE Jr, editor. Advances in genetic programming. Cambridge (MA): MIT Press, 1994.Google Scholar
  15. [15]
    Angeline PJ, Kinnear KE Jr, editors. Advances in genetic programming 2. Cambridge (MA): MIT Press, 1996.Google Scholar
  16. [16]
    Spector L, Langdon WB, O’Reilly U-M, Angeline P, editors. Advances in genetic programming 3. Cambridge (MA): MIT Press, 1999.Google Scholar
  17. [17]
    Koza JR, Goldberg DE, Fogel DB, Riolo RL, editors. Genetic Programming 1996: Proceedings of the First Annual Conference, 28–31 July, Stanford University. Cambridge (MA): MIT Press, 1996.Google Scholar
  18. [18]
    Koza JR, Deb K, Dorigo M, Fogel DB, Garzon M, Iba H, et al., editors. Genetic Programming 1997: Proceedings of the Second Annual Conference, 13–16 July, Stanford University. San Francisco (CA): Morgan Kaufmann, 1997.Google Scholar
  19. [19]
    Koza JR, Banzhaf W, Chellapilla K, Deb K, Dorigo M, Fogel DB, et al., editors. Genetic Programming 1998: Proceedings of the Third Annual Conference. San Francisco (CA): Morgan Kaufmann, 1998.Google Scholar
  20. [20]
    Banzhaf W, Daida J, Eiben AE, Garzon MH, Honavar V, Jakiela M, et al., editors. GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference, 13–17 July, Orlando, FL, USA. San Francisco (CA): Morgan Kaufmann, 1999.Google Scholar
  21. [21]
    Whitley D, Goldberg D, Cantu-Paz E, Spector L, Parmee I, Beyer H-G, editors. GECCO-2000: Proceedings of the Genetic and Evolutionary Computation Conference, 10–12 July, Las Vegas, NV. San Francisco (CA): Morgan Kaufmann, 2000.Google Scholar
  22. [22]
    Banzhaf W, Poli R, Schoenauer M, Fogarty TC. In: Genetic Programming: First European Workshop. EuroGP’98. April 1998 Proceedings. Paris, France. Lecture notes in computer science, vol. 1391. Berlin (Germany): Springer, 1998.Google Scholar
  23. [23]
    Poli R, Nordin P, Langdon WB, Fogarty TC. In: Genetic Programming: Second European Workshop. EuroGP’99. Proceedings. Lecture notes in computer science, vol. 1598. Berlin (Germany): Springer, 1999.Google Scholar
  24. [24]
    Poli R, Banzhaf W, Langdon WB, Miller J, Nordin P, Fogarty TC. In: Genetic Programming: European Conference, EuroGP 2000, Edinburgh, Scotland, UK, April 2000 Proceedings. Lecture notes in computer science, vol. 1802. Berlin (Germany): Springer, 2000.Google Scholar
  25. [25]
    Aaserud O, Nielsen IR. Trends in current analog design: a panel debate. Analog Integr Circuits Signal Process 1995;7(1):5–9.CrossRefGoogle Scholar
  26. [26]
    Quarles T, Newton AR, Pederson DO, Sangiovanni-Vincentelli A. SPICE 3 version 3F5 user’s manual. Berkeley (CA): Department of Electrical Engineering and Computer Science, University of California, 1994.Google Scholar
  27. [27]
    Campbell GA. Electric wave filter. US Patent 1,227,113, filed 15 July 1915, issued 22 May 1917.Google Scholar
  28. [28]
    Zobel OJ. Wave filter. US Patent 1,538,964, filed 15 January 1921, issued 26 May 1925.Google Scholar
  29. [29]
    Mydlowec W, Koza J. Use of time-domain simulations in automatic synthesis of computational circuits using genetic programming. In: Late Breaking Papers at the 2000 Genetic and Evolutionary Computation Conference, Las Vegas, NV. 2000; 187–97.Google Scholar
  30. [30]
    Keane MA, Yu J, Koza JR. Automatic synthesis of both the topology and tuning of a common parameterized controller for two families of plants using genetic programming. In: Whitley D, Goldberg D, Cantu-Paz E, Spector L, Parmee I, Beyer H-G, editors. GECCO-2000: Proceedings of the Genetic and Evolutionary Computation Conference, 10–12 July, Las Vegas, NV. San Francisco (CA): Morgan Kaufmann, 2000; 496–504.Google Scholar
  31. [31]
    Koza JR, Keane MA, Yu J, Bennett FH III, Mydlowec W, Stiffelman O. Automatic synthesis of both the topology and parameters for a robust controller for a non-minimal phase plant and a three-lag plant by means of genetic programming. In: Proceedings of 1999 IEEE Conference on Decision and Control, 1999; 5292–300.Google Scholar
  32. [32]
    Koza JR, Keane, MA, Bennett FH III, Yu J, Mydlowec W, Stiffelman O. Automatic creation of both the topology and parameters for a robust controller by means of genetic programming. In: Proceedings of the 1999 IEEE International Symposium on Intelligent Control, Intelligent Systems, and Semiotics. Piscataway (NJ): IEEE, 1999; 344–52.Google Scholar
  33. [33]
    Koza JR, Keane MA, Yu J, Bennett FH III, Mydlowec W Automatic creation of human-competitive programs and controllers by means of genetic programming. Genet Prog Evolv Mach 2000;(1):121–64.MATHCrossRefGoogle Scholar
  34. [34]
    Koza JR, Keane MA, Yu J, Mydlowec W, Bennett FH III. Automatic synthesis of both the topology and parameters for a controller for a three-lag plant with a five-second delay using genetic programming. In: Cagnoni S, Poli R, Smith GD, Corner D, Oates M, Hart E, editors. Real-World Applications of Evolutionary Computing. EvoWorkshops 2000. EvoIASP, Evo SCONDI, EvoTel, EvoSTIM, EvoRob, and EvoFlight, Edinburgh, Scotland, UK, April 2000, Proceedings. Lecture notes in computer science, vol. 1803. Berlin (Germany): Springer, 2000; 168–77 [ISBN 3–540–67353–9].CrossRefGoogle Scholar
  35. [35]
    Koza JR, Keane MA, Yu J, Mydlowec W, Bennett FH III. Automatic synthesis of both the control law and parameters for a controller for a three-lag plant with five-second delay using genetic programming and simulation techniques. In: Proceedings of the 2000 American Control Conference, 28–30 June, Chicago, IL. Evanston (IL): American Automatic Control Council, 2000; 453–9.Google Scholar
  36. [36]
    Koza JR, Yu J, Keane MA, Mydlowec W 2000. Evolution of a controller with a free variable using genetic programming. In: Poli R, Banzhaf W, Langdon WB, Miller J, Nordin P, Fogarty TC, editors. Genetic Programming: European Conference, EuroGP 2000, Edinburgh, Scotland, UK, April 2000, Proceedings. Lecture notes in computer science, vol. 1802. Berlin (Germany): Springer, 2000; 91–105 [ISBN 3–540–67339–3].Google Scholar
  37. [37]
    Yu J, Keane, Martin A, Koza JR. Automatic design of both topology and tuning of a common parameterized controller for two families of plants using genetic programming. In: Proceedings of Eleventh IEEE International Symposium on Computer-Aided Control System Design (CACSD) Conference and Ninth IEEE International Conference on Control Applications (CCA) Conference, Anchorage, AK, 25–27 September, 2000; CACSD-234–42.Google Scholar
  38. [38]
    Callender A, Stevenson AB. Automatic control of variable physical characteristics. US Patent 2,175,985, filed (in USA) 17 February 1936, (in UK) 13 February 1935, issued (USA) 10 October 1939.Google Scholar
  39. [39]
    Astrom KJ, Hagglund T. PID controllers: theory, design, and tuning. 2nd ed. Research Triangle Park (NC): Instrument Society of America, 1995.Google Scholar
  40. [40]
    Boyd SP, Barratt CH. Linear controller design: limits of performance. Englewood Cliffs (NJ): Prentice Hall, 1991.MATHGoogle Scholar
  41. [41]
    Jones HS. 1942. Control apparatus. US Patent 2,282,726, filed 25 October 1939, issued 12 May 1942.Google Scholar
  42. [42]
    Comisky W, Yu J, Koza J. Automatic synthesis of a wire antenna using genetic programming. In: Late Breaking Papers at the 2000 Genetic and Evolutionary Computation Conference, Las Vegas, NV, 2000; 179–86.Google Scholar
  43. [43]
    Uda S. Wireless beam of short electric waves. J Inst Electr Eng (Jpn) 1926;(March):273–82.Google Scholar
  44. [44]
    Uda S. Wireless beam of short electric waves. J Inst Electr Eng (Jpn) 1927;(March):1209–19.Google Scholar
  45. [45]
    Yagi H. Beam transmission of ultra short waves. Proc Inst Radio Eng 1928;26:714–41.Google Scholar
  46. [46]
    Koza JR, Mydlowec W, Lanza G, Yu J, Keane MA. Reverse engineering and automatic synthesis of metabolic pathways from observed data using genetic programming. Stanford Medical Informatics technical report SMI-2000–0851, 2000.Google Scholar

Copyright information

© Springer-Verlag London 2002

Authors and Affiliations

  • John R. Koza

There are no affiliations available

Personalised recommendations