Advertisement

Genetic Algorithms and Neural Networks

  • W. M. Jenkins
Conference paper
Part of the CISM International Centre for Mechanical Sciences book series (CISM, volume 404)

Abstract

The basic genetic algorithm is introduced including the representation of individuals in populations, data structures for the representation of variables, binary strings, assessment of individual fitness, selection for recombination, crossover and mutation operators. The penalty function method of handling design constraints is introduced. The basic GA is illustrated by optimizing a simple structural design. We consider how we might improve the GA by on-line adaptation of the main controls. We then review string coding, the schema theorem and the formation of building blocks in the strings. We consider the coding of continuous-valued variables and bit array representations, elitism, methods of maintaining diversity in the population and introduce a further illustration in structural optimization. The application of the genetic algorithm is then extended into large scale-situations, particularly design situations involving a large number of variables. A combinatorial space reduction heuristic based on a record of parameter selection intensities is described. The allocation of fitness to partial strings is reviewed. Consideration is given to the multi-objective GA and pareto optimality. There follows a brief introduction to mathematical models of the GA. The GA is used to train a neural network as an alternative to back-propagation. We consider the ‘permutations’ problem and introduce the concept of ‘shift’. The method is illustrated by training a neural network for structural analysis. The chapter concludes with a brief review of the implicit parallelism of the GA and suggestions as to how the algorithm might be improved with parallel hardware and a further example application.

Keywords

Genetic Algorithm Design Variable Multiobjective Optimization Binary String General Regression Neural Network 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Goldberg D E: Genetic Algorithms in Search, Optimization and Machine Learning. Adison Wesley 1989MATHGoogle Scholar
  2. 2.
    Davis L: “Handbook of Genetic Algorithms”, Van Nostrand Reinhold, New York, 1991.Google Scholar
  3. 3.
    Mitchell M: “An Introduction to Genetic Algorithms”, A Bradford Book, MIT Press, Cambridge, Massachusetts, 1996Google Scholar
  4. 4.
    Jenkins W M: Towards structural optimization via the genetic algorithm. Computers and Structures. 1990 40(5), 1321–1327.CrossRefGoogle Scholar
  5. 5.
    Jenkins W M: (1991) Structural optimization with the genetic algorithm. The Structural Engineer, London, 69(24), 418–422.Google Scholar
  6. 6.
    Jenkins W M: (1992) Plane Frame Optimum Design Environment Based on the Genetic Algorithm. Journal of Structural Engineering. Proceedings of the American Society of Civil Engineers, Vol 118 No 11 November 1992.Google Scholar
  7. 7.
    Jenkins W M: (1998) Improving structural design by genetic search. Computer-aided Civil and Infrastructure Engineering 13(1998) 5–11.CrossRefGoogle Scholar
  8. 8.
    Chakrabarty B. K: “A model for optimum design of reinforced concrete beams” ASCE Journal of Structural Engineering, Vol 118 No 11 November 1992.Google Scholar
  9. 9.
    Jenkins W. M: Discussion on reference [8]. ASCE Journal of Structural Engineering, March 1994.Google Scholar
  10. 10.
    Levy, Stephen: “Artificial Life” Penguin Books 1993.Google Scholar
  11. 11.
    Sigmund, Karl: “Games of Life” Penguin Books 1993.Google Scholar
  12. 12.
    Hasancebi O and Erbatur F. Evaluation of crossover techniques in Genetic Algorithm based structural optimization. Advances in Engineering Computational Technology, Ed. B H V Topping, CIVIL-COMP Press, Edinburgh 1998.Google Scholar
  13. 13.
    Jenkins W.M: “An enhanced genetic algorithm for structural design optimization”, 5th International Conference on Civil & Structural Engineering, Heriot-Watt University, Edinburgh, August 1993. Civil-Comp Press, Edinburgh, 1993.Google Scholar
  14. 14.
    Davis, L: “Adapting operator probabilities in genetic algorithms”. Proc. Third Int. Conf. On Genetic Algorithms, Morgan Kaufmann, Los Altos, CA, 1989.Google Scholar
  15. 15.
    Jenkins W.M: “A space condensation heuristic for combinatorial optimization”, Advances in structural optimization, Computational Structures Technology 94, Civil Comp Press, Edinburgh, UK 1994.Google Scholar
  16. 16.
    Reeves C.R: (ed), “Modern Heuristic Techniques for Combinatorial Problems”. McGraw-Hill, Maidenhead, Berkshire, UK, 1995Google Scholar
  17. 17.
    Schoenauer M:“Shape Representations for Evolutionary Optimization and identification in Structural Mechanics”, Genetic Algorithms in Engineering and Computer Science, Ch 22, pp 443–463, John Wiley 1995.Google Scholar
  18. 18.
    Jenkins W.M: “On the applications of natural algorithms to structural design optimization”. Engineering Structures, Vol 19, No. 4, pp 302–308, 1997 Elsevier Science Ltd.CrossRefMathSciNetGoogle Scholar
  19. 19.
    Baker J.E: “Adaptive selections methods for genetic algorithms”. In J.J. Grefenstette, ed. Proceedings of the First International Conference on Genetic Algorithms and Their Applications. Erlbaum.Google Scholar
  20. 20.
    Press W H, Teukolsky S A, Vettering W T, Flannery B P. Numerical Recipes in C, Second edition, Cambridge University Press 1992.MATHGoogle Scholar
  21. 21.
    Krishnakumar K, Narayanaswamy S and Garg S: Solving Large Parameter Optimization Problems Using a Genetic Algorithm with Stochastic Coding. Genetic Algorithms in Engineering and Computer Science. Eds Winter G, Periaux J, Galan M and Cuesta P. John Wiley & Sons. Chichester, 1995Google Scholar
  22. 22.
    Wassermann P.D: Advanced methods in neural computing. Van Nostrand Reinhold. New York, 1993.Google Scholar
  23. 23.
    Fu LiMin: “Neural Networks in Computer Intelligence”. McGraw-Hill, New York, 1994.Google Scholar
  24. 24.
    Jenkins W.M: “A Genetic Algorithm for Structural Design Optimization” in Emergent Computing Methods in Engineering Design, Eds Grierson D.E and Hajela P, NATO ASI Series F: Computer and Systems Sciences, Vol. 149 1996. Pp 30–53.CrossRefGoogle Scholar
  25. 25.
    Jenkins W.M: “The Estimation of Partial String Fitnesses in the Genetic Algorithm.” Developments in Neural Networks and Evolutionary Computing. CIVIL-COMP Press, Edinburgh UK, 1995, pp 137–142.Google Scholar
  26. 26.
    Koumousis V.K: “Genetic Algorithms in Optimal Design of Civil Engineering Structures”, in Emergent Computing Methods in Engineering Design, Eds Grierson D.E and Hajela P, NATO ASI Series F: Computer and Systems Sciences, Vol. 149 1996. pp 54–73.CrossRefGoogle Scholar
  27. 27.
    Osyczka A: “Multicriterion Optimization in Engineering”, Ellis Horwood Series in Mechanical Engineering, Ellis Horwood Ltd, Chichester, West Sussex 1954.Google Scholar
  28. 28.
    Shih C J and Yu K C. “Methods of pairwise comparisons and fuzzy global criterion for multi-objective optimization in structural engineering”. Structural Engineering and Mechanics, Vol 6, No 1 (1998) 17–30.CrossRefGoogle Scholar
  29. 29.
    Cheng F Y and Li D. “Multiobjective Optimization Design with Pareto Genetic Algorithm”. ASCE Journal of Structural Engineering, September 1997.Google Scholar
  30. 30.
    Sturzaker D. “Elementary Probability”. Cambridge University Press 1994.Google Scholar
  31. 31.
    Feller W. “An introduction to probability theory and its applications”. Wiley, New York 1970.Google Scholar
  32. 32.
    Whitely D: “Genetic Algorithms and Neural Networks” in Winter G A et al (eds). Genetic Algorithms in Engineering and Computer Science. John Wiley & Sons, Chichester, England 1995. pp 203 – 216Google Scholar
  33. 33.
    Jenkins W.M: “A Neural Network trained by Genetic Algorithm.” International Conference of Computational Structures, Budapest, August 1996. CIVIL-COMP Press, Edinburgh.Google Scholar
  34. 34.
    Jenkins W.M: “Approximate analysis of structural grillages using a neural network.” Proc. Instn Civ. Engrs Structures & Buildings, 1997, 122, Aug.,pp. 355–363Google Scholar
  35. 35.
    Braun H and Zagorski P: “ENZO-M — A Hybrid Approach for optimizing Neural Networks by Evolution and Learning.” Lecture Notes in Computer Science 866. Parallel Problem Solving from Nature — PPSN III. Intl. Conf. on Evolutionary Computation, Jerusalem, Israel, October 1994, pp440 – 451.Google Scholar
  36. 36.
    Doorly D: Parallel Genetic Algorithms for Optimization in Computational Fluid Dynamics, ibid pp 251 .. 270.Google Scholar
  37. 37.
    Marshall S.J and Harrison R.F: ‘Optimization and training of feed-forward neural networks by genetic algorithms.’ Proc. 2nd IEE International Conference on Artificial Neural Networks, Vol 349 ch 81 pp39–43, Bournemouth, England, Nov. 1991Google Scholar
  38. 38.
    Jenkins W.M ‘Neural network-based approximations for structural analysis’. Proceedings of the fourth International Conference on Artificial Intelligence in Civil & Structural Engineering. CIVIL-COMP Press, Edinburgh 1995.Google Scholar
  39. 39.
    Jenkins W.M. ‘An introduction to neural computing for the Structural Engineer’. The Structural Engineer, Volume 75, Number 3, 4 February 1997.MathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Wien 1999

Authors and Affiliations

  • W. M. Jenkins
    • 1
  1. 1.University of LeedsLeedsUK

Personalised recommendations