Abstract
Evolutionary algorithms have been very popular for solving multiobjective optimization problems, mainly because of their ease of use, and their wide applicability. However, multi-objective evolutionary algorithms (MOEAs) tend to consume an important number of objective function evaluations, in order to achieve a reasonably good approximation of the Pareto front. This is a major concern when attempting to use MOEAs for real-world applications, since we can normally afford only a fairly limited number of fitness function evaluations in such cases. Despite these concerns, relatively few efforts have been reported in the literature to reduce the computational cost of MOEAs. It has been until relatively recently, that researchers have developed techniques to achieve an effective reduction of fitness function evaluations by exploiting knowledge acquired during the search. In this chapter, we analyze different proposals currently available in the specialized literature to deal with expensive functions in evolutionary multi-objective optimization. Additionally, we review some real-world applications of these methods, which can be seen as case studies in which such techniques led to a substantial reduction in the computational cost of the MOEA adopted. Finally, we also indicate some of the potential paths for future research in this area.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alonso, J., LeGresley, P., Pereyra, V.: Aircraft Design Optimization. Mathematics and Computer in Simulation 79, 1948–1958 (2008)
Arabnia, M., Ghaly, W.: A strategy for multi-objective shape optimization of turbine stages in three-dimensional flow. In: 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Victoria, British Columbia, Canada (2008)
Beachkofski, B.K., Grandhi, R.V.: Improved Distributed Hypercube Sampling. In: 43rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, Denver, CO, USA (2002)
Bhattacharya, M., Lu, G.: A dynamic approximate fitness based hybrid ea for optimization problems. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 1879–1886 (2003)
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, UK (1995)
Bueche, D., Schraudolph, N., Koumoutsakos, P.: Accelerating evolutionary algorithms with gaussian process fitness function models. IEEE Transactions on Systems, Man, and Cybernetics: Part C 35(2), 183–194 (2005)
Kampolis, I.C., Giannakoglou, K.C.: A multilevel approach to single- and multiobjective aerodynamic optimization. Computer Methods in Applied Mechanics and Engineering 197, 2963–2975 (2008)
Chen, J.H., Goldberg, D., Ho, S.Y., Sastry, K.: Fitness inheritance in multi-objective optimization. In: Proceedings of Genetic and Evolutionary Computation Conference. Morgan Kaufmann, San Francisco (2002)
Chiba, K., Obayashi, S.: Data mining for multidisciplinary design space of regional-jet wing. AIAA Journal of Aerospace Computing, Information, and Communication 4(11), 1019–1036 (2007)
Chiba, K., Obayashi, S., Nakahashi, K., Morino, H.: High-Fidelity Multidisciplinary Design Optimization of Wing Shape for Regional Jet Aircraft. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 621–635. Springer, Heidelberg (2005)
Choi, S., Alonso, J.J., Chung, H.S.: Design of a low-boom supersonic business jet using evolutionary algorithms and an adaptive unstructured mesh method. In: AIAA Paper 2004-1758, 45th AIAA/ASME/ASCE/AHS/ASC Structure, Structural Dynamics and Materials Conference, Palm Springs, CA, USA (2004)
Chung, H.S., Alonso, J.J.: Multiobjective optimization using approximation model-based genetic algorithms. In: AIAA Paper 2004-4325, 10th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Albany, New York, USA (2004)
Chung, H.S., Choi, S., Alonso, J.J.: Supersonic business jet design using a knowledge-based genetic algorithm with an adaptive, unstructured grid methodology. In: AIAA Paper 2003-3791, 21st Applied Aerodynamics Conference, Orlando, Florida, USA (2003)
Cinnella, P., Congedo, P.M.: Optimal Airfoil Shapes for Viscous Transonic Flows of Dense Gases. In: AIAA Paper 2006-3881, 36th AIAA Fluid Dynamics Conference and Exhibit, San Francisco, California, USA (2006)
Coello Coello, C.A., Toscano Pulido, G.: A Micro-Genetic Algorithm for Multiobjective Optimization. In: Zitzler, E., Deb, K., Thiele, L., Coello Coello, C.A., Corne, D.W. (eds.) EMO 2001. LNCS, vol. 1993, pp. 126–140. Springer, Heidelberg (2001)
Coello Coello, C.A., Toscano Pulido, G.: Multiobjective Optimization using a Micro-Genetic Algorithm. In: Spector, L., Goodman, E.D., Wu, A., Langdon, W., Voigt, H.M., Gen, M., Sen, S., Dorigo, M., Pezeshk, S., Garzon, M.H., Burke, E. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2001), pp. 274–282. Morgan Kaufmann Publishers, San Francisco (2001b)
Coello Coello, C.A., Lamont, G.B., Van Veldhuizen, D.A.: Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd edn. Springer, New York (2007)
Congedo, P.M., Corre, C., Cinnella, P.: Airfoil Shape Optimization for Transonic Flows of Bethe-Zel’dovich-Thompson Fluids. AIAA Journal 45(6), 1303–1316 (2007)
Costa, M., Minisci, E.: MOPED: A multi-objective parzen-based estimation of distribution algorithm for continuous problems. In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Deb, K., Thiele, L. (eds.) EMO 2003. LNCS, vol. 2632, pp. 282–294. Springer, Heidelberg (2003)
D’Angelo, S., Minisci, E.A.: Multi-objective evolutionary optimization of subsonic airfoils by kriging approximation and evolutionary control. In: 2005 IEEE Congress on Evolutionary Computation (CEC 2005), Edinburg, Scotland, vol. 2, pp. 1262–1267 (2005)
Deb, K.: Multi-Objective Optimization using Evolutionary Algorithms. John Wiley & Sons, Chichester (2001)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multiobjective Genetic Algorithm: NSGA–II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)
Ducheyne, E.I., De Baets, B., De Wulf, R.: Is Fitness Inheritance Useful for Real-World Applications? In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Deb, K., Thiele, L. (eds.) EMO 2003. LNCS, vol. 2632, pp. 31–42. Springer, Heidelberg (2003)
Emmerich, M., Giotis, A., Özdenir, M., Bäck, T., Giannakoglou, K.: Metamodel-assisted evolution strategies. In: Guervós, J.J.M., Adamidis, P.A., Beyer, H.-G., Fernández-Villacañas, J.-L., Schwefel, H.-P. (eds.) PPSN 2002. LNCS, vol. 2439, pp. 371–380. Springer, Heidelberg (2002)
Fletcher, R.: Practical Methods of Optimization. John Wiley and Sons, New York (1989)
Fonseca, C.M., Fleming, P.J.: Genetic Algorithms for Multiobjective Optimization: Formulation, Discussion and Generalization. In: Forrest, S. (ed.) Proceedings of the Fifth International Conference on Genetic Algorithms, University of Illinois at Urbana-Champaign, pp. 416–423. Morgan Kauffman Publishers, San Mateo (1993)
Giunta, A., Watson, L.: A comparison of approximation modeling techniques: Polynomial versus interpolating models. Tech. Rep. 98-4758, AIAA (1998)
Glaz, B., Goel, T., Liu, L., Friedmann, P.P., Haftka, R.T.: Application of a Weighted Average Surrogate Approach to Helicopter Rotor Blade Vibration. In: AIAA Paper 2007–1898, 48th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, Honolulu, Hawaii, USA (2007)
Goel, T., Vaidyanathan, R., Haftka, R.T., Shyy, W., Queipo, N.V., Tucker, K.: Response Surface Approximtion of Pareto Optimal Front in Multi-Objective Optimization. Computer Methods in Applied Mechanics and Engineering 196, 879–893 (2007)
Goel, T., Vaidyanathan, R., Haftka, R., Shyy, W., Queipo, N., Tucker, K.: Response surface approximation of pareto optimal front in multiobjective optimization. Tech. Rep. 2004-4501, AIAA (2004)
Gonzalez, L.F., Périaux, J., Srinivas, K., Whitney, E.J.: A generic framework for the design optimisation of multidisciplinary uav intelligent systems using evolutionary computing. In: AIAA Paper 2006-1475, 44th AIAA Aerospace Science Meeting and Exhibit, Reno, Nevada, USA (2006)
Hardy, R.L.: Multiquadric equations of topography and other irregular surfaces. J. Geophys. Res. 76, 1905–1915 (1971)
Hong, Y.S., Lee, H., Tahk, M.J.: Acceleration of the convergence speed of evolutionary algorithms using multi-layer neural networks. Engineering Optimization 35(1), 91–102 (2003)
Hüscken, M., Jin, Y., Sendhoff, B.: Structure optimization of neural networks for aerodynamic optimization. Soft Computing 9(1), 21–28 (2005)
Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999), http://doi.acm.org/10.1145/331499.331504
Jensen, M.T.: Reducing the Run-Time Complexity of Multiobjective EAs: The NSGA-II and Other Algorithms. IEEE Transactions on Evolutionary Computation 7(5), 503–515 (2003)
Jeong, S., Minemura, Y., Obayashi, S.: Optimization of combustion chamber for diesel engine using kriging model. Journal of Fluid Science and Technology 1, 138–146 (2006)
Jeong, S., Suzuki, K., Obayashi, S., Kurita, M.: Improvement of nonlinear lateral characteristics of lifting-body type reentry vehicle using optimization algorithm. In: AIAA Paper 2007–2893, AIAA infotech@Aerospace 2007 Conference and Exhibit, Rohnert Park, California, USA (2007)
Jin, R., Chen, W., Simpson, T.: Comparative studies of metamodeling techniques under miltiple modeling criteria. Tech. Rep. 2000-4801, AIAA (2000)
Jin, Y.: A comprehensive survey of fitness approximation in evolutionary computation. Soft Computing 9(1), 3–12 (2005)
Jone, D., Schonlau, M., Welch, W.: Efficient global optimization of expensive black-box function. Journal of Global Optimization 13, 455–492 (1998)
Knowles, J.: ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Transactions on Evolutionary Computation 10(1), 50–66 (2006)
Knowles, J., Nakayama, H.: Meta-modeling in multiobjective optimization. In: Branke, J., Deb, K., Miettinen, K., Slowinski, R. (eds.) Multiobjective Optimization-Interactive and Evolutionary Approaches, pp. 245–284. Springer, Heidelberg (2008)
Kumano, T., Jeong, S., Obayashi, S., Ito, Y., Hatanaka, K., Morino, H.: Multidisciplinary design optimization of wing shape for a small jet aircraft using kriging model. In: AIAA Paper 2006-932, 44th AIAA Aerospace Science Meeting and Exhibit, Reno, Nevada, USA (2006)
Kung, H., Luccio, F., Preparata, F.: On finding the maxima of a set of vectors. Journal of the Association for Computing Machinery 22(4), 469–476 (1975)
Becerra, R.L., Coello, C.A.C.: Solving Hard Multiobjective Optimization Problems Using ε-Constraint with Cultured Differential Evolution. In: Runarsson, T.P., Beyer, H.-G., Burke, E.K., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) PPSN 2006. LNCS, vol. 4193, pp. 543–552. Springer, Heidelberg (2006)
Langer, H., Pühlhofer, T., Baier, H.: A multi-objective evolutionary algorithm with integrated response surface functionalities for configuration optimization with discrete variables. In: AIAA Paper 2004–4326, 10th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization Conference, Albany, New York, USA (2004)
Lee, D., Gonzalez, L., Periaux, J., Srinivas, K.: Robust design optimisation using multi-objective evolutionary algorithms. Computer & Fluids 37, 565–583 (2008)
Lee, D., Gonzalez, L., Srinivas, K., Periaux, J.: Robust evolutionary algorithms for uav/ucav aerodynamic and rcs design optimisation. Computer & Fluids 37, 547–564 (2008b)
Lee, D.S., Gonzalez, L.F., Srinivas, K., Auld, D.J., Wong, K.C.: Aerodynamics/rcs shape optimisation of unmanned aerial vehicles using hierarchical asynchronous parallel evolutionary algorithms. In: AIAA Paper 2006-3331, 24th AIAA Applied Aerodynamics Conference, San Francisco, California, USA (2006)
Lee, D.S., Gonzalez, L.F., Srinivas, K., Periaux, J.: Multi-objective robust design optimisation using hierarchical asynchronous parallel evolutionary algorithms. In: AIAA Paper 2007-1169, 45th AIAA Aerospace Science Meeting and Exhibit, Reno, Nevada, USA (2007)
Lian, Y., Liou, M.S.: Multiobjective Optimization Using Coupled Response Surface Model and Evolutinary Algorithm. In: AIAA Paper 2004–4323, 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Albany, New York, USA (2004)
Lian, Y., Liou, M.S.: Multi-Objective Optimization of a Transonic Compressor Blade Using Evolutionary Algorithm. In: AIAA Paper 2005–1816, 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics & Materials Conference, Austin, Texas, USA (2005)
Lian, Y., Liou, M.S.: Multi-objective Optimization of Transonic Compressor Blade Using Evolutionary Algorithm. Journal of Propulsion and Power 21(6), 979–987 (2005)
Mack, Y., Goel, T., Shyy, W., Haftka, R., Queipo, N.: Multiple Surrogates for the Shape Optimization of Bluff Body-Facilitated Mixing. In: AIAA Paper 2005–333, 43rd AIAA Aerospace Sciences Metting and Exhibit, Reno, Nevada, USA (2005)
Nakayama, H., Sawaragi, Y.: Satisficing trade-off method for multi-objective programming. In: Grauer, M., Wierzbicki, A. (eds.) Interactive Decision Analysis, pp. 113–122. Springer, Heidelberg (1984)
Nakayama, H., Yun, Y.: Support vector regression based on goal programming and multi-objective programming. In: IEEE World Congress on Computational Intelligence (2006)
Nakayama, H., Inoue, K., Yoshimori, Y.: Approximate optimization using computational intelligence and its application to reinforcement of cable-stayed bridges. In: Zha, X., Howlett, R. (eds.) Integrated Intelligent Systems for Engineering Design, pp. 289–304. IOS Press, Amsterdam (2006)
Obayashi, S., Sasaki, D.: Self-organizing map of pareto solutions obtained from multiobjective supersonic wing design. In: AIAA Paper 2002–0991, 40th Aerospace Science Meeting and Exhibit, Reno, Nevada, USA (2002)
Ong, Y.S., Nair, P.B., Keane, A.J., Wong, K.W.: Surrogate-assisted evolutionary optimization frameworks for high-fidelity engineering design problems. In: Jin, Y. (ed.) Knowledge Incorporation in Evolutionary Computation. Studies in Fuzziness and Soft Computing, pp. 307–332. Springer, Heidelberg (2004)
Pagano, A., Federico, L., Barbarino, M., GUida, F., Aversano, M.: Multi-objective Aeroacoustic Optimization of an Aircraft Propeller. In: 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Victoria, British Columbia Canada (2008)
Pierret, S.: Turbomachinery blade design using a Navier-Stokes solver and artificial neural network. ASME Journal of Turbomachinery 121(3), 326–332 (1999)
Rai, M.M.: Robust Optimal Aerodynamic Design Using Evolutionary Methods and Neural Networks. In: AIAA Paper 2004-778, 42nd AIAA Aerospace Science Meeting and Exhibit, Reno, Nevada, USA (2004)
Rai, M.M.: Robust Optimal Design With Differential Evolution. In: AIAA Paper 2004-4588, 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Albany, New York, USA (2004)
Rasheed, K., Ni, X., Vattam, S.: Comparison of methods for developing dynamic reduced models for design optimization. Soft Computing 9(1), 29–37 (2005)
Ratle, A.: Accelerating the convergence of evolutionary algorithms by fitness landscape approximation. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, H.-P. (eds.) PPSN 1998. LNCS, vol. 1498, pp. 87–96. Springer, Heidelberg (1998)
Reyes Sierra, M., Coello Coello, C.A.: A Study of Fitness Inheritance and Approximation Techniques for Multi-Objective Particle Swarm Optimization. In: 2005 IEEE Congress on Evolutionary Computation (CEC 2005), vol. 1, pp. 65–72. IEEE Service Center, Edinburgh (2005)
Sacks, J., Welch, W., Mitchell, T., Wynn, H.: Design and analysis of computer experiments (with discussion). Statistical Science 4, 409–435 (1989)
Sasaki, D., Obayashi, S., Nakahashi, K.: Navier stokes optimzation of supersonic wings with four objectives using evolutionary algorithms. In: AIAA Paper 2001–2531, 15th AIAA Computational Fluid Dynamics Confernce, Anaheim, CA, USA (2001)
Sasaki, D., Obayashi, S., Nakahashi, K.: Navier-Stokes Optimization of Supersonic Wings with Four Objectives Using Evolutionary Algorithms. Journal of Aircraft 39(4), 621–629 (2002)
Abboud, K., Schoenauer, M.: Surrogate deterministic mutation: Preliminary results. In: Collet, P., Fonlupt, C., Hao, J.-K., Lutton, E., Schoenauer, M. (eds.) EA 2001. LNCS, vol. 2310, pp. 104–115. Springer, Heidelberg (2002)
Smith, R.E., Dike, B.A., Stegmann, S.A.: Fitness inheritance in genetic algorithms. In: SAC 1995: Proceedings of the 1995 ACM symposium on Applied computing, pp. 345–350. ACM Press, New York (1995)
Song, W., Keane, A.J.: Surrogate-based aerodynamic shape optimization of a civil aircraft engine nacelle. AIAA Journal 45(10), 265–2574 (2007)
Srinivas, N., Deb, K.: Multiobjective Optimization Using Nondominated Sorting in Genetic Algorithms. Evolutionary Computation 2(3), 221–248 (1994)
Todoroki, A., Sekishiro, M.: Dimensions and laminates optimization of hat-stiffened composite panel with buckling load constraint using multi-objective ga. In: AIAA Paper 2007–2880, AIAA infotech@Aerospace 2007 Conference and Exhibit, Rohnert Park, California, USA (2007)
Todoroki, A., Sekishiro, M.: Modified efficient global optimization for a hat-stiffened composite panel with buckling constraint. AIAA Journal 46(9), 2257–2264 (2008)
Ulmer, H., Streicher, F., Zell, A.: Model-assisted steady-state evolution strategies. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2723, pp. 610–621. Springer, Heidelberg (2003)
Ulmer, H., Streichert, F., Zell, A.: Evolution startegies assisted by gaussian processes with improved pre-selection criterion. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 692–699 (2003)
Vapnik, V.: Statistical Learning Theory. Wiley, Chichester (1998)
Vapnik, V.N.: The Nature of Statistical Learning. Springer, Heidelberg (1995)
Voutchkov, I., Keane, A.J., Fox, R.: Robust structural design of a simplified jet engine model, using multiobjective optimization. AIAA Paper 2006–7003, Portsmouth, Virginia, USA (2006)
Williams, C.K.I., Rasmussen, C.E.: Gaussian processes for regression. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (eds.) Advances in Neural Information Processing Systems, vol. 8. MIT Press, Cambridge (1996)
Won, K., Ray, T.: Performance of kriging and cokriging based surrogate models within the unified framework for surrogate assisted optimization. In: Congress on Evolutionary Computation, pp. 1577–1585. IEEE, Los Alamitos (2004)
Zitzler, E., Deb, K., Thiele, L.: Comparison of Multiobjective Evolutionary Algorithms: Empirical Results. Evolutionary Computation 8(2), 173–195 (2000)
Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: Improving the Strength Pareto Evolutionary Algorithm. In: Giannakoglou, K., Tsahalis, D., Periaux, J., Papailou, P., Fogarty, T. (eds.) EUROGEN 2001. Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems, Athens, Greece, pp. 95–100 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Santana-Quintero, L.V., Montaño, A.A., Coello, C.A.C. (2010). A Review of Techniques for Handling Expensive Functions in Evolutionary Multi-Objective Optimization. In: Tenne, Y., Goh, CK. (eds) Computational Intelligence in Expensive Optimization Problems. Adaptation Learning and Optimization, vol 2. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10701-6_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-10701-6_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10700-9
Online ISBN: 978-3-642-10701-6
eBook Packages: EngineeringEngineering (R0)