Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Sequential kriging optimization using multiple-fidelity evaluations

Abstract

When cost per evaluation on a system of interest is high, surrogate systems can provide cheaper but lower-fidelity information. In the proposed extension of the sequential kriging optimization method, surrogate systems are exploited to reduce the total evaluation cost. The method utilizes data on all systems to build a kriging metamodel that provides a global prediction of the objective function and a measure of prediction uncertainty. The location and fidelity level of the next evaluation are selected by maximizing an augmented expected improvement function, which is connected with the evaluation costs. The proposed method was applied to test functions from the literature and a metal-forming process design problem via finite element simulations. The method manifests sensible search patterns, robust performance, and appreciable reduction in total evaluation cost as compared to the original method.

This is a preview of subscription content, log in to check access.

References

  1. Ackley DH (1987) A connectionist machine for genetic hill-climbing. Kluwer, Boston

  2. Alexandrov NM, Dennis JE Jr, Lewis RM, Torczon V (1998) A trust region framework for managing the use of approximation models in optimization. Struct Optim 15(1):16–23

  3. Audet C, Dennis JE Jr, Moore DW, Booker A, Frank PD (2000) A surrogate-model-based method for constrained optimization. In: Proceedings of the 8th AIAA/NASA/USAF/ISSMO symposium on multidisciplinary analysis and optimization, AIAA-2000-4891, Long Beach, 6–8 September 2000

  4. Bandler JW, Ismail MA, Rayas-Sanchez JE, Zhang Q (1999) Neuromodelling of microwave circuits exploiting space-mapping technology. IEEE Trans Microwave Theor Tech 47:2417–2427

  5. Björkman M, Holström K (2000) Global optimization of costly nonconvex functions using radial basis functions. Opt Eng 1:373–397

  6. Cressie NAC (1993) Statistics for spatial data, revised edn. Wiley, New York

  7. Currin C, Mitchell M, Morris M, Ylvisaker D (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc 86:953–963

  8. Edy D, Averill RC, Punch WF III, Goodman ED (1998) Evaluation of injection island GA performance on flywheel design optimization. In: Parmee IC (ed) Adaptive computing in design and manufacture. Springer, Berlin Heidelberg New York

  9. Hartman JK (1973) Some experiments in global optimization. Nav Res Logist Q 20:569–576

  10. Huang D, Allen TT, Notz WI, Zheng N (2006) Global optimization of stochastic black-box systems via sequential kriging meta-models. J Global Optim 34(3):441–466

  11. Hutchinson MG, Unger ER, Mason WH, Grossman B, Haftka RT (1994) Variable-complexity aerodynamic optimization of a high speed civil transport wing. J Aircr 31:110–116

  12. Jones D, Schonlau M, Welch W (1998) Efficient global optimization of expensive black-box functions. J Global Optim 13:455–492

  13. Kaufman M, Balabanov V, Burgee SL, Giunta AA, Grossman B, Mason WH, Watson LT (1996) Variable-complexity response surface approximations for wing structural weight in HSCT design. Proceedings of the 34th aerospace sciences meeting and exhibit, AIAA-96-0089, Reno, 15–18 January 1996

  14. Keane AJ (2003) Wing optimization using design of experiment, response surface, and data fusion methods. J Aircr 40(4):741–750

  15. Kennedy MC, O'Hagan A (2000) Predicting the output of a complex computer code when fast approximation are available. Biometrika 87(1):1–13

  16. Kennedy MC, O'Hagan A (2001)Bayesian calibration of computer models (with discussion). J R Stat Soc, Ser B 63(3):425–464

  17. Koehler JR, Owen AB (1996) Computer experiments. In: Ghosh S, Rao CR (eds) Handbook of statistics, vol 13. Elsevier, Amsterdam

  18. Kushner HJ (1964) A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise. J Basic Eng 86:97–106

  19. Leary SJ, Bhaskar A, Keane AJ (2003) A knowledge-based approach to response surface modelling in multifidelity optimization. J Global Optim 26(3):297–319

  20. McDaniel WR, Ankenman BE (2000) A response surface test bed. Qual Reliab Eng Int 16:363–372

  21. O'Hagan A (1989) Comment: design and analysis of computer experiments. Stat Sci 4:430–432

  22. Rodriguez JF, Perez VM, Padmanabhan D, Renaud JE (2001) Sequential approximate optimization using multiple fidelity response surface approximation. Struct Multidisc Optim 22(1):23–34

  23. Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989a) Design and analysis of computer experiments (with discussion). Stat Sci 4:409–430

  24. Sacks J, Schiller SB, Welch W (1989b) Design for computer experiments. Technometrics 31:41–47

  25. Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, Berlin Heidelberg New York

  26. Sasena MJ (2002) Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. Ph.D. dissertation, University of Michigan, Ann Arbor

  27. Sasena MJ, Papalambros PY, Goovaerts P (2002) Exploration of metamodeling sampling criteria for constrained global optimization. Eng Optim 34:263–278

  28. Schonlau M (1997) Computer experiments and global optimization. Ph.D. dissertation, University of Waterloo, Waterloo

  29. Stein M (1987) Large sample properties of simulation using Latin hypercube sampling. Technometrics 29:143–151

  30. Watson PM, Gupta KC (1996) EM-ANN models for microstrip vias and interconnects in dataset circuits. IEEE Trans Microwave Theor Tech 44:2495–2503

Download references

Author information

Correspondence to D. Huang.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Huang, D., Allen, T.T., Notz, W.I. et al. Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidisc Optim 32, 369–382 (2006). https://doi.org/10.1007/s00158-005-0587-0

Download citation

Keywords

  • Multiple fidelity
  • Surrogate systems
  • Kriging
  • Efficient global optimization
  • Computer experiments