Skip to main content
SpringerLink
Log in

A model-independent adaptive sequential sampling technique based on response nonlinearity estimation

  • Research Paper
  • Published:
Structural and Multidisciplinary Optimization Aims and scope Submit manuscript

Abstract

Sequential adaptive sampling strategies attempt to efficiently and accurately generate surrogate model (SM) training datasets by limiting the number of required function evaluations. Among these techniques, those that are model independent have attracted attention during the last decade because they do not use a global SM to supervise the sampling process, thereby relieving the user from the burden of selecting an appropriate SM formulation at the beginning of the sampling process. In this study, we propose a new model-independent sequential adaptive sampling technique called nearest neighbors adaptive sampling (NNAS). The NNAS formulation introduces a refinement metric based on local linear models that leads to a quasilinear dependency of the algorithm complexity with respect to the number of samples. Additionally, the exploration-refinement balance is achieved by a stochastic Pareto-ranking-based selection criterion that attempts to simultaneously maximize both the exploration and refinement. NNAS is tested on ten two-dimensional and one ten-dimensional analytic functions, a five-dimensional engineering test case based on the XRotor solver (Drela and Youngren 2014), and a two-response two-dimensional analytic problem. The results show that NNAS is more computationally efficient than comparable methods without causing a relevant increase in sample requirement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  • Abate G, Mavris DN (2018) Performance analysis of different positions of leading edge tubercles on a wind turbine blade. In: 2018 Wind energy symposium, p 1494

  • Adorio EP, Diliman U (2005) Mvf-multivariate test functions library in C for unconstrained global optimization. http://www.geocities.ws/eadorio/mvf.pdf

  • Aurenhammer F (1991) Voronoi diagrams; a survey of a fundamental geometric data structure. ACM Comput Surv 23(3):345–405. https://doi.org/10.1145/116873.116880

    Article  Google Scholar 

  • Basudhar A (2015) Multi-objective optimization using adaptive explicit non-dominated region sampling. In: 11th world congress on structural and multidisciplinary optimization

  • Ben Salem M, Roustant O, Gamboa F, Tomaso L (2017) Universal prediction distribution for surrogate models. SIAM/ASA Journal on Uncertainty Quantification 5(1):1086–1109

    Article  MathSciNet  MATH  Google Scholar 

  • Bhosekar A, Ierapetritou M (2018) Advances in surrogate based modeling, feasibility analysis, and optimization: a review. Comput Chem Eng 108:250–267. https://doi.org/10.1016/j.compchemeng.2017.09.017. http://www.sciencedirect.com/science/article/pii/S0098135417303228

    Article  Google Scholar 

  • Censor Y (1977) Pareto optimality in multiobjective problems. Appl Math Opt 4(1):41–59. https://doi.org/10.1007/BF01442131

    Article  MathSciNet  MATH  Google Scholar 

  • Chen Quin Lam M (2008) Sequential adaptive designs in computer experiments for response surface model fit. Ph.D. thesis, The Ohio State University USA

  • Crombecq K, Couckuyt I, Gorissen D, Dhaene T (2009) Space-filling sequential design strategies for adaptive surrogate modelling. In: The first international conference on soft computing technology in civil, structural and environmental engineering

  • Crombecq K, Gorissen D, Deschrijver D, Dhaene T (2011) A novel hybrid sequential design strategy for global surrogate modeling of computer experiments. SIAM J Sci Comput 33(4):1948–1974

    Article  MathSciNet  MATH  Google Scholar 

  • Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197. https://doi.org/10.1109/4235.996017

    Article  Google Scholar 

  • Drela M, Youngren H (2014) Xrotor download page. http://web.mit.edu/drela/Public/web/xrotor/

  • Dyn N, Levin D, Rippa S (1986) Numerical procedures for surface fitting of scattered data by radial functions. SIAM J Sci Stat Comput 7(2):639–659

    Article  MathSciNet  MATH  Google Scholar 

  • Garbo A, German BJ (2016) Comparison of adaptive design space exploration methods applied to S-duct CFD simulation. In: 57th AIAA/ASCE/AHS/ASC structures, structural dynamics, and materials conference, p 0416

  • Garbo A, German BJ (2017) Adaptive sampling with adaptive surrogate model selection for computer experiment applications. In: 18th AIAA/ISSMO multidisciplinary analysis and optimization conference, p 4430

  • Garbo A, German BJ (2019) Performance assessment of a cross-validation sampling strategy with active surrogate model selection. Struct Multidiscip Optim. https://doi.org/10.1007/s00158-018-02190-7

    Article  Google Scholar 

  • Gorissen D (2007) Heterogeneous evolution of surrogate models. Master’s thesis, Katholieke Universiteit Leuven, Belgium

  • Gorissen D, De Tommasi L, Crombecq K, Dhaene T (2009) Sequential modeling of a low noise amplifier with neural networks and active learning. Neural Comput Applic 18(5):485–494

    Article  Google Scholar 

  • Gorodetsky A, Marzouk Y (2016) Mercer kernels and integrated variance experimental design: connections between Gaussian process regression and polynomial approximation. SIAM/ASA Journal on Uncertainty Quantification 4(1):796–828

    Article  MathSciNet  MATH  Google Scholar 

  • Grobler C, Kok S, Wilke DN (2017) Simple intuitive multi-objective parallelization of efficient global optimization: simple-ego. In: World congress of structural and multidisciplinary optimisation. Springer, pp 205–220

  • Gunn SR (1998) Support vector machines for classification and regression. ISIS Technical Report 14:85–86

    Google Scholar 

  • Hancer E, Xue B, Zhang M, Karaboga D, Akay B (2018) Pareto front feature selection based on artificial bee colony optimization. Inf Sci 422:462–479

    Article  Google Scholar 

  • Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76 (8):1905–1915

    Article  Google Scholar 

  • van der Herten J, Couckuyt I, Deschrijver D, Dhaene T (2015) A fuzzy hybrid sequential design strategy for global surrogate modeling of high-dimensional computer experiments. SIAM J Sci Comput 37(2):A1020–A1039

    Article  MathSciNet  MATH  Google Scholar 

  • Jiang C, Cai X, Qiu H, Gao L, Li P (2018) A two-stage support vector regression assisted sequential sampling approach for global metamodeling. Struct Multidiscip Optim 58(4):1657–1672

    Article  Google Scholar 

  • Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13

    Article  Google Scholar 

  • Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In: ASME 2002 International design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers, pp 539–548

  • Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492

    Article  MathSciNet  MATH  Google Scholar 

  • Klee V (1980) On the complexity of d-dimensional Voronoi diagrams. Arch Math 34(1):75–80

    Article  MathSciNet  MATH  Google Scholar 

  • Kleijnen JP, Van Beers WC (2004) Application-driven sequential designs for simulation experiments: kriging metamodelling. J Oper Res Soc 55(8):876–883

    Article  MATH  Google Scholar 

  • Lee TH (2003) The design of CMOS radio-frequency integrated circuits. University Press, Cambridge UK

  • Liao X, Li Q, Yang X, Zhang W, Li W (2008) Multiobjective optimization for crash safety design of vehicles using stepwise regression model. Struct Multidiscip Optim 35(6):561–569

    Article  Google Scholar 

  • Liu H, Xu S, Ma Y, Chen X, Wang X (2016) An adaptive Bayesian sequential sampling approach for global metamodeling. J. Mech. Des. 138(1)

  • Liu H, Ong YS, Cai J (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416

    Article  Google Scholar 

  • Lovison A, Rigoni E (2011) Adaptive sampling with a lipschitz criterion for accurate metamodeling. Communications in Applied and Industrial Mathematics 1(2):110–126

    MathSciNet  MATH  Google Scholar 

  • Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808

    Article  Google Scholar 

  • Marcy P (2014) On the use and utility of gradient information in computer experiments. Ph.D. thesis, University of Wyoming. Department of Statistics USA

  • Mehdad E, Kleijnen JP (2018) Stochastic intrinsic kriging for simulation metamodeling. Appl Stoch Model Bus Ind 34(3): 322–337

    Article  MathSciNet  MATH  Google Scholar 

  • Mishra PK, Nath SK, Sen MK, Fasshauer GE (2015) Hybrid gaussian-cubic radial basis functions for scattered data interpolation. arXiv preprint

  • Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of derivatives in surface prediction. Technometrics 35(3):243–255

    Article  MathSciNet  MATH  Google Scholar 

  • Plumlee M, Apley DW (2016) Lifted brownian kriging models Technometrics (just-accepted)

  • Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, Tucker PK (2005) Surrogate-based analysis and optimization. Prog Aerosp Sci 41(1):1–28

    Article  Google Scholar 

  • Rasmussen CE, Williams CK (2006) Gaussian processes for machine learning. Tech. Rep. ISBN 0-262-18253-X, Cambridge, MA USA

  • Santner TJ, Williams BJ, Notz WI (2013) The design and analysis of computer experiments. Springer, Berlin

    MATH  Google Scholar 

  • Shan S, Wang GG (2010) Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optim 41(2):219–241

    Article  MathSciNet  MATH  Google Scholar 

  • Shoemaker CA, Akhtar T (2019) An adaptive population-based candidate search algorithm with surrogates for global multi objective optimization of expensive functions. In: AIP Conference proceedings, vol 2070. AIP Publishing, p 020047

  • Simpson TW, Lin DK, Chen W (2001) Sampling strategies for computer experiments: design and analysis. International Journal of Reliability and Applications 2(3):209–240

    Google Scholar 

  • Simpson TW, Poplinski J, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150

    Article  MATH  Google Scholar 

  • Tarter ME (1968) Inverse cumulative approximation and applications. Biometrika 55(1):29–41. https://doi.org/10.1093/biomet/55.1.29

    Article  MathSciNet  Google Scholar 

  • Wang B, Hao P, Li G, Fang Y, Wang X, Zhang X (2013) Determination of realistic worst imperfection for cylindrical shells using surrogate model. Struct Multidiscip Optim 48(4):777–794

    Article  Google Scholar 

  • Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on voronoi diagram and cross validation. J Mech Des 136(7):071,009

    Article  Google Scholar 

  • Yan C, Shen X, Guo F (2018) An improved support vector regression using least squares method. Struct Multidiscip Optim 57(6): 2431–2445. https://doi.org/10.1007/s00158-017-1871-5

    Article  MathSciNet  Google Scholar 

  • Yegnanarayana B (2009) Artificial neural networks. PHI Learning Pvt Ltd

  • Zhang Y, Kim NH, Haftka RT (2019) General surrogate adaptive sampling using interquartile range for design space exploration. In: AIAA Scitech 2019 forum, p 2213

  • Zhang Y, Neelakantan A, Park C, Kim NH, Lam H, Haftka RT (2019) Adaptive sampling with varying sampling cost for design space exploration. AIAA J: 1–12

  • Zhou Q, Shao X, Jiang P, Gao Z, Zhou H, Shu L (2016) An active learning variable-fidelity metamodelling approach based on ensemble of metamodels and objective-oriented sequential sampling. J Eng Des 27(4-6):205–231

    Article  Google Scholar 

Download references

Funding

This material is based upon work supported by the USA National Science Foundation under Grant No. 1537782.

Author information

Authors and Affiliations

  1. School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, 30313, USA

    Andrea Garbo & Brian J. German

Authors
  1. Andrea Garbo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian J. German
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Garbo.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Responsible Editor: Raphael Haftka

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

(PDF 223 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Garbo, A., German, B.J. A model-independent adaptive sequential sampling technique based on response nonlinearity estimation. Struct Multidisc Optim 61, 1051–1069 (2020). https://doi.org/10.1007/s00158-019-02404-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00158-019-02404-6

Keywords

Search

Navigation