Abstract
Sequential adaptive sampling strategies attempt to efficiently and accurately generate surrogate model (SM) training datasets by limiting the number of required function evaluations. Among these techniques, those that are model independent have attracted attention during the last decade because they do not use a global SM to supervise the sampling process, thereby relieving the user from the burden of selecting an appropriate SM formulation at the beginning of the sampling process. In this study, we propose a new model-independent sequential adaptive sampling technique called nearest neighbors adaptive sampling (NNAS). The NNAS formulation introduces a refinement metric based on local linear models that leads to a quasilinear dependency of the algorithm complexity with respect to the number of samples. Additionally, the exploration-refinement balance is achieved by a stochastic Pareto-ranking-based selection criterion that attempts to simultaneously maximize both the exploration and refinement. NNAS is tested on ten two-dimensional and one ten-dimensional analytic functions, a five-dimensional engineering test case based on the XRotor solver (Drela and Youngren 2014), and a two-response two-dimensional analytic problem. The results show that NNAS is more computationally efficient than comparable methods without causing a relevant increase in sample requirement.
Similar content being viewed by others
References
Abate G, Mavris DN (2018) Performance analysis of different positions of leading edge tubercles on a wind turbine blade. In: 2018 Wind energy symposium, p 1494
Adorio EP, Diliman U (2005) Mvf-multivariate test functions library in C for unconstrained global optimization. http://www.geocities.ws/eadorio/mvf.pdf
Aurenhammer F (1991) Voronoi diagrams; a survey of a fundamental geometric data structure. ACM Comput Surv 23(3):345–405. https://doi.org/10.1145/116873.116880
Basudhar A (2015) Multi-objective optimization using adaptive explicit non-dominated region sampling. In: 11th world congress on structural and multidisciplinary optimization
Ben Salem M, Roustant O, Gamboa F, Tomaso L (2017) Universal prediction distribution for surrogate models. SIAM/ASA Journal on Uncertainty Quantification 5(1):1086–1109
Bhosekar A, Ierapetritou M (2018) Advances in surrogate based modeling, feasibility analysis, and optimization: a review. Comput Chem Eng 108:250–267. https://doi.org/10.1016/j.compchemeng.2017.09.017. http://www.sciencedirect.com/science/article/pii/S0098135417303228
Censor Y (1977) Pareto optimality in multiobjective problems. Appl Math Opt 4(1):41–59. https://doi.org/10.1007/BF01442131
Chen Quin Lam M (2008) Sequential adaptive designs in computer experiments for response surface model fit. Ph.D. thesis, The Ohio State University USA
Crombecq K, Couckuyt I, Gorissen D, Dhaene T (2009) Space-filling sequential design strategies for adaptive surrogate modelling. In: The first international conference on soft computing technology in civil, structural and environmental engineering
Crombecq K, Gorissen D, Deschrijver D, Dhaene T (2011) A novel hybrid sequential design strategy for global surrogate modeling of computer experiments. SIAM J Sci Comput 33(4):1948–1974
Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197. https://doi.org/10.1109/4235.996017
Drela M, Youngren H (2014) Xrotor download page. http://web.mit.edu/drela/Public/web/xrotor/
Dyn N, Levin D, Rippa S (1986) Numerical procedures for surface fitting of scattered data by radial functions. SIAM J Sci Stat Comput 7(2):639–659
Garbo A, German BJ (2016) Comparison of adaptive design space exploration methods applied to S-duct CFD simulation. In: 57th AIAA/ASCE/AHS/ASC structures, structural dynamics, and materials conference, p 0416
Garbo A, German BJ (2017) Adaptive sampling with adaptive surrogate model selection for computer experiment applications. In: 18th AIAA/ISSMO multidisciplinary analysis and optimization conference, p 4430
Garbo A, German BJ (2019) Performance assessment of a cross-validation sampling strategy with active surrogate model selection. Struct Multidiscip Optim. https://doi.org/10.1007/s00158-018-02190-7
Gorissen D (2007) Heterogeneous evolution of surrogate models. Master’s thesis, Katholieke Universiteit Leuven, Belgium
Gorissen D, De Tommasi L, Crombecq K, Dhaene T (2009) Sequential modeling of a low noise amplifier with neural networks and active learning. Neural Comput Applic 18(5):485–494
Gorodetsky A, Marzouk Y (2016) Mercer kernels and integrated variance experimental design: connections between Gaussian process regression and polynomial approximation. SIAM/ASA Journal on Uncertainty Quantification 4(1):796–828
Grobler C, Kok S, Wilke DN (2017) Simple intuitive multi-objective parallelization of efficient global optimization: simple-ego. In: World congress of structural and multidisciplinary optimisation. Springer, pp 205–220
Gunn SR (1998) Support vector machines for classification and regression. ISIS Technical Report 14:85–86
Hancer E, Xue B, Zhang M, Karaboga D, Akay B (2018) Pareto front feature selection based on artificial bee colony optimization. Inf Sci 422:462–479
Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76 (8):1905–1915
van der Herten J, Couckuyt I, Deschrijver D, Dhaene T (2015) A fuzzy hybrid sequential design strategy for global surrogate modeling of high-dimensional computer experiments. SIAM J Sci Comput 37(2):A1020–A1039
Jiang C, Cai X, Qiu H, Gao L, Li P (2018) A two-stage support vector regression assisted sequential sampling approach for global metamodeling. Struct Multidiscip Optim 58(4):1657–1672
Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13
Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In: ASME 2002 International design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers, pp 539–548
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492
Klee V (1980) On the complexity of d-dimensional Voronoi diagrams. Arch Math 34(1):75–80
Kleijnen JP, Van Beers WC (2004) Application-driven sequential designs for simulation experiments: kriging metamodelling. J Oper Res Soc 55(8):876–883
Lee TH (2003) The design of CMOS radio-frequency integrated circuits. University Press, Cambridge UK
Liao X, Li Q, Yang X, Zhang W, Li W (2008) Multiobjective optimization for crash safety design of vehicles using stepwise regression model. Struct Multidiscip Optim 35(6):561–569
Liu H, Xu S, Ma Y, Chen X, Wang X (2016) An adaptive Bayesian sequential sampling approach for global metamodeling. J. Mech. Des. 138(1)
Liu H, Ong YS, Cai J (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416
Lovison A, Rigoni E (2011) Adaptive sampling with a lipschitz criterion for accurate metamodeling. Communications in Applied and Industrial Mathematics 1(2):110–126
Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808
Marcy P (2014) On the use and utility of gradient information in computer experiments. Ph.D. thesis, University of Wyoming. Department of Statistics USA
Mehdad E, Kleijnen JP (2018) Stochastic intrinsic kriging for simulation metamodeling. Appl Stoch Model Bus Ind 34(3): 322–337
Mishra PK, Nath SK, Sen MK, Fasshauer GE (2015) Hybrid gaussian-cubic radial basis functions for scattered data interpolation. arXiv preprint
Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of derivatives in surface prediction. Technometrics 35(3):243–255
Plumlee M, Apley DW (2016) Lifted brownian kriging models Technometrics (just-accepted)
Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, Tucker PK (2005) Surrogate-based analysis and optimization. Prog Aerosp Sci 41(1):1–28
Rasmussen CE, Williams CK (2006) Gaussian processes for machine learning. Tech. Rep. ISBN 0-262-18253-X, Cambridge, MA USA
Santner TJ, Williams BJ, Notz WI (2013) The design and analysis of computer experiments. Springer, Berlin
Shan S, Wang GG (2010) Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optim 41(2):219–241
Shoemaker CA, Akhtar T (2019) An adaptive population-based candidate search algorithm with surrogates for global multi objective optimization of expensive functions. In: AIP Conference proceedings, vol 2070. AIP Publishing, p 020047
Simpson TW, Lin DK, Chen W (2001) Sampling strategies for computer experiments: design and analysis. International Journal of Reliability and Applications 2(3):209–240
Simpson TW, Poplinski J, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150
Tarter ME (1968) Inverse cumulative approximation and applications. Biometrika 55(1):29–41. https://doi.org/10.1093/biomet/55.1.29
Wang B, Hao P, Li G, Fang Y, Wang X, Zhang X (2013) Determination of realistic worst imperfection for cylindrical shells using surrogate model. Struct Multidiscip Optim 48(4):777–794
Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on voronoi diagram and cross validation. J Mech Des 136(7):071,009
Yan C, Shen X, Guo F (2018) An improved support vector regression using least squares method. Struct Multidiscip Optim 57(6): 2431–2445. https://doi.org/10.1007/s00158-017-1871-5
Yegnanarayana B (2009) Artificial neural networks. PHI Learning Pvt Ltd
Zhang Y, Kim NH, Haftka RT (2019) General surrogate adaptive sampling using interquartile range for design space exploration. In: AIAA Scitech 2019 forum, p 2213
Zhang Y, Neelakantan A, Park C, Kim NH, Lam H, Haftka RT (2019) Adaptive sampling with varying sampling cost for design space exploration. AIAA J: 1–12
Zhou Q, Shao X, Jiang P, Gao Z, Zhou H, Shu L (2016) An active learning variable-fidelity metamodelling approach based on ensemble of metamodels and objective-oriented sequential sampling. J Eng Des 27(4-6):205–231
Funding
This material is based upon work supported by the USA National Science Foundation under Grant No. 1537782.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Raphael Haftka
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Garbo, A., German, B.J. A model-independent adaptive sequential sampling technique based on response nonlinearity estimation. Struct Multidisc Optim 61, 1051–1069 (2020). https://doi.org/10.1007/s00158-019-02404-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-019-02404-6