Sequential Design of Computer Experiments for Constrained Optimization
This paper proposes a sequential method of designing computer or physical experiments when the goal is to optimize one integrated signal function subject to constraints on the integral of a second response function. Such problems occur, for example, in industrial problems where the computed responses depend on two types of inputs: manufacturing variables and noise variables. In industrial settings, manufacturing variables are determined by the product designer; noise variables represent field conditions which are modeled by specifying a probability distribution for these variables. The update scheme of the proposed method selects the control portion of the next input site to maximize a posterior expected “improvement” and the environmental portion of this next input is selected to minimize the mean square prediction error of the objective function at the new control site. The method allows for dependence between the objective and constraint functions. The efficacy of the algorithm relative to the single-stage design and relative to a design assuming independent responses is illustrated. Implementation issues for the deterministic and measurement error cases are discussed as are some generalizations of the method.
KeywordsComputer Experiment Constraint Function Sequential Design Spatial Autoregressive Model Control Portion
Unable to display preview. Download preview PDF.
This work was sponsored, in part, by grants DMS-0406026 and DMS-0806134 (The Ohio State University) from the National Science Foundation. The authors would like to thank Han Gang for computational help.
- Chang, P. B.,Williams, B. J., Bawa Bhalla, K. S., Belknap, T.W., Santner, T. J., Notz,W. I.&Bartel, D. L. (2001). Robust design and analysis of total joint replacements: Finite element model experiments with environmental variables, Journal of Biomechanical Engineering 123: 239– 246.CrossRefGoogle Scholar
- Haylock, R. G. & O’Hagan, A. (1996). On inference for outputs of computationally expensive algorithms with uncertainty on the inputs, in J. Bernardo, J. Berger, A. Dawid & A. Smith (eds), Bayesian Statistics, Vol. 5, Oxford University Press, pp. 629–637.Google Scholar
- Lehman, J. (2002). Sequential Design of Computer Experiments for Robust Parameter Design, PhD thesis, Department of Statistics, Ohio State University, Columbus, OH USA.Google Scholar
- O’Hagan, A. (1992). Some bayesian numerical analysis, in J. Bernardo, J. Berger, A. Dawid & A. Smith (eds), Bayesian Statistics, Vol. 4, Oxford University Press, pp. 345–363.Google Scholar
- Ong, L.-T. (2004). Stability of Uncemented Acetabular Components: Design, Patient-Dependent, and Surgical Effects & Complications Due to Trapped Interfacial Fluid, PhD thesis, Sibley School of Mechanical and Aerospace Engineering, Cornell University.Google Scholar
- Schonlau, M., Welch, W. J. & Jones, D. R. (1997). Global versus local search in constrained optimization of computer models, Technical Report RR-97-11, University of Waterloo and General Motors.Google Scholar
- Schonlau, M., Welch, W. J. & Jones, D. R. (1998). Global versus local search in constrained optimization of computer models, in N. Flournoy, W. Rosenberger & W. Wong (eds), New Developments and Applications in Experimental Design, Vol. 34, Institute of Mathematical Statistics, pp. 11–25.Google Scholar
- Williams, B. J., Santner, T. J. & Notz,W. I. (2000a). Sequential design of computer experiments for constrained optimization of integrated response functions, Technical Report 658, Department of Statistics, The Ohio State University.Google Scholar