Meta-modeling and Optimization for Varying Dimensional Search Space

  • Kalyanmoy Deb
  • Soumil Srivastava
  • Akshay Chawla
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8297)


High-fidelity computer simulations are used widely in several scientific and engineering domains to study, analyze and optimize process responses and reduce the time, cost and risk associated with conducting a physical experiment. However, many such simulations are computationally expensive and impractical for optimization. Meta-models have been successfully used to give quick approximation of the process responses in simulations and facilitate the analysis and optimization of designs.

Despite the abundance of literature in meta-modeling for continuous variables, there have been very few studies in the domain where the design spaces are discrete or mixed or with dependencies between discrete and real variables. These problems are widespread in engineering, science, economics and several other fields. Through this work, we wish to address the lack of a technique to handle such problems from front to end i.e. selecting design samples, meta-modeling and subsequent optimization.

This paper presents novel methods for choosing design samples, meta-modeling of design spaces having binary and real variables using padding in Kriging technique and single-objective constrained optimization of the meta-model using a new genetic algorithm VDGA. These scalable generic methodologies have the potential for solving optimization problems that are very expensive or impractical due to the extremely high computational cost and time associated with the simulations. We also present the results of these techniques on several test problems.


Meta-modeling optimization mixed-variable design space discrete design space evolutionary algorithms 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Box, G.E.P., Hunter, W.G., Hunter, J.S.: Statistics for experimenters. John Wiley & Sons, New York (1978)zbMATHGoogle Scholar
  2. 2.
    Chapra, S.C., Canale, R.: Numerical Methods for Engineers, 5th edn. McGraw-Hill, Inc., New York (2006)Google Scholar
  3. 3.
    Cheng, B., Titterington, D.M.: Neural networks: a review from a statistical perspective. Statistical Science 9, 2–30 (1994)CrossRefzbMATHMathSciNetGoogle Scholar
  4. 4.
    Deb, K.: An efficient constraint handling method for genetic algorithms. Comput. Methods Appl. Mech. Engrg. 186, 311–338 (2000)CrossRefzbMATHGoogle Scholar
  5. 5.
    Deb, K., Agrawal, R.B.: Simulated binary crossover for continuous search space. Complex Systems 9, 115–148 (1995)zbMATHMathSciNetGoogle Scholar
  6. 6.
    Krige, D.G.: A statistical approach to some basic mine valuation problems on the Witwatersrand. Journal of the Chemical, Metallurgical and Mining Society of South Africa 52(6), 119–139 (1951)Google Scholar
  7. 7.
    Lophaven, S., Nielsen, H., Søondergaard, J.D.: A matlab kriging tool- box version 2.0., Technical Report IMM-REP-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark (2002)Google Scholar
  8. 8.
    Meckesheimer, M., Barton, R.R., Simpson, T.W., Limayem, F., Yannou, B.: Meta-modeling of combined discrete/continuous responses. AIAA Journal 39, 1950–1959 (2001)CrossRefGoogle Scholar
  9. 9.
    Nain, P.K.S., Deb, K.: Computationally effective search and optimization procedure using coarse to fine approximations. In: Proceedings of the Congress on Evolutionary Computation (CEC 2003), Canberra, Australia, pp. 2081–2088 (2003)Google Scholar
  10. 10.
    Sacks, J., Welch, W.J., Mitchell, T.J., Wynn, H.P.: Design and analysis of computer experiments. Statistical Science 4, 409–435 (1989)CrossRefzbMATHMathSciNetGoogle Scholar
  11. 11.
    Smith, M.: Neural networks for statistical modeling. Von Nostrand Reinhold, New York (1993)zbMATHGoogle Scholar
  12. 12.
    Srivastava, S.: Algorithms for Meta-modeling and Optimization for Mixed-variables. Master’s Thesis. Indian Institute of Technology Kanpur, Kanpur, UP, India (2011)Google Scholar
  13. 13.
    Jin, R., Chen, W., Simpson, T.W.: Comparative studies of meta-modeling techniques under multiple modeling criteria. Structural and Multidisciplinary Optimization 23, 1–13 (2000)CrossRefGoogle Scholar
  14. 14.
    Simpson, T.W., Mauery, T.M., Korte, J.J., Mistree, F.: Comparison of response surface and kriging models for multidisciplinary design optimization. In: 7th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis & Optimization, vol. 1, pp. 381–391 (1998)Google Scholar
  15. 15.
    Yang, R.J., Gu, L., Liaw, L., Gearhart, C., Tho, C.H., Liu, X., Wang, B.P.: Approximations for safety optimization of large systems. In: ASME Design Automation Conf., pp. DETC– 00/DAC–14245 (2000)Google Scholar
  16. 16.
    Meckesheimer, M., Barton, R.R., Simpson, T.W., Limayem, F., Yannou, B.: Meta-modeling of combined discrete/continuous responses. AIAA Journal 39, 1950–1959 (2001)CrossRefGoogle Scholar
  17. 17.
    Ryerkerk, M., Averill, R., Deb, K., Goodman, E.: Optimization for Variable-Size Problems Using Genetic Algorithms. In: Proceedings of the 14th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Indianapolis, USA, pp. 2012–5569. AIAA, Reston (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Kalyanmoy Deb
    • 1
  • Soumil Srivastava
    • 2
  • Akshay Chawla
    • 2
  1. 1.Michigan State UniversityEast LansingUSA
  2. 2.Indian Institute of Technology KanpurIndia

Personalised recommendations