Skip to main content

Handling Uncertainties in Evolutionary Multi-Objective Optimization

  • Chapter

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5050))

Abstract

Evolutionary algorithms are stochastic search methods that are efficient and effective for solving sophisticated multi-objective (MO) problems. Advances made in the field of evolutionary multi-objective optimization (EMO) are the results of two decades worth of intense research, studying various topics that are unique to MO optimization. However many of these studies assume that the problem is deterministic and static, and the EMO performance generally deteriorates in the presence of uncertainties. In certain situations, the solutions found may not even be implementable in practice. In this chapter, the challenges faced in handling three different forms of uncertainties in EMO will be discussed, including 1) noisy objective functions, 2) dynamic MO fitness landscape, and 3) robust MO optimization. Specifically, the impact of these uncertainties on MO optimization will be described and the approaches/modifications to basic algorithm design for better and robust EMO performance will be presented.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arnold, D.V., Beyer, H.G.: Local performance of the (1+1)-ES in a noisy environment. IEEE Transactions on Evolutionary Computation 6(1), 30–41 (2002)

    Article  MathSciNet  Google Scholar 

  2. Arnold, D.V., Beyer, H.G.: A General Noise Model and Its Effects on Evolution Strategy Performance. IEEE Transactions on Evolutionary Computation 10(4), 380–391 (2006)

    Article  Google Scholar 

  3. Back, T., Hammel, U.: Evolution strategies applied to perturbed objective functions. In: Proceedings of the First IEEE Conference on Evolutionary Computation, vol. 1, pp. 40–45 (1994)

    Google Scholar 

  4. Babbar, M., Lakshmikantha, A., Goldberg, D.E.: Modified NSGA-II to solve Noisy Multi-objective Problems. In: Proceedings of the 2003 Genetic and Evolutionary Computation Conference, Late-Breaking Papers, pp. 21–27 (2003)

    Google Scholar 

  5. Basseur, M., Zitzler, E.: Handling Uncertainty in Indicator-Based Multiobjective Optimization. International Journal of Computational Intelligence Research 2(3), 255–272 (2006)

    Article  MathSciNet  Google Scholar 

  6. Bosman, P., Thierens, D.: The balance between proximity and diversity in multiobjective evolutionary algorithms. IEEE Transactions on Evolutionary Computation 7(2), 174–188 (2003)

    Article  Google Scholar 

  7. Beielstein, T., Markon, S.: Threshold selection, hypothesis tests, and DOC methods. In: Proceedings of the 2002 Congress on Evolutionary Computation, vol. 1, pp. 777–782 (2002)

    Google Scholar 

  8. Beyer, H.G.: Evolutionary algorithms in noisy environments: Theoretical issues and guidelines for practice. Computer Methods in Applied Mechanics and Engineering 186, 239–267 (2000)

    Article  MATH  Google Scholar 

  9. Branke, J.: Evolutionary Optimization in Dynamic Environments. Kluwer Academic Publishers, Dordrecht (2001)

    Google Scholar 

  10. Branke, J.: Reducing the sampling variance when searching for robust solution. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 235–424 (2001)

    Google Scholar 

  11. Branke, J.: Creating robust solutions by means of evolutionary algorithms. In: Proceedings of the Fifth International Conference on Parallel Problem Solving from Nature, pp. 119–128 (1998)

    Google Scholar 

  12. Branke, J., Schmidt, C., Schmeck, H.: Efficient fitness estimation in noisy environments. In: Proceedings of Genetic and Evolutionary Computation, pp. 243–250. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  13. Branke, J., Schmeck, H.: Designing evolutionary algorithms for dynamic optimization problems. In: Tsutsui, S., Ghosh, A. (eds.) Theory and Application of Evolutionary Computation: Recent Trends, pp. 239–262. Springer, Heidelberg (2002)

    Google Scholar 

  14. Buche, D., Stoll, P., Dornberger, R., Koumoutsakos, P.: Multiobjective Evolutionary Algorithm for the Optimization of Noisy Combustion Processes. IEEE Transactions on Systems, Man, and Cybernetics art C: Applications and Reviews 32(4) (2002)

    Google Scholar 

  15. Cobb, H.G.: An investigation into the use of hypermutation as an adaptive operator in genetic algorithms having continuous, time-dependent nonstationary environments. Technical Report AIC-90-001, Naval Research Laboratory, Washington, DC (1990)

    Google Scholar 

  16. Coello Coello, C.A., Aguirre, A.H.: Design of combinational logic circuits through an evolutionary multiobjective optimization approach. Artificial Intelligence for Engineering, Design, Analysis and Manufacture 16(1), 39–53 (2002)

    Google Scholar 

  17. Coello Coello, C.A., Sierra, M.R.: A Coevolutionary Multi-Objective Evolutionary Algorithm. In: Proceedings of the 2003 Congress on Evolutionary Computation, vol. 1, pp. 482–489 (2003)

    Google Scholar 

  18. Deb, K., Gupta, H.: Introducing robustness in multiobjective optimization. Kanpur Genetic Algorithms Lab. (KanGAL), Indian Institue of Technology, Kanpur, India, Technical Report 2004016 (2004)

    Google Scholar 

  19. Deb, K., Padmanabhan, D., Gupta, S., Kumar Mall, A.: Reliability-based multi-objective optimization using evolutionary algorithms. In: Proceedings of the Fourth International Conference on Evolutionary Multi-Criterion Optimization, pp. 66–80 (2007)

    Google Scholar 

  20. Deb, K., Udaya Bhaskara Rao, N., Karthik, S.: Dynamic Multi-Objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-Thermal Power Scheduling. Kanpur Genetic Algorithms Lab. (KanGAL), Indian Institue of Technology, Kanpur, India, Technical Report 2006008 (2006)

    Google Scholar 

  21. Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)

    Article  Google Scholar 

  22. Farina, M., Deb, K., Amato, P.: Dynamic Multiobjective Optimization Problems: Test Cases, Aproximations, and Applications. IEEE Transactions on Evolutionary Computation 8(5), 425–442 (2004)

    Article  Google Scholar 

  23. Farina, M., Amato, P.: A fuzzy definition of ”optimality” for many-criteria optimization problems. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 34(3), 315–326 (2003)

    Article  Google Scholar 

  24. Fieldsend, J.E., Everson, R.M.: Multi-objective Optimisation in the Presence of Uncertainty. In: Proceedings of the 2005 Congress on Evolutionary Computation, vol. 1, pp. 243–250 (2005)

    Google Scholar 

  25. Ghosh, A., Tstutsui, S., Tanaka, H.: Function optimization in non-stationary environment using steady state genetic algorithms with aging of individuals. In: Proceedings of 1998 IEEE Congress on Evolutionary Computation (CEC 1998), pp. 666–671 (1998)

    Google Scholar 

  26. Goldberg, D.E.: The Design of Innovation: Lessons from and for Competent Genetic Algorithms. Kluwer Academic Publishers, Dordrecht (2002)

    MATH  Google Scholar 

  27. Goh, C.K., Tan, K.C.: An investigation on noisy environments in evolutionary multiobjective optimization. IEEE Transactions on Evolutionary Computation 11(3), 354–381 (2007)

    Article  Google Scholar 

  28. Goh, C.K., Tan, K.C.: Evolving the tradeoffs between Pareto-optimality and Robustness in Multi-Objective Evolutionary Algorithms. In: Yang, S., Ong, Y.S., Jin, Y. (eds.) Evolving the tradeoffs between Pareto-optimality and Robustness in Multi-Objective Evolutionary Algorithms, pp. 457–478. Springer, Heidelberg (2007)

    Google Scholar 

  29. Goh, C.K., Tan, K.C., Cheong, C.Y., Ong, Y.S.: Noise Induced Features in Robust Multiobjective Optimization Problems. In: Proceedings of the 2007 IEEE Congress on Evolutionary Computation, pp. 568–575 (2007)

    Google Scholar 

  30. Goh, C.K., Teoh, E.J., Tan, K.C.: Hybrid multiobjective evolutionary design for artificial neural networks. IEEE Transactions on Neural Networks (accepted)

    Google Scholar 

  31. Grefenstette, J.J.: Genetic algorithms for changing environments. In: Proceedings of the Second International Conference on Parallel Problem Solving from Nature, pp. 137–144 (1992)

    Google Scholar 

  32. Grefenstette, J.J., Ramsey, C.L.: An approach to anytime learning. In: Proceedings of the Ninth International Conference on Machine Learning, pp. 41–49 (1987)

    Google Scholar 

  33. Gunawan, S., Azarm, S.: Multi-objective robust optimization using a sensitivity region concept. Structural and Multidisciplinary Optimization 29, 50–60 (2005)

    Article  Google Scholar 

  34. Gupta, H., Deb, K.: Handling constraints in robust multi-objective optimization. In: Proceedings of the 2005 IEEE Congress on Evolutionary Computation, pp. 25–32 (2005)

    Google Scholar 

  35. Hatzakis, I., Wallace, D.: Dynamic Multi-Objective Optimization with Evolutionary Algorithms: A Foward-Looking Approach. In: Proceedings of the 2006 Genetic and Evolutionary Computation Congress, pp. 1201–1208 (2006)

    Google Scholar 

  36. Hughes, E.J.: Evolutionary multi-objective ranking with uncertainty and noise. In: Proceedings of the First Conference on Evolutionary Multi-Criterion Optimization, pp. 329–343 (2001)

    Google Scholar 

  37. Hughes, E.J.: Constraint handling with uncertain and noisy multi-objective evolution. In: Proceedings of the 2001 Congress on Evolutionary Computation, vol. 2, pp. 963–970 (2001)

    Google Scholar 

  38. Hughes, E.J.: Multi-objective Probabilistic Selection Evolutionary Algorithm (MOPSEA). Technical Report No. DAPS/EJH/56/2000, Department of Aerospace, POwer & Sensors, Cranfield University (2000)

    Google Scholar 

  39. Iorio, A.W., Li, X.: A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting. In: Proceedings of the 2004 Genetic and Evolutionary Computation Congress, pp. 537–548 (2004)

    Google Scholar 

  40. Jin, Y., Branke, J.: Evolutionary Optimization in Uncertain Environments–A Survey. IEEE Transactions on Evolutionary Computation 9(3), 303–317 (2005)

    Article  Google Scholar 

  41. Jin, Y., Sendhoff, B.: Constructing Dynamic Optimization Test Problems Using the Multi-objective Optimization Concept. In: Proceedings of the 2004 EvoWorkshops, pp. 525–536 (2004)

    Google Scholar 

  42. Jin, Y., Sendhoff, B.: Tradeoff between performance and robustness: An evolutionary multiobjective approach. In: Proceedings of the Second Conference on Evolutionary Multi-Criterion Optimization, pp. 237–251 (2003)

    Google Scholar 

  43. Keerativuttiumrong, N., Chaiyaratana, N., Varavithya, V.: Multiobjective co-operative coevolutionary genetic algorithm. In: Proceedings of the Seventh International Conference on Parallel Problem Solving from Nature, pp. 288–297 (2002)

    Google Scholar 

  44. Khor, E.F., Tan, K.C., Lee, T.H., Goh, C.K.: A study on distribution preservation mechanism in evolutionary multi-objective optimization. Artificial Intelligence Review 23(1), 31–56 (2005)

    Article  Google Scholar 

  45. Laumanns, M., Zitzler, E., Thiele, L.: A unified model for multi-objective evolutionary algorithms with elitism. In: Proceedings of the 2000 Congress on Evolutionary Computation, vol. 1, pp. 46–53 (2000)

    Google Scholar 

  46. Li, M., Azarm, S., Aute, V.: A multi-objective genetic algorithm for robust design optimization. In: Proceedings of the 2005 Genetic and Evolutionary Computation Conference, pp. 771–778 (2005)

    Google Scholar 

  47. Lim, D., Ong, Y.S., Lim, M.H., Jin, Y.: Single/Multi-objective Inverse Robust Evolutionary Design Methodology in the Presence of Uncertainty. In: Yang, S., Ong, Y.S., Jin, Y. (eds.) Evolutionary Computation in Dynamic and Uncertain Environments, Springer, Heidelberg (in press)

    Google Scholar 

  48. Limbourg, P.: Multi-objective optimization of Problems with Epistemic Uncertainty. In: Proceedings of the Third International Conference on Evolutionary Multi-Criterion Optimization, pp. 413–427 (2005)

    Google Scholar 

  49. Lohn, J.D., Kraus, W.F., Haith, G.L.: Comparing a coevolutionary genetic algorithm for multiobjective optimization. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 1157–1162 (2002)

    Google Scholar 

  50. Lu, H., Yen, G.G.: Rank-based multiobjective genetic algorithm and benchmark test function study. IEEE Transactions on Evolutionary Computation 7(4), 325–343 (2003)

    Article  Google Scholar 

  51. Maneeratana, K., Boonlong, K., Chaiyaratana, N.: Multi-objective Optimisation by Co-operative Co-evolution. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 772–781. Springer, Heidelberg (2004)

    Google Scholar 

  52. Mori, N., Kita, H., Nishikawa, Y.: Adaptation to a changing environment by means of the thermodynamical genetic algorithm. In: Ebeling, W., Rechenberg, I., Voigt, H.-M., Schwefel, H.-P. (eds.) PPSN 1996. LNCS, vol. 1141, pp. 513–522. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  53. Nissen, V., Propach, J.: On the robustness of population based versus point-based optimization in the presence of noise. IEEE Transactions on Evolutionary Computation 2(3), 107–119 (1998)

    Article  Google Scholar 

  54. Ong, Y.S., Nair, P.B., Lum, K.Y.: Min-Max Surrogate Assisted Evolutionary Algorithm for Robust Aerodynamic Design. IEEE Transactions on Evolutionary Computation 10(4), 392–404 (2006)

    Article  Google Scholar 

  55. Paenke, I., Branke, J., Jin, Y.: Efficient Search for Robust Solutions by Means of Evolutionary Algorithms and Fitness Approximation. IEEE Transactions on Evolutionary Computation 10(4), 405–420 (2006)

    Article  Google Scholar 

  56. Potter, M.A., Jong, K.A.: Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evolutionary Computation 8(1), 1–29 (2000)

    Article  Google Scholar 

  57. Rana, S., Whitney, D., Cogswell, R.: Searching in the presence of noise. In: Ebeling, W., Rechenberg, I., Voigt, H.-M., Schwefel, H.-P. (eds.) PPSN 1996. LNCS, vol. 1141, pp. 198–207. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  58. Rattray, M., Shapiro, J.: Noisy fitness evaluations in genetic algorithms and the dynamics of learning. In: Belew, R.K., Vose, M.D. (eds.) Foundations of Genetic Algorithms, vol. 4, pp. 117–139. Morgan Kaufmann, San Francisco (1997)

    Google Scholar 

  59. Ray, T.: Constrained robust optimal design using a multiobjective evolutionary algorithm. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 419–424 (2002)

    Google Scholar 

  60. Rosin, C.D., Belew, R.K.: New methods for competitive coevolution. Evolutionary Computation 5(1), 1–29 (1997)

    Article  Google Scholar 

  61. Rudolph, G.: A partial order approach to noisy fitness functions. In: Proceedings of the 2001 Congress on Evolutionary Computation, vol. 1, pp. 318–325 (2001)

    Google Scholar 

  62. Sano, Y., Kita, H.: Optimization of noisy fitness functions by means of genetic algorithms using history of search with test of estimation. In: Proceedings of the 2002 Congress on Evolutionary Computation, vol. 1, pp. 360–365 (2002)

    Google Scholar 

  63. Singh, A.: Uncertainty based Multi-objective Optimization of Groundwater Remediation Design. Master’s Thesis, University of Illinois at Urbana-Champaign (2003)

    Google Scholar 

  64. Tan, K.C., Goh, C.K.: A Competitive-Cooperation Coevolutionary Paradigm for Dynamic Multi-objective Optimization. IEEE Transactions on Evolutionary Computation (accepted)

    Google Scholar 

  65. Tan, K.C., Yang, Y.J., Goh, C.K.: A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Transactions on Evolutionary Computation 10(5), 527–549 (2006)

    Article  Google Scholar 

  66. Tan, K.C., Cheong, C.Y., Goh, C.K.: Solving multiobjective vehicle routing problem with stochastic demand via evolutionary computation. European Journal of Operational Research 177, 813–839 (2007)

    Article  MATH  Google Scholar 

  67. Tan, K.C., Lee, T.H., Khor, E.F., Ang, D.C.: Design and real-time implementation of a multivariable gyro-mirror line-of-sight stabilization platform. Fuzzy Sets and Systems 128(1), 81–93 (2002)

    Article  MathSciNet  Google Scholar 

  68. Teich, J.: Pareto-front exploration with uncertain objectives. In: Proceedings of the First Conference on Evolutionary Multi-Criterion Optimization, pp. 314–328. Springer, Heidelberg (2001)

    Google Scholar 

  69. Tsutsui, S., Ghosh, A.: A comparative study on the effects of adding perturbations to phenotypic parameters in genetic algorithms with a robust solution searching scheme. In: Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics, pp. 585–591 (1999)

    Google Scholar 

  70. Tsutsui, S., Ghosh, A.: A comparative study on the effects of adding perturbations to phenotypic parameters in genetic algorithms with a robust solution searching scheme. In: Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics, pp. 585–591 (1999)

    Google Scholar 

  71. Tsutsui, S., Ghosh, A.: Genetic algorithms with a robust solution searching scheme. IEEE Transactions on Evolutionary Computation 1(3), 201–208 (1997)

    Article  Google Scholar 

  72. Ursem, R.K.: Multinational GA optimization techniques in dynamic environments. In: Proceedings of the 2000 Genetic and Evolutionary Computation Congress, pp. 19–26 (2000)

    Google Scholar 

  73. Vavak, F., Jukes, K., Fogarty, T.C.: Adaptive combustion balancing in multiple burner boiler using a genetic algorithm with variable range of local search. In: Proceedings of the Seventh International Conference on Genetic Algorithms, pp. 719–726 (1997)

    Google Scholar 

  74. Wineberg, M., Oppacher, F.: Enhancing the GA ability to cope with dynamic environments. In: Proceedings of the 2000 Genetic and Evolutionary Computation Congress, p. 310 (2000)

    Google Scholar 

  75. Zeng, S.Y., Chen, G., Zheng, L., Shi, H., Garis, H., Ding, L., Kang, L.: A Dynamic Multi-objective Evolutionary Algorithm Based on an Orthogonal Design. In: Proceedings of the 2006 IEEE Congress on Evolutionary Computation, pp. 573–580 (2006)

    Google Scholar 

  76. Zhang, Z.: Multiobjective optimization immune algorithm in dynamic environments and its application to greenhouse control. In: Proceedings of the 2005 IEEE Congress on Evolutionary Computation, pp. 714–719 (2005)

    Google Scholar 

  77. Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: Improving the Strength Pareto Evolutionary Algorithm. Technical Report 103, Computer Engineering and Networks Laboratory (TIK), Swiss Federal Institute of Technology (ETH) Zurich, Switzerland (2001)

    Google Scholar 

  78. Zitzler, E., Deb, K., Thiele, L.: Comparison of multiobjective evolutionary algorithms: empirical results. Evolutionary Computation 8(2), 173–195 (2000)

    Article  Google Scholar 

  79. Zitzler, E., Thiele, L.: Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 3(4), 257–271 (1999)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Jacek M. Zurada Gary G. Yen Jun Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Tan, K.C., Goh, C.K. (2008). Handling Uncertainties in Evolutionary Multi-Objective Optimization. In: Zurada, J.M., Yen, G.G., Wang, J. (eds) Computational Intelligence: Research Frontiers. WCCI 2008. Lecture Notes in Computer Science, vol 5050. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68860-0_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-68860-0_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68858-7

  • Online ISBN: 978-3-540-68860-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics