Skip to main content
SpringerLink
Log in

A Survey of Diversity Oriented Optimization: Problems, Indicators, and Algorithms

  • Chapter
  • First Online:
Book cover EVOLVE – A Bridge between Probability, Set Oriented Numerics and Evolutionary Computation VII

Part of the book series: Studies in Computational Intelligence ((SCI,volume 662))

Abstract

In this chapter it is discussed, how the concept of diversity plays a crucial role in contemporary (multi-objective) optimization algorithms. It is shown that diversity maintenance can have a different purpose, such as improving global convergence reliability or finding alternative solutions to a (multi-objective) optimization problem. Moreover, different algorithms are reviewed that put special emphasis on diversity maintenance, such as multicriteria evolutionary optimization algorithms, multimodal optimization, artificial immune systems, and techniques from set oriented numerics. Diversity maintenance enters in different search operators and is used for different reasons in these algorithms. Among them we highlight evolutionary, swarm-based, artificial immune system-based, and indicator-based approaches to diversity optimization. In order to understand indicator-based approaches, we will review some of the most common diversity indices that can be used to quantitatively assess diversity. Based on the discussion, ’diversity oriented optimization’ is suggested as a term encompassing optimization techniques that adress diversity maintainance as a major ingredient of the search paradigm. To bring order into all these different approaches, an ontology on diversity oriented optimization is proposed. It provides a systematic overview of the various concepts, methods, and applications and it can be extended in future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alba, E., Dorronsoro, B.: Cellular Genetic Algorithms, Operations Research/Computer Science Interfaces, vol. 42. Springer, Heidelberg (2008)

    MATH  Google Scholar 

  2. Beekman, M., Sword, G.A., Simpson, S.J.: Biological foundations of swarm intelligence. In: Blum, C., Merkle, D. (eds.) Swarm Intelligence, Natural Computing Series, pp. 3–41. Springer, Heidelberg (2008)

    Google Scholar 

  3. Branke, J., Kaußler, T., Smidt, C., Schmeck, H.: A multi-population approach to dynamic optimization problems. In: Parmee, I. (ed.) Proceedings of the 4th International Conference on Adaptive Computing in Design and Manufacture (ACDM’2000, Plymouth, UK, April 26–28, 2000), pp. 299–307. Springer, Heidelberg (2000)

    Google Scholar 

  4. Burnet, F.: Clonal selection and after. In: Bell, G.I., Perelson, A.S., Pimbley Jr., G.H. (eds.) Theoretical Immunology, pp. 63–85. Marcel Dekker Inc., New York (1978)

    Google Scholar 

  5. de Castro, L., Von Zuben, F.: Learning and optimization using the clonal selection principle. Evol. Comput. IEEE Trans. 6(3), 239–251 (2002)

    Article  Google Scholar 

  6. Ceriani, L., Verme, P.: The origins of the Gini index: Extracts from Variabilità e Mutabilità (1912) by Corrado Gini. J. Econ. Inequal. 10(3), 421–443 (2012)

    Article  Google Scholar 

  7. Coelho, G.P., von Zuben, F.J.: Omni-aiNet: An immune-inspired approach for omni optimization. In: Bersini, H., Carneiro, J. (eds.) Proceeding of the 5th International Conference on Artificial Immune Systems (ICARIS, Oeiras, Portugal, September 4–6, 2006). Lecture Notes in Computer Science, vol. 4163, pp. 294–308. Springer, Heidelberg (2006)

    Google Scholar 

  8. Coelho, G.P., Von Zuben, F.J.: A concentration-based artificial immune network for multi-objective optimization. In: Takahashi, R.H.C., et al. (eds.) Proceedings of the 6th International Conference on Evolutionary Multi-Criterion Optimization (EMO 2011, Ouro Preto, Brazil, April 5–8, 2011). Lecture Notes in Computer Science, vol. 6576, pp. 343–357. Springer, Heidelberg (2011)

    Google Scholar 

  9. de Castro, L., Timmis, J.: An artificial immune network for multimodal function optimization. In: Proceedings of the 2002 Congress on Evolutionary Computation, (CEC 2002, Honolulu, Hawaii, USA, May 12–17, 2002), vol. 1, pp. 699–704. IEEE (2002)

    Google Scholar 

  10. Deb, K.: Innovization: Discovery of innovative solution principles using multi-objective optimization. In: Purshouse, R., et al. (eds.) Proceedings of the 7th International Conference on Evolutionary Multi-Criterion Optimization (EMO 2013, Sheffield, UK, March 19–22, 2013), pp. 4–5. Springer, Heidelberg (2013)

    Google Scholar 

  11. Deb, K., Srinivasan, A.: Innovization: Innovating design principles through optimization. In: Cattolico, M. (ed.) Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO’06, Seattle, WA, USA, July 08–12, 2006), pp. 1629–1636. ACM, New York (2006)

    Google Scholar 

  12. Deb, K., Srinivasan, A.: Innovization: Discovery of innovative design principles through multiobjective evolutionary optimization. In: Knowles, J., et al. (eds.) Multiobjective Problem Solving from Nature, Natural Computing Series, pp. 243–262. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  13. Deb, K., Tiwari, S.: Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization. Eur. J. Oper. Res. 185(3), 1062–1087 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  14. Emmerich, M.T., Deutz, A.H., Kruisselbrink, J.: On quality indicators for black-box level set approximation. In: Tantar, E., et al. (eds.) EVOLVE - A bridge between Probability, Set Oriented Numerics and Evolutionary Computation, Studies in Computational Intelligence, vol. 447, pp. 157–185. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  15. Ghosh, J.B.: Computational aspects of the maximum diversity problem. Oper. Res. Lett. 19(4), 175–181 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  16. Gruber, T.R.: A translation approach to portable ontology specifications. Knowl. Acquis. 5(2), 199–220 (1993)

    Article  Google Scholar 

  17. Guiasu, R.C., Guiasu, S.: The Rich-Gini-Simpson quadratic index of biodiversity. Nat. Sci. 2(10), 1130–1137 (2010)

    Google Scholar 

  18. Jerne, N.K.: Towards a network theory of the immune system. Ann. Immunol. 125C, 373–389 (1974)

    Google Scholar 

  19. Jin, Y., Branke, J.: Evolutionary optimization in uncertain environments-a survey. IEEE Trans. Evol. Comput. 9(3), 303–317 (2005)

    Article  Google Scholar 

  20. Jost, L.: Entropy and diversity. OIKOS 113(2), 363–375 (2006)

    Article  Google Scholar 

  21. Knowles, J.: Closed-loop evolutionary multiobjective optimization. IEEE Comput. Intell. Mag. 4(3), 77–91 (2009)

    Article  Google Scholar 

  22. Knowles, J., Corne, D.: The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation. In: P.J. Angeline, et al. (eds.) Proceedings of the 1999 Congress on Evolutionary Computation (CEC 99, Washington, USA, July 6–9, 1999), vol. 1, pp. 98–105. IEEE, New Jersey (1999)

    Google Scholar 

  23. Laumanns, M., Rudolph, G., Schwefel, H.P.: A spatial predator-prey approach to multi-objective optimization: A preliminary study. In: Eiben, A.E., et al. (eds.) Proceedings of the 5th International Conference on Parallel Problem Solving from Nature (PPSN V, Amsterdam, The Netherlands, September 27–30, 1998). Lecture Notes in Computer Science, vol. 1498, pp. 241–249. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  24. Parmee, I.C., Bonham, C.R.: Towards the support of innovative conceptual design through interactive designer/evolutionary computing strategies. AI EDAM 14(1), 3–16 (2000)

    Article  Google Scholar 

  25. Pauling, L.: The Nature of the Chemical Bond and the Structure of Molecules and Crystals: An Introduction to Modern Structural Chemistry, vol. 18, 3d edn. Cornell University Press, Ithaca (1960)

    Google Scholar 

  26. Preuß, M., Wessing, S.: Measuring multimodal optimization solution sets with a view to multiobjective techniques. In: Emmerich, M.T., et al. (eds.) Proceedings of the 4th International Conference: EVOLVE-A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation (EVOLVE 2013, Leiden, The Netherlands, July 10–13, 2013), Advances in Intelligent Systems and Computing, vol. 227, pp. 123–137. Springer, Heidelberg (2013)

    Google Scholar 

  27. Reehuis, E., Kruisselbrink, J., Olhofer, M., Graening, L., Sendhoff, B., Bäck, T.: Model-guided evolution strategies for dynamically balancing exploration and exploitation. In: Hao, J., et al. (eds.) Proceedings of the 10th International Conference on Artificial Evolution, (EA 2011, Angers, France, October 24–26, 2011), pp. 306–317. Springer, Heidelberg (2011)

    Google Scholar 

  28. Schönemann, L., Emmerich, M.T., Preuß, M.: On the extinction of evolutionary algorithm subpopulations on multimodal landscapes. Informatica (Slowenien) 28(4), 345–351 (2004)

    Google Scholar 

  29. Schütze, O., Vasile, M.: Coello Coello, C.A.: Approximate solutions in space mission design. In: Proceedings of the 10th International Conference on Parallel Problem Solving from Nature (PPSN X. Dortmund, Germany, September 13–17, 2008). Lecture Notes in Computer Science, vol. 5199, pp. 805–814. Springer, Berlin (2008)

    Google Scholar 

  30. Shir, O., Beltrani, V., Bäck, T., Rabitz, H., Vrakking, M.: On the diversity of multiple optimal controls for quantum systems. J. Phys. B At. Mol. Opt. Phys. 41(7), (2008)

    Google Scholar 

  31. Shir, O., Preuß, M., Naujoks, B., Emmerich, M.: Enhancing decision space diversity in evolutionary multiobjective algorithms. Evolutionary Multi-Criterion Optimization. Studies in Computational Intelligence, pp. 95–109. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  32. Shir, O.M.: Niching in evolutionary algorithms. In: Rozenberg, G., Bäck, T., Kok, J.N. (eds.) Handbook of Natural Computing: Theory, Experiments, and Applications, pp. 1035–1069. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  33. Simpson, E.H.: Measurement of diversity. Nature 163(4148), 688 (1949)

    Article  MATH  Google Scholar 

  34. Solow, A., Polasky, S., Broadus, J.: On the measurement of biological diversity. J. Environ. Econ. Manag. 24(1), 60–68 (1993)

    Article  Google Scholar 

  35. Solow, A.R., Polasky, S.: Measuring biological diversity. Environ. Ecol. Stat. 1(2), 95–107 (1994)

    Article  Google Scholar 

  36. Stoean, C., Preuß, M., Stoean, R., Dumitrescu, D.: Multimodal optimization by means of a topological species conservation algorithm. IEEE Trans. Evol. Comput. 14(6), 842–864 (2010)

    Article  Google Scholar 

  37. Tudorache, T., Nyulas, C., Noy, N.F., Musen, M.A.: WebProtégé: A collaborative ontology editor and knowledge acquisition tool for the web. Semant. web 4(1), 89–99 (2013)

    Google Scholar 

  38. Ulrich, T.: Exploring structural diversity in evolutionary algorithms. Ph.D. thesis, ETH Zurich, TIK Institut für Technische Informatik und Kommunikationsnetze (2012)

    Google Scholar 

  39. Ulrich, T., Bader, J., Thiele, L.: Defining and optimizing indicator-based diversity measures in multiobjective search. In: Schaefer, R., et al. (eds.) Proceedings of the 11th International Conference on Parallel Problem Solving from Nature: Part I (PPSN XI, Krakow, Poland, September 11–15, 2010), pp. 707–717. Springer, Heidelberg (2010)

    Google Scholar 

  40. Ulrich, T., Bader, J., Zitzler, E.: Integrating decision space diversity into hypervolume-based multiobjective search. In: Pelikan, M., Branke, J. (eds.) Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation (GECCO’10, Portland, USA, July 07–11, 2010), pp. 455–462. ACM, New York (2010)

    Google Scholar 

  41. Ulrich, T., Thiele, L.: Maximizing population diversity in single-objective optimization. In: Krasnogor, N., Lanzi, P.L. (eds.) Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation (GECCO ’11, Dublin, Ireland, July 12–16, 2011), pp. 641–648. ACM, New York (2011)

    Google Scholar 

  42. van der Horst, E., Marqués-Gallego, P., Mulder-Krieger, T., van Veldhoven, J., Kruisselbrink, J., Aleman, A., Emmerich, M.T., Brussee, J., Bender, A.: IJzerman, A.P.: Multi-objective evolutionary design of adenosine receptor ligands. J. Chem. Inf. Model. 52(7), 1713–1721 (2012)

    Google Scholar 

  43. Weitzman, M.L.: On diversity. Q. J. Econ. 107(2), 363–405 (1992)

    Article  MATH  Google Scholar 

  44. Yevseyeva, I., Guerreiro, A.P., Emmerich, M.T., Fonseca, C.M.: A portfolio optimization approach to selection in multiobjective evolutionary algorithms. In: Bartz-Beielstein, T., et al. (eds.) Proceedings of the 13th International Conference on Parallel Problem Solving from Nature (PPSN XIII, Ljubljana, Slovenia, September 13–17, 2014). Lecture Notes in Computer Science, vol. 8672, pp. 672–681. Springer, Heidelberg (2014)

    Google Scholar 

  45. Yevseyeva, I., Lenselink, E.B., de Vries, A., Ijzerman, A.P., Deutz, A.H., Emmerich, M.T.: Multiobjective portfolio optimization for drug discovery using deterministic and stochastic methods. In: M.J. Geiger (ed.) Abstracts of the 23d International Conference on Multicriteria Decision Making (MCDM 2015 - Bridging Disciplines, Hamburg, Germany, August 2–7 (2015)

    Google Scholar 

  46. Zadorojniy, A., Masin, M., Greenberg, L., Shir, O.M., Zeidner, L.: Algorithms for finding maximum diversity of design variables in multi-objective optimization. Procedia Comput. Sci. 8, 171–176 (2012)

    Article  Google Scholar 

  47. Zechman, E., Ranjithan, S.: An evolutionary algorithm to generate alternatives (EAGA) for engineering optimization problems. Eng. Optim. 36(5), 539–553 (2004)

    Article  MathSciNet  Google Scholar 

  48. Zechman, E., Ranjithan, S.: Evolutionary computation-based methods for characterizing contaminant sources in a water distribution system. J. Water Res. Planning Manag. 135(5), 334–343 (2009)

    Article  Google Scholar 

  49. Zitzler, E., Künzli, S.: Indicator-based selection in multiobjective search. In: Yao, X. (ed.) Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN VIII, Birmingham, UK, September 18–22, 2004), pp. 832–842. Springer-Verlag, Berlin, Heidelberg (2004)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Polytechnic Institute of Leiria, Instituto Universitário De Lisboa (ISCTE-IUL), University Institute of Lisbon (ISTAR-IUL), 1649-026, Lisboa, Portugal

    Vitor Basto-Fernandes

  2. Faculty of Technology, School of Computer Science and Informatics, De Montfort University, Leicester, LE1 9BH, UK

    Iryna Yevseyeva

  3. Leiden University, 2333, CA Leiden, The Netherlands

    André Deutz & Michael Emmerich

Authors
  1. Vitor Basto-Fernandes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iryna Yevseyeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. André Deutz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Emmerich
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vitor Basto-Fernandes .

Editor information

Editors and Affiliations

  1. Leiden Institute of Advanced Com. Sci., Leiden University Leiden Institute of Advanced Com. Sci., CA Leiden, The Netherlands

    Michael Emmerich

  2. Leiden Institute of Advanced Com. Sci., Leiden University Leiden Institute of Advanced Com. Sci., CA Leiden, The Netherlands

    André Deutz

  3. Depto. de Ingeniería Eléctrica, CINVESTAV-IPN Depto. de Ingeniería Eléctrica, México, D.F., Mexico

    Oliver Schütze

  4. University of Bordeaux, Université Bordeaux Victoire , Bordeaux Cedex, France

    Pierrick Legrand

  5. Luxembourg Centre for Systems Biomedicin, University of Luxembourg Luxembourg Centre for Systems Biomedicin, Belval, Luxembourg

    Emilia Tantar

  6. Computer Science & Comm. Research Unit, University of Luxembourg Computer Science & Comm. Research Unit, Luxembourg, Luxembourg

    Alexandru-Adrian Tantar

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Basto-Fernandes, V., Yevseyeva, I., Deutz, A., Emmerich, M. (2017). A Survey of Diversity Oriented Optimization: Problems, Indicators, and Algorithms. In: Emmerich, M., Deutz, A., Schütze, O., Legrand, P., Tantar, E., Tantar, AA. (eds) EVOLVE – A Bridge between Probability, Set Oriented Numerics and Evolutionary Computation VII. Studies in Computational Intelligence, vol 662. Springer, Cham. https://doi.org/10.1007/978-3-319-49325-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49325-1_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49324-4

  • Online ISBN: 978-3-319-49325-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation