Advertisement

Large-scale evolutionary optimization: a survey and experimental comparative study

  • Jun-Rong Jian
  • Zhi-Hui ZhanEmail author
  • Jun Zhang
Original Article
First Online:
  • 51 Downloads

Abstract

In the last decades, global optimization problems are very common in many research fields of science and engineering and lots of evolutionary computation algorithms have been used to deal with such problems, such as differential evolution (DE) and particle swarm optimization (PSO). However, the algorithms performance rapidly decreases as the increasement of the problem dimension. In order to solve large-scale global optimization problems more efficiently, a lot of improved evolutionary computation algorithms, especially the improved DE or improved PSO algorithms have been proposed. In this paper, we want to analyze the differences and characteristics of various large-scale evolutionary optimization (LSEO) algorithms on some benchmark functions. We adopt the CEC2010 and the CEC2013 large-scale optimization benchmark functions to compare the performance of seven well-known LSEO algorithms. Then, we try to figure out which algorithms perform better on different types of benchmark functions based on simulation results. Finally, we give some potential future research directions of LSEO algorithms and make a conclusion.

Keywords

Differential evolution Particle swarm optimization Large-scale global optimization Large-scale evolutionary optimization algorithms 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

This work was supported in part by the Outstanding Youth Science Foundation under Grant 61822602, in part by the National Natural Science Foundations of China (NSFC) under Grant 61772207 and Grant 61873097, in part by the Guangdong Natural Science Foundation Research Team under Grant 2018B030312003, and in part by the Guangdong-Hong Kong Joint Innovation Platform under Grant 2018B050502006.

References

  1. 1.
    Shi GY, Dong JL (2002) Optimization methods. Higher Education Press, BeijingGoogle Scholar
  2. 2.
    Fletcher R (1987) Practical methods of optimization. Wiley-Interscience, New YorkzbMATHGoogle Scholar
  3. 3.
    Holland JH (1992) Genetic algorithms. Sci Am 267(1):66–72CrossRefGoogle Scholar
  4. 4.
    Storn R, Price K (1997) Differential evolution: a simple and efficient heuristic for global optimization over continuous spaces. J Global Opt 11(4):341–359MathSciNetCrossRefGoogle Scholar
  5. 5.
    Storn R (1996) On the usage of differential evolution for function optimization. In: 1996 biennial conference of the North American fuzzy information processing, pp 519–523Google Scholar
  6. 6.
    Cui L, Li G, Lin Q, Chen J, Lu N (2016) Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations. Comput Oper Res 67:155–173MathSciNetCrossRefGoogle Scholar
  7. 7.
    Li G, Lin Q, Cui L, Du Z, Liang Z, Chen J, Lu N, Ming Z (2016) A novel hybrid differential evolution algorithm with modified CoDE and JADE. Appl Soft Comput 47:577–599CrossRefGoogle Scholar
  8. 8.
    Muhlenbein H (1996) From recombination of genes to the estimation of distributions I. binary parameters. In: International Conference on Parallel Problem Solving from Nature. Springer, Berlin, Heidelberg, pp 178–187CrossRefGoogle Scholar
  9. 9.
    Zhang QF, Sun JY, Tsang E, Ford J (2004) Hybrid estimation of distribution algorithm for global optimization. Eng Comput 21(1):91–107CrossRefGoogle Scholar
  10. 10.
    Kennedy J, Eberhart RC (1995) Particle swarm optimization. IEEE Int. Conf. Neural Netw, Perth, pp 1942–1948Google Scholar
  11. 11.
    Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: the 6th Int. Symp. Micromachine Human Sci. Nagoya, pp 39–43Google Scholar
  12. 12.
    Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern B Cybern 26(1):29–41CrossRefGoogle Scholar
  13. 13.
    Cui L, Li G, Luo Y, Chen F, Ming Z, Lu N, Lu J (2018) An enhanced artificial bee colony algorithm with dual-population framework. Swarm Evol Comput 43:184–206CrossRefGoogle Scholar
  14. 14.
    Yang ZY, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999MathSciNetCrossRefGoogle Scholar
  15. 15.
    Liu Y, Yao X, Zhao Q, Higuchi T (2001) Scaling up fast evolutionary programming with cooperative coevolution. In: IEEE Congr. Evol. Comput., pp 1101–1108Google Scholar
  16. 16.
    Descartes R (1956) Discourse on method, 1st edn. Perentice Hall, Upper Saddle RiverGoogle Scholar
  17. 17.
    Potter MA, Jong KAD (1994) A cooperative coevolutionary approach to function optimization. In: International Conference on Parallel Problem Solving from Nature, pp 249–257CrossRefGoogle Scholar
  18. 18.
    Bergh FV, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239CrossRefGoogle Scholar
  19. 19.
    Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Trans Evol Comput 16(2):210–224CrossRefGoogle Scholar
  20. 20.
    Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999MathSciNetCrossRefGoogle Scholar
  21. 21.
    Shi Y, Teng H, Li Z (2005) Cooperative co-evolutionary differential evolution for function optimization. In: International Conference on Natural Computation, pp 1080–1088Google Scholar
  22. 22.
    Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: IEEE Congr. Evol. Comput., pp 1663–1670Google Scholar
  23. 23.
    Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: IEEE Congr. Evol. Comput., pp 1762–1769Google Scholar
  24. 24.
    Omidvar M, Li X, Mei Y, Yao X (2014) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evol Comput 18(3):378–393CrossRefGoogle Scholar
  25. 25.
    Ling YB, Li HJ, Cao B (2016) Cooperative co-evolution with graph-based differential grouping for large scale global optimization. In: IEEE International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, pp 95–102Google Scholar
  26. 26.
    Takahama T, Sakai S (2012) Large scale optimization by differential evolution with landscape modality detection and a diversity archive. In: IEEE Congr. Evol. Comput., pp 2842–2849Google Scholar
  27. 27.
    Kushida J, Hara A, Takahama T (2015) Rank-based differential evolution with multiple mutation strategies for large scale global optimization. In: IEEE Congr. Evol. Comput., pp 353–360Google Scholar
  28. 28.
    Ran C, Jin YC (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204CrossRefGoogle Scholar
  29. 29.
    Ran C, Jin YC (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291:43–60Google Scholar
  30. 30.
    Yang Q, Xie HY, Chen WN, Zhang J (2016) Multiple parents guided differential evolution for large scale optimization. In: IEEE Congr. Evol. Comput., pp 3549–3556Google Scholar
  31. 31.
    Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. In: IEEE Congr. Evol. Comput., pp 3845–3852Google Scholar
  32. 32.
    Molina D, Herrera F (2015) Iterative hybridization of DE with local search for the cec2015 special session on large scale global optimization. In: IEEE Congr. Evol. Comput., pp 1974–1978Google Scholar
  33. 33.
    Ge YF, Yu WJ, Lin Y, Gong YJ, Zhan ZH, Chen WN, Zhang J (2018) Distributed differential evolution based on adaptive mergence and split for large-scale optimization. IEEE Trans Cybern 48(7):2166–2180CrossRefGoogle Scholar
  34. 34.
    Weber M, Neri F, Tirronen V (2011) Shuffle or update parallel differential evolution for large-scale optimization. Appl Soft Comput 15(11):2089–2107CrossRefGoogle Scholar
  35. 35.
    Wang H, Rahnamayan S, Wu ZJ (2013) Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems. J Parallel Distrib Comput 73(1):62–73CrossRefGoogle Scholar
  36. 36.
    Liang JJ, Suganthan PN (2005) Dynamic multi-swarm particle swarm optimizer. In: IEEE Int. Swarm Intelligence Symposium, pp 124–129Google Scholar
  37. 37.
    Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRefGoogle Scholar
  38. 38.
    Tang K, Li X, Suganthan P, Yang Z, Weise T (2009) Benchmark functions for the cec 2010 special session and competition on large scale global optimization. In: Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, ChinaGoogle Scholar
  39. 39.
    Li X, Tang K, Omidvar MN, Yang Z, Qin K (2013) Benchmark functions for the cec 2013 special session and competition on large scale global optimization. In: Evol. Comput. Mach. Learn. Subpopulation, Tech. Rep. RMIT University, MelbourneGoogle Scholar
  40. 40.
    Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: IEEE World Congr. Comput. Intell., pp 69–73Google Scholar
  41. 41.
    Yang Z, Tang K, Yao X (2007) Differential evolution for high-dimensional function optimization In: IEEE Congr. Evol. Comput., pp 3523–3530Google Scholar
  42. 42.
    Zhang X, Du KJ, Zhan ZH, Kwong S, Gu TL, Zhang J (2019) Cooperative co-evolutionary bare-bones particle swarm optimization with function independent decomposition for large-scale supply chain network design with uncertainties. IEEE Trans Cybern.  https://doi.org/10.1109/TCYB.2019.2933499 CrossRefGoogle Scholar
  43. 43.
    Omidvar MN, Li X, Yao X (2011) Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms. In: Conference on Genetic and Evolutionary Computation, pp 1115–1122Google Scholar
  44. 44.
    Omidvar MN, Kazimipour B, Li X, Yao X (2016) CBCC3—a contribution-based cooperative co-evolutionary algorithm with improved exploration/exploitation balance. In: IEEE Congr. Evol. Comput., pp 3541–3548Google Scholar
  45. 45.
    Wang ZJ, Zhan ZH, Yu WJ, Lin Y, Zhang J, Gu TL, Zhang J (2019) Dynamic group learning distributed particle swarm optimization for large-scale optimization and its application in cloud workflow scheduling. IEEE Trans Cybern.  https://doi.org/10.1109/TCYB.2019.2933499 CrossRefGoogle Scholar
  46. 46.
    Wu G, Mallipeddi R, Suganthan PN, Wang R, Chen H (2016) Differential evolution with multi-population based ensemble of mutation strategies. Inf Sci 329:329–345CrossRefGoogle Scholar
  47. 47.
    Glotic A, Glotic A, Kitak P, Pihler J, Ticar I (2014) Parallel self-adaptive differential evolution algorithm for solving short-term hydro scheduling problem. IEEE Trans Power Syst 29(5):2347–2358CrossRefGoogle Scholar
  48. 48.
    Zhan ZH, Liu X, Zhang H, Yu Z, Weng J, Li Y, Gu T, Zhang J (2017) Cloudde: a heterogeneous differential evolution algorithm and its distributed cloud version. IEEE Trans Parallel Distrib Syst 28(3):704–716CrossRefGoogle Scholar
  49. 49.
    Liu XF, Zhan ZH, Gu TL, Kwong S, Lu Z, Duh HBL, Zhang J (2019) Neural network-based information transfer for dynamic optimization. IEEE Trans Neural Netw Learn Syst.  https://doi.org/10.1109/TNNLS.2019.2920887 CrossRefGoogle Scholar
  50. 50.
    Liu XF, Zhan ZH, Zhang J (2018) Neural network for change direction prediction in dynamic optimization. IEEE Access 6:72649–72662CrossRefGoogle Scholar
  51. 51.
    Zhao H, Zhan ZH, Lin Y, Chen X, Luo XN, Zhang J, Kwong S, Zhang J (2019) Local binary pattern-based adaptive differential evolution for multimodal optimization problems. IEEE Trans Cybern.  https://doi.org/10.1109/TCYB.2019.2927780 CrossRefGoogle Scholar
  52. 52.
    Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Wang H, Kwong S, Zhang J (2019) Automatic niching differential evolution with contour prediction approach for multimodal optimization problems. IEEE Trans Evol Comput.  https://doi.org/10.1109/tevc.2019.2910721
  53. 53.
    Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Yuan HQ, Gu TL, Kwong S, Zhang J (2018) Dual-strategy differential evolution with affinity propagation clustering for multimodal optimization problems. IEEE Trans Evol Comput 22(6):894–908CrossRefGoogle Scholar
  54. 54.
    Zhan ZH, Li J, Cao J, Zhang J, Chung H, Shi YH (2013) Multiple populations for multiple objectives: a coevolutionary technique for solving multiobjective optimization problems. IEEE Trans Cybern 43(2):445–463CrossRefGoogle Scholar
  55. 55.
    Liu XF, Zhan ZH, Gao Y, Zhang J, Kwong S, Zhang J (2019) Coevolutionary particle swarm optimization with bottleneck objective learning strategy for many-objective optimization. IEEE Trans Evol Comput 23(4):587–602CrossRefGoogle Scholar
  56. 56.
    Chen ZG, Zhan ZH, Lin Y, Gong YJ, Yuan HQ, Gu TL, Kwong S, Zhang J (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49(8):2912–2926CrossRefGoogle Scholar
  57. 57.
    Zhan ZH, Liu XF, Gong YJ, Zhang J, Chung HSH, Li Y (2015) Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput Surv 47(4):1–33CrossRefGoogle Scholar
  58. 58.
    Liu XF, Zhan ZH, Deng D, Li Y, Gu TL, Zhang J (2018) An energy efficient ant colony system for virtual machine placement in cloud computing. IEEE Trans Evol Comput 22(1):113–128CrossRefGoogle Scholar
  59. 59.
    Ma L, Gong M, Liu J, Cai Q, Jiao L (2014) Multi-level learning based memetic algorithm for community detection. Appl Soft Comput. 19:121–133CrossRefGoogle Scholar
  60. 60.
    Ma L, Li J, Lin Q, Gong M, Coello CAC, Ming Z (2019) Reliable link inference for network data with community structure. IEEE Trans Cybern 49(9):3347–3361CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Computer Science and EngineeringSouth China University of TechnologyGuangzhouChina
  2. 2.State Key Laboratory of Subtropical Building ScienceSouth China University of TechnologyGuangzhouChina

Personalised recommendations

Cite article

Buy options