Advertisement

Applied Intelligence

, Volume 49, Issue 2, pp 513–531 | Cite as

Surrogate model assisted cooperative coevolution for large scale optimization

  • Zhigang RenEmail author
  • Bei Pang
  • Muyi Wang
  • Zuren Feng
  • Yongsheng Liang
  • An Chen
  • Yipeng Zhang
Article
  • 75 Downloads

Abstract

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a ‘divide-and-conquer’ strategy. However, its performance is severely restricted by the current context-vector-based sub-solution evaluation method, since this method needs to invoke the original high dimensional simulation model when evaluating each sub-solution, thus requiring many computation resources. To alleviate this issue, this study proposes a novel surrogate model assisted cooperative coevolution (SACC) framework. SACC constructs a surrogate model for each sub-problem and employs it to evaluate corresponding sub-solutions. The original simulation model is only adopted to reevaluate a small number of promising sub-solutions selected by surrogate models, and these really evaluated sub-solutions will in turn be employed to update surrogate models. By this means, the computation cost could be greatly reduced without significantly sacrificing evaluation quality. By taking the radial basis function (RBF) and the success-history based adaptive differential evolution (SHADE) as surrogate model and optimizer, respectively, this study further designs a concrete SACC algorithm named RBF-SHADE-SACC. RBF and SHADE have only been proved to be effective on small and medium scale problems. This study scales them up to LSOPs under the SACC framework, where they are tailored to a certain extent for adapting to the characteristics of LSOPs and SACC. Empirical studies on IEEE CEC 2010 benchmark functions demonstrate that SACC can significantly enhance the sub-solution evaluation efficiency, and even with much fewer computation resources, RBF-SHADE-SACC can find much better solutions than traditional CC algorithms.

Keywords

Cooperative coevolution (CC) Large scale optimization problem (LSOP) Surrogate model Radial basis function (RBF) Success-history based adaptive differential evolution (SHADE) 

Notes

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 61873199, in part by the Postdoctoral Science Foundation of China under Grants 2014M560784 and 2016T90922, and in part by the Fundamental Research Funds for the Central Universities of China.

References

  1. 1.
    Zhou ZH, Chawla NV, Jin Y, Williams GJ (2014) Big data opportunities and challenges: Discussions from data analytics perspectives. IEEE Comput Intell Mag 9(4):62–74Google Scholar
  2. 2.
    Sabar NR, Abawajy J, Yearwood J (2017) Heterogeneous cooperative co-evolution memetic differential evolution algorithm for big data optimization problems. IEEE Trans Evol Comput 21(2):315–327Google Scholar
  3. 3.
    Bellman RE (1957) Dynamic Programming, ser. Dover Books on Mathematics. Princeton University, PrincetonGoogle Scholar
  4. 4.
    Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239Google Scholar
  5. 5.
    Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: Proceedings of the 3rd Conference on Parallel Problem Solving Nature, pp 249–257Google Scholar
  6. 6.
    Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: A survey. Inf Sci 295:407–428MathSciNetGoogle Scholar
  7. 7.
    Wu Z, Zhao M (2016) Leap on large-scale nonseparable problems. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1808–1814Google Scholar
  8. 8.
    Tang RL, Li X (2018) Adaptive multi-context cooperatively coevolving in differential evolution. Appl Intell 48(9):2719–2729Google Scholar
  9. 9.
    Peng X, Liu K, Jin Y (2016) A dynamic optimization approach to the design of cooperative co-evolutionary algorithms. Knowl-Based Syst 109(2):174–186Google Scholar
  10. 10.
    Lim D, Jin Y, Ong YS, Sendhoff B (2010) Generalizing surrogate-assisted evolutionary computation. IEEE Trans Evol Comput 14(3):329–355Google Scholar
  11. 11.
    Jin Y (2011) Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm &, Evol Comput 1(2):61–70Google Scholar
  12. 12.
    Díaz-Manríquez A, Toscano G, Coello CAC (2017) Comparison of metamodeling techniques in evolutionary algorithms. Soft Comput 21:5647–5663Google Scholar
  13. 13.
    Sun C, Jin Y, Zeng J, Yu Y (2015) A two-layer surrogate-assisted particle swarm optimization algorithm. Soft Comput 19(6):1461–1475Google Scholar
  14. 14.
    Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 71–78Google Scholar
  15. 15.
    Potter MA, De Jong KA (2000) Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evol Comput 8(1):1–29Google Scholar
  16. 16.
    Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999MathSciNetzbMATHGoogle Scholar
  17. 17.
    Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1663–1670Google Scholar
  18. 18.
    Omidvar MN, Li X, Yang Z, Yao X (2010) Cooperative co-evolution for large scale optimization through more frequent random grouping. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1754–1761Google Scholar
  19. 19.
    Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1–8Google Scholar
  20. 20.
    Omidvar MN, Li XD, Mei Y, Yao X (2014) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evol Comput 18(3):378–393Google Scholar
  21. 21.
    Mei Y, Omidvar MN, Li X, Yao X (2016) A competitive divide-and-conquer algorithm for unconstrained large-scale black-box optimization. Acm Trans Math Softw 42(2):13:1–24MathSciNetGoogle Scholar
  22. 22.
    Omidvar MN, Yang M, Mei Y, Li X, Yao X (2017) DG2: A faster and more accurate differential grouping for large-scale black-box optimization. IEEE Trans Evol Comput 21(6):929–942Google Scholar
  23. 23.
    Ren Z, Chen A, Wang L, Liang Y, Pang B (2017) An Efficient Vector-Growth Decomposition Algorithm for Cooperative Coevolution in Solving Large Scale Problems. In: Proceedings of the Conference on Genetic and Evolutionary Computation, pp 41–42Google Scholar
  24. 24.
    Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Tran Evol Comput 16(2):210–224Google Scholar
  25. 25.
    Yang Z, Tang K, Yao X (2008) Self-adaptive Differential Evolution with Neighborhood Search. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 1110–1116Google Scholar
  26. 26.
    Liu B, Zhang Q, Gielen GGE (2014) A Gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192Google Scholar
  27. 27.
    Jin Y, Olhofer M, Sendhoff B (2008) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evol Comput 6(5):481–494Google Scholar
  28. 28.
    Branke J, Schmidt C (2005) Fast convergence by means of fitness estimation. Soft Comput 9(1):13–20Google Scholar
  29. 29.
    Sun C, Zeng J, Pan J, Jin Y (2013) Similarity-based evolution control for fitness estimation in particle swarm optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 1–8Google Scholar
  30. 30.
    Sun C, Jin Y, Cheng R, Ding J, Zeng J (2017) Surrogate-assisted cooperative Swarm optimization of high-dimensional expensive problems. IEEE Trans Evol Comput 21(4):644–660Google Scholar
  31. 31.
    Powell MJD (1992) The theory of radial basis function approximation in 1990. Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions. Oxford University Press, Oxford, pp 105–210Google Scholar
  32. 32.
    Wild SM, Shoemaker C (2013) Global convergence of radial basis function trust region derivative-free algorithms. Siam J Optim 21(3):761–781MathSciNetzbMATHGoogle Scholar
  33. 33.
    Wang H, Jin Y, Doherty J (2017) Committee-based active learning for surrogate-assisted particle swarm optimization of expensive problems. IEEE Trans Cybern 47(9):2664–2677Google Scholar
  34. 34.
    Zhang J, Sanderson AC (2009) JADE: Adaptive Differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958Google Scholar
  35. 35.
    García-Martínez C, Gutiérrez PD, Molina D, Lozano M, Herrera F (2017) Since CEC 2005 competition on real-parameter optimisation: A decade of research, progress and comparative analysis’s weakness. Soft Comput 21:5573–5583Google Scholar
  36. 36.
    Yang M, Omidvar MN, Li C, Li X, Cai Z, Kazimipour B (2017) Efficient resource allocation in cooperative co-evolution for large-scale global optimization. IEEE Trans Evol Comput 21(4):493–505Google Scholar
  37. 37.
    Mahdavi S, Rahnamayan S, Shiri ME (2017) Cooperative co–evolution with sensitivity analysis-based budget assignment strategy for large-scale global optimization. Appl Intell 47:888–913Google Scholar
  38. 38.
    Tang K, Li X, Suganthan PN, Yang Z, Weise T (2010) Benchmark functions for the CEC’2010 special session and competition on large scale global optimization. Technical report Nature Inspired Computation and Applications Laboratory (NICAL), USTC, ChinaGoogle Scholar
  39. 39.
    Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Earlbaum Associates, HillsdalezbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Zhigang Ren
    • 1
    • 2
    Email author
  • Bei Pang
    • 1
  • Muyi Wang
    • 1
  • Zuren Feng
    • 2
  • Yongsheng Liang
    • 1
  • An Chen
    • 1
  • Yipeng Zhang
    • 1
  1. 1.Autocontrol Institute, School of Electronic and Information EngineeringXi’an Jiaotong UniversityXi’anChina
  2. 2.State Key Laboratory for Manufacturing Systems Engineering, School of Electronic and Information EngineeringXi’an Jiaotong UniversityXi’anChina

Personalised recommendations