Skip to main content
SpringerLink
Log in

Surrogate model assisted cooperative coevolution for large scale optimization

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a ‘divide-and-conquer’ strategy. However, its performance is severely restricted by the current context-vector-based sub-solution evaluation method, since this method needs to invoke the original high dimensional simulation model when evaluating each sub-solution, thus requiring many computation resources. To alleviate this issue, this study proposes a novel surrogate model assisted cooperative coevolution (SACC) framework. SACC constructs a surrogate model for each sub-problem and employs it to evaluate corresponding sub-solutions. The original simulation model is only adopted to reevaluate a small number of promising sub-solutions selected by surrogate models, and these really evaluated sub-solutions will in turn be employed to update surrogate models. By this means, the computation cost could be greatly reduced without significantly sacrificing evaluation quality. By taking the radial basis function (RBF) and the success-history based adaptive differential evolution (SHADE) as surrogate model and optimizer, respectively, this study further designs a concrete SACC algorithm named RBF-SHADE-SACC. RBF and SHADE have only been proved to be effective on small and medium scale problems. This study scales them up to LSOPs under the SACC framework, where they are tailored to a certain extent for adapting to the characteristics of LSOPs and SACC. Empirical studies on IEEE CEC 2010 benchmark functions demonstrate that SACC can significantly enhance the sub-solution evaluation efficiency, and even with much fewer computation resources, RBF-SHADE-SACC can find much better solutions than traditional CC algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhou ZH, Chawla NV, Jin Y, Williams GJ (2014) Big data opportunities and challenges: Discussions from data analytics perspectives. IEEE Comput Intell Mag 9(4):62–74

    Article  Google Scholar 

  2. Sabar NR, Abawajy J, Yearwood J (2017) Heterogeneous cooperative co-evolution memetic differential evolution algorithm for big data optimization problems. IEEE Trans Evol Comput 21(2):315–327

    Article  Google Scholar 

  3. Bellman RE (1957) Dynamic Programming, ser. Dover Books on Mathematics. Princeton University, Princeton

    Google Scholar 

  4. Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239

    Article  Google Scholar 

  5. Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: Proceedings of the 3rd Conference on Parallel Problem Solving Nature, pp 249–257

  6. Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: A survey. Inf Sci 295:407–428

    Article  MathSciNet  Google Scholar 

  7. Wu Z, Zhao M (2016) Leap on large-scale nonseparable problems. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1808–1814

  8. Tang RL, Li X (2018) Adaptive multi-context cooperatively coevolving in differential evolution. Appl Intell 48(9):2719–2729

    Article  Google Scholar 

  9. Peng X, Liu K, Jin Y (2016) A dynamic optimization approach to the design of cooperative co-evolutionary algorithms. Knowl-Based Syst 109(2):174–186

    Article  Google Scholar 

  10. Lim D, Jin Y, Ong YS, Sendhoff B (2010) Generalizing surrogate-assisted evolutionary computation. IEEE Trans Evol Comput 14(3):329–355

    Article  Google Scholar 

  11. Jin Y (2011) Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm &, Evol Comput 1(2):61–70

    Article  Google Scholar 

  12. Díaz-Manríquez A, Toscano G, Coello CAC (2017) Comparison of metamodeling techniques in evolutionary algorithms. Soft Comput 21:5647–5663

    Article  Google Scholar 

  13. Sun C, Jin Y, Zeng J, Yu Y (2015) A two-layer surrogate-assisted particle swarm optimization algorithm. Soft Comput 19(6):1461–1475

    Article  Google Scholar 

  14. Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 71–78

  15. Potter MA, De Jong KA (2000) Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evol Comput 8(1):1–29

    Article  Google Scholar 

  16. Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999

    Article  MathSciNet  MATH  Google Scholar 

  17. Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1663–1670

  18. Omidvar MN, Li X, Yang Z, Yao X (2010) Cooperative co-evolution for large scale optimization through more frequent random grouping. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1754–1761

  19. Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation CEC, pp 1–8

  20. Omidvar MN, Li XD, Mei Y, Yao X (2014) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evol Comput 18(3):378–393

    Article  Google Scholar 

  21. Mei Y, Omidvar MN, Li X, Yao X (2016) A competitive divide-and-conquer algorithm for unconstrained large-scale black-box optimization. Acm Trans Math Softw 42(2):13:1–24

    Article  MathSciNet  Google Scholar 

  22. Omidvar MN, Yang M, Mei Y, Li X, Yao X (2017) DG2: A faster and more accurate differential grouping for large-scale black-box optimization. IEEE Trans Evol Comput 21(6):929–942

    Article  Google Scholar 

  23. Ren Z, Chen A, Wang L, Liang Y, Pang B (2017) An Efficient Vector-Growth Decomposition Algorithm for Cooperative Coevolution in Solving Large Scale Problems. In: Proceedings of the Conference on Genetic and Evolutionary Computation, pp 41–42

  24. Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Tran Evol Comput 16(2):210–224

    Article  Google Scholar 

  25. Yang Z, Tang K, Yao X (2008) Self-adaptive Differential Evolution with Neighborhood Search. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 1110–1116

  26. Liu B, Zhang Q, Gielen GGE (2014) A Gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192

    Article  Google Scholar 

  27. Jin Y, Olhofer M, Sendhoff B (2008) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evol Comput 6(5):481–494

    Google Scholar 

  28. Branke J, Schmidt C (2005) Fast convergence by means of fitness estimation. Soft Comput 9(1):13–20

    Article  Google Scholar 

  29. Sun C, Zeng J, Pan J, Jin Y (2013) Similarity-based evolution control for fitness estimation in particle swarm optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 1–8

  30. Sun C, Jin Y, Cheng R, Ding J, Zeng J (2017) Surrogate-assisted cooperative Swarm optimization of high-dimensional expensive problems. IEEE Trans Evol Comput 21(4):644–660

    Article  Google Scholar 

  31. Powell MJD (1992) The theory of radial basis function approximation in 1990. Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions. Oxford University Press, Oxford, pp 105–210

    Google Scholar 

  32. Wild SM, Shoemaker C (2013) Global convergence of radial basis function trust region derivative-free algorithms. Siam J Optim 21(3):761–781

    Article  MathSciNet  MATH  Google Scholar 

  33. Wang H, Jin Y, Doherty J (2017) Committee-based active learning for surrogate-assisted particle swarm optimization of expensive problems. IEEE Trans Cybern 47(9):2664–2677

    Article  Google Scholar 

  34. Zhang J, Sanderson AC (2009) JADE: Adaptive Differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Article  Google Scholar 

  35. García-Martínez C, Gutiérrez PD, Molina D, Lozano M, Herrera F (2017) Since CEC 2005 competition on real-parameter optimisation: A decade of research, progress and comparative analysis’s weakness. Soft Comput 21:5573–5583

    Article  Google Scholar 

  36. Yang M, Omidvar MN, Li C, Li X, Cai Z, Kazimipour B (2017) Efficient resource allocation in cooperative co-evolution for large-scale global optimization. IEEE Trans Evol Comput 21(4):493–505

    Article  Google Scholar 

  37. Mahdavi S, Rahnamayan S, Shiri ME (2017) Cooperative co–evolution with sensitivity analysis-based budget assignment strategy for large-scale global optimization. Appl Intell 47:888–913

    Article  Google Scholar 

  38. Tang K, Li X, Suganthan PN, Yang Z, Weise T (2010) Benchmark functions for the CEC’2010 special session and competition on large scale global optimization. Technical report Nature Inspired Computation and Applications Laboratory (NICAL), USTC, China

  39. Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Earlbaum Associates, Hillsdale

    MATH  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 61873199, in part by the Postdoctoral Science Foundation of China under Grants 2014M560784 and 2016T90922, and in part by the Fundamental Research Funds for the Central Universities of China.

Author information

Authors and Affiliations

  1. Autocontrol Institute, School of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    Zhigang Ren, Bei Pang, Muyi Wang, Yongsheng Liang, An Chen & Yipeng Zhang

  2. State Key Laboratory for Manufacturing Systems Engineering, School of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    Zhigang Ren & Zuren Feng

Authors
  1. Zhigang Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bei Pang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muyi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zuren Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yongsheng Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. An Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yipeng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhigang Ren.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ren, Z., Pang, B., Wang, M. et al. Surrogate model assisted cooperative coevolution for large scale optimization. Appl Intell 49, 513–531 (2019). https://doi.org/10.1007/s10489-018-1279-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-1279-y

Keywords

Search

Navigation