Advertisement

A New Adaptive Hybrid Algorithm for Large-Scale Global Optimization

  • Ninglei Fan
  • Yuping WangEmail author
  • Junhua Liu
  • Yiu-ming Cheung
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11554)

Abstract

Large-scale global optimization (LSGO) problems are one of most difficult optimization problems and many works have been done for this kind of problems. However, the existing algorithms are usually not efficient enough for difficult LSGO problems. In this paper, we propose a new adaptive hybrid algorithm (NAHA) for LSGO problems, which integrates the global search, local search and grouping search and greatly improves the search efficiency. At the same time, we design an automatic resource allocation strategy which can allocate resources to different optimization strategies automatically and adaptively according to their performance and different stages. Furthermore, we propose a self-learning parameter adjustment scheme for the parameters in local search and grouping search, which can automatically adjust parameters. Finally, the experiments are conducted on CEC 2013 LSGO competition benchmark test suite and the proposed algorithm is compared with several state-of-the-art algorithms. The experimental results indicate that the proposed algorithm is pretty effective and competitive.

Keywords

Large scale global optimization Parameter automatical adjustment Global search Local search Grouping search Resource allocation Self-learning 

Notes

Acknowledgments

This work is supported by National Natural Science Foundation of China under the Project 61872281.

References

  1. 1.
    Potter, M.A., De Jong, K.A.: A cooperative coevolutionary approach to function optimization. In: Davidor, Y., Schwefel, H.-P., Männer, R. (eds.) PPSN 1994. LNCS, vol. 866, pp. 249–257. Springer, Heidelberg (1994).  https://doi.org/10.1007/3-540-58484-6_269Google Scholar
  2. 2.
    Salomon, R.: Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. Bio Syst. 39(3), 263–278 (1996)Google Scholar
  3. 3.
    Yang, Z., Tang, K., Yao, X.: Large scale evolutionary optimization using cooperative coevolution. Inf. Sci. 178(15), 2985–2999 (2008)Google Scholar
  4. 4.
    Van den Bergh, F., Engelbrecht, A.P.: A cooperative approach to particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 225–239 (2004)Google Scholar
  5. 5.
    Yang, Z., Tang, K., Yao, X.: Multilevel cooperative coevolution for large scale optimization. In: 2008 IEEE Congress on Evolutionary Computation, Hong Kong, pp. 1663–1670. IEEE Press (2008)Google Scholar
  6. 6.
    Omidvar, M.N., Li, X., Yang, Z., Yao, X.: Cooperative co-evolution for large scale optimization through more frequent random grouping. In: 2010 IEEE Congress on Evolutionary Computation, Barcelona, pp. 1754–1761. IEEE Press (2010)Google Scholar
  7. 7.
    Omidvar, M.N., Li, X., Mei, Y., Yao, X.: Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans. Evol. Comput. 18(3), 378–393 (2014)Google Scholar
  8. 8.
    Mei, Y., Omidvar, M.N., Li, X., Yao, X.: A competitive divide-and-conquer algorithm for unconstrained large-scale black-box optimization. ACM Trans. Math. Softw. 42(2), 1–24 (2016)Google Scholar
  9. 9.
    Omidvar, M.N., Yang, M., Mei, Y., Li, X., Yao, X.: DG2: a faster and more accurate differential grouping for large-scale black-box optimization. IEEE Trans. Evol. Comput. 21(6), 929–942 (2017)Google Scholar
  10. 10.
    Sun, Y., Kirley, M., Halgamuge, S.K.: A recursive decomposition method for large scale continuous optimization. IEEE Trans. Evol. Comput. 22(5), 647–661 (2018)Google Scholar
  11. 11.
    Wang, Y., Liu, H., Wei, F., Zong, T., Li, X.: Cooperative co-evolution with formula-based variable grouping for large-scale global optimization. Evol. Comput. 26(4), 569–596 (2017)Google Scholar
  12. 12.
    Latorre, A., Muelas, S., Pena, J.M.: Large scale global optimization: experimental results with MOS-based hybrid algorithms. In: 2013 IEEE Congress on Evolutionary Computation, Cancun, pp. 2742–2749. IEEE Press (2013)Google Scholar
  13. 13.
    Wang, Y., Li, B.: Two-stage based ensemble optimization for large-scale global optimization. In: 2010 IEEE Congress on Evolutionary Computation, Barcelona, pp. 4488–4495. IEEE Press (2010)Google Scholar
  14. 14.
    Liu, H., Wang, Y., Liu, L.: A two phase hybrid algorithm with a new decomposition method for large scale optimization. Integr. Comput.-Aided Eng. 25(4), 349–367 (2018)Google Scholar
  15. 15.
    Molina, D., Lozano, M., Herrera, F.: MA-SW-Chains: memetic algorithm based on local search chains for large scale continuous global optimization. In: 2010 IEEE Congress on Evolutionary Computation, Barcelona, pp. 1–8. IEEE Press (2010)Google Scholar
  16. 16.
    Brest, J., Boskovic, B., Zamuda, A., Fister, I.: Self-adaptive differential evolution algorithm with a small and varying population size. In: 2012 IEEE Congress on Evolutionary Computation, Brisbane, pp. 2827–2834. IEEE Press (2012)Google Scholar
  17. 17.
    Molina, D., Herrera, F.: Iterative hybridization of DE with local search for the CEC’2015 special session on large scale global optimization. In: 2015 IEEE Congress on Evolutionary Computation, Sendai, pp. 1974–1978. IEEE Press (2015)Google Scholar
  18. 18.
    Solis, F.J., Wets, R.J.B.: Minimization by random search techniques. Math. Oper. Res. 6(1), 19–30 (1981)Google Scholar
  19. 19.
    Tseng, L.Y., Chen, C.C.C.: Multiple trajectory search for large scale global optimization. In: 2008 IEEE Congress on Evolutionary Computation, Hong Kong, pp. 3052–3059. IEEE Press (2008)Google Scholar
  20. 20.
    Yang, Z., Tang, K., Yao, X.: Self-adaptive differential evolution with neighborhood search. In: 2010 IEEE Congress on Evolutionary Computation, Barcelona, pp. 1110–1116. IEEE Press (2010)Google Scholar
  21. 21.
    Li, X., Tang, K., Omidvar, M.N.: Benchmark functions for the CEC 2013 special session and competition on large-scale global optimization. Gene 7(33), 8–30 (2013)Google Scholar
  22. 22.
    Maucec, M.S., Brest, J.: A review of the recent use of differential evolution for large-scale global optimization: an analysis of selected algorithms on the CEC 2013 LSGO benchmark suite. Swarm Evol. Comput. 1–18 (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ninglei Fan
    • 1
  • Yuping Wang
    • 1
    Email author
  • Junhua Liu
    • 1
  • Yiu-ming Cheung
    • 2
  1. 1.School of Computer Science and TechnologyXidian UniversityXi’anChina
  2. 2.Department of Computer ScienceHong Kong Baptist UniversityKowloon, Hong HongChina

Personalised recommendations