Advertisement

Neural Computing and Applications

, Volume 31, Issue 12, pp 8423–8440 | Cite as

Adaptive differential search algorithm with multi-strategies for global optimization problems

  • Xianghua Chu
  • Da Gao
  • Jiansheng Chen
  • Jianshuang Cui
  • Can Cui
  • Su Xiu Xu
  • Quande QinEmail author
Original Article
  • 54 Downloads

Abstract

Differential search (DSA) is a recently proposed evolutionary algorithm mimicking the Brownian motion-like random movement existing in living beings. Though it has displayed promise for global optimization, the original DSA suffers from relatively poor search capability, especially for exploitation. In this study, an augmented DSA (ADSA) is proposed by integrating memetic framework with multiple strategies. In ADSA, a sub-gradient strategy is combined to improve local exploitation, and the dynamic Lévy flight technique is developed to strengthen the global exploration. Moreover, a mutation operator based on differential search is used to increase swarm diversity. An intelligent selection method is implemented to adaptively adjust the strategies based on historical performance. To fully benchmark the proposed algorithm, 35 test functions of various properties in 30-D and 100-D are adopted in numerical experiments. Seven canonical optimization algorithms are involved for experimental comparison. In addition, two real-world problems are also tested to verify ADSA’s practical applicability. Numerical results reveal the efficiency and effectiveness of ADSA.

Keywords

Swarm intelligence Differential search algorithm Gradient search Lévy flight 

Notes

Acknowledgements

This work was partially supported by the National Natural Science Foundation of China (Grant No. 71971142 and 71871146), the Major Research plan of the National Natural Science Foundation of China (No. 91846301), the Major Project for National Natural Science Foundation of China (Grant No. 71790615), and the Natural Science Foundation of Guangdong Province (Grant No. 2016A030310067).

Compliance with ethical standards

Conflict of interest

No conflict of interest exists in the submission of this manuscript. I would like to declare on behalf of my co-authors that this manuscript is the authors’ original work and has not been published nor has it been submitted simultaneously elsewhere.

References

  1. 1.
    Chu X, Wu T, Weir JD, Shi Y, Niu B, Li L (2018) Learning–Interaction–diversification framework for swarm intelligence optimizers: a unified perspective. Neural Comput Appl.  https://doi.org/10.1007/s00521-018-3657-0 CrossRefGoogle Scholar
  2. 2.
    Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks. Piscataway, New Jersey, USA, pp 1942–1948Google Scholar
  3. 3.
    Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: IEEE WCCI, IEEE, pp 69–73Google Scholar
  4. 4.
    Saha S, Das R (2018) Exploring differential evolution and particle swarm optimization to develop some symmetry-based automatic clustering techniques: application to gene clustering. Neural Comput Appl 30(3):735–757CrossRefGoogle Scholar
  5. 5.
    Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. IEEE Comput Intell M 1(4):28–39CrossRefGoogle Scholar
  6. 6.
    Dorigo M, Stützle T (2003) The ant colony optimization metaheuristic: Algorithms, applications, and advances. Handbook of metaheuristics. Springer, Boston, pp 250–285CrossRefGoogle Scholar
  7. 7.
    Karaboga D, Akay B (2009) A comparative study of Artificial Bee Colony algorithm. Appl Math Comput 214(1):108–132MathSciNetzbMATHGoogle Scholar
  8. 8.
    Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57CrossRefGoogle Scholar
  9. 9.
    Chu X, Cai F, Cui C, Hu M, Li L, Qin Q (2018) Adaptive recommendation model using meta-learning for population-based algorithms. Inf Sci 476:192–210CrossRefGoogle Scholar
  10. 10.
    Qin Q, Cheng S, Chu X, Lei X, Shi Y (2017) Solving non-convex/non-smooth economic load dispatch problems via an enhanced particle swarm optimization. Appl Soft Comput 59:229–242CrossRefGoogle Scholar
  11. 11.
    Chu X, Chen J, Cai F, Li L, Qin Q (2018) Adaptive brainstorm optimisation with multiple strategies. Memet Comput 10(4):383–396CrossRefGoogle Scholar
  12. 12.
    Chu X, Xu S, Cai F, Chen J, Qin Q (2018) An efficient auction mechanism for regional logistics synchronization. J Intell Manuf.  https://doi.org/10.1007/s10845-018-1410-2 CrossRefGoogle Scholar
  13. 13.
    Milner S, Davis C, Zhang H, Llorca J (2012) Nature-inspired self-organization, control, and optimization in heterogeneous wireless networks. IEEE Trans Mob Comput 11(7):1207–1222CrossRefGoogle Scholar
  14. 14.
    Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531CrossRefGoogle Scholar
  15. 15.
    Marinakis Y, Marinaki M, Migdalas A (2019) A multi-adaptive particle swarm optimization for the vehicle routing problem with time windows. Inf Sci 481:311–329CrossRefGoogle Scholar
  16. 16.
    Wu Z, Tazvinga H, Xia XH (2015) Demand side management of photovoltaic-battery hybrid system. Appl Energy 148:294–304CrossRefGoogle Scholar
  17. 17.
    Chaudhry R, Tapaswi S, Kumar N (2019) Fz enabled multi-objective pso for multicasting in IoT based wireless sensor networks. Inf Sci 498:1–20MathSciNetCrossRefGoogle Scholar
  18. 18.
    Łapa K (2019) Meta-optimization of multi-objective population-based algorithms using multi-objective performance metrics. Inf Sci 489:193–204MathSciNetCrossRefGoogle Scholar
  19. 19.
    Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A Lévy flights-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30(12):3707–3720CrossRefGoogle Scholar
  20. 20.
    Chou JS, Ngo NT (2018) Engineering strength of fiber-reinforced soil estimated by swarm intelligence optimized regression system. Neural Comput Appl 30(7):2129–2144CrossRefGoogle Scholar
  21. 21.
    Civicioglu P (2012) Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm. Comput Geosci-UK 46(3):229–247CrossRefGoogle Scholar
  22. 22.
    Abaci K, Yamacli V (2016) Differential search algorithm for solving multi-objective optimal power flow problem. Int J Electr Power 79:1–10CrossRefGoogle Scholar
  23. 23.
    Bouchekara EH, Abido MA (2014) Optimal power flow using differential search algorithm. Electr Power Compon Syst 42(15):1683–1699CrossRefGoogle Scholar
  24. 24.
    Yousoff SNM, Baharin A, Abdullah A (2017) Differential search algorithm in deep neural network for the predictive analysis of xylitol production in escherichia coli. Asian simulation conference. Springer, Singapore, pp 53–67Google Scholar
  25. 25.
    Arul R, Velusami S, Ravi G (2015) Solving combined economic emission dispatch problems using self-adaptive differential harmony search algorithm. In: International conference on circuit, power and computing technologies, IEEE, pp 757–762.Google Scholar
  26. 26.
    RayapudiSrinivasaRao Satish K, Narasimham SVL (2011) Optimal conductor size selection in distribution systems using the harmony search algorithm with a differential operator. Electr Mach Power Syst 40(1):41–56CrossRefGoogle Scholar
  27. 27.
    Sandeepdhar GD, Rout S, Badhai H, Swain M, Bhattacharya A (2015) Differential search algorithm for different economic dispatch problem. In: International conference on energy, power and environment: towards sustainable growth, IEEE, pp 1–6.Google Scholar
  28. 28.
    Sulaiman MH (2013) Differential search algorithm for economic dispatch with valve-point effects, In: ICEAS, Tokyo, Toshi Center Hotel, pp 111–117Google Scholar
  29. 29.
    Kumar V, Chhabra JK, Kumar D (2016) Data clustering using differential search algorithm. Pertan J Sci Technol 24(2):295–306Google Scholar
  30. 30.
    Liu B (2014) Composite differential search algorithm. J Appl Math 2014(119):1–15MathSciNetGoogle Scholar
  31. 31.
    Guha D, Roy PK, Banerjee S (2016) Quasi-oppositional differential search algorithm applied to load frequency control. Eng Sci Technol Int J 19(4):1635–1654CrossRefGoogle Scholar
  32. 32.
    Chen G-z, Wang J-q, Li R-z (2015) Parameter identification of the 2-chlorophenol oxidation model using improved differential search algorithm. J Chem-NY 2015:1–10Google Scholar
  33. 33.
    Islam NN, Hannan MA, Shareef H, Mohamad A (2015) Bijective differential search algorithm for robust design of damping controller in multimachine power system. Appl Mech Mater 785:424–428CrossRefGoogle Scholar
  34. 34.
    Kumar V, Chhabra JK, Kumar D (2015) Differential search algorithm for multiobjective problems. Procedia Comput Sci 48:22–28CrossRefGoogle Scholar
  35. 35.
    Liu J, Wu C, Cao J, Wang X, Teo KL (2016) A binary differential search algorithm for the 0–1 multidimensional knapsack problem. Appl Math Model 40(23–24):9788–9805MathSciNetCrossRefGoogle Scholar
  36. 36.
    Faria P, Soares J, Vale Z (2015) Definition of the demand response events duration using differential search algorithm for aggregated consumption shifting and generation scheduling. In: ISAP, IEEE, pp 1–7Google Scholar
  37. 37.
    Yang XS (2010) Firefly algorithm, Levy flights and global optimization. In: Research and development in intelligent systems XXVI, Springer, pp 209–218Google Scholar
  38. 38.
    Boyd S, Mutapcic A (2003) Subgradient methods. In: Lecture notes of EE392o, Stanford University, Autumn Quarter, pp 1–21Google Scholar
  39. 39.
    Trianni V, Tuci E, Passino KM, Marshall JAR (2011) Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives. Swarm Intell 5(1):3–18CrossRefGoogle Scholar
  40. 40.
    Vagelis P, Manolis P (2011) A hybrid particle swarm - gradient algorithm for global structural optimization. Comput-Aided Civ Inf 26(1):48–68Google Scholar
  41. 41.
    Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE T Autom Control 37(3):332–341MathSciNetzbMATHCrossRefGoogle Scholar
  42. 42.
    Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver PressGoogle Scholar
  43. 43.
    Sharma H, Bansal JC, Arya KV, Yang XS (2016) Lévy flight artificial bee colony algorithm. Int J Syst Sci 47(2016):4750–4756zbMATHGoogle Scholar
  44. 44.
    Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83CrossRefGoogle Scholar
  45. 45.
    Chu X, Hu M, Wu T, Weir JD, Lu Q (2014) AHPS2: an optimizer using adaptive heterogeneous particle swarms. Inf Sci 280:26–52CrossRefGoogle Scholar
  46. 46.
    Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE T Evol Comput 10(3):281–295CrossRefGoogle Scholar
  47. 47.
    Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471MathSciNetzbMATHCrossRefGoogle Scholar
  48. 48.
    Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: NaBIC 2009, IEEE, pp 210–214Google Scholar
  49. 49.
    Tang R, Fong S, Yang XS, Deb S (2012) Wolf search algorithm with ephemeral memory. In: ICDIM 2012, IEEE, pp 165–172Google Scholar
  50. 50.
    Yang XS (2010) Firefly algorithm, stochastic test functions and design optimisation. Int J Bio-Inspir Com 2(2):78–84CrossRefGoogle Scholar
  51. 51.
    Das S, Suganthan PN (2011) Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. In: Jadavpur University, Nanyang Technological University, Kolkata, pp 341–359Google Scholar
  52. 52.
    Bai X, Tao R, Wang Z, Wang Y (2013) ISAR imaging of a ship target based on parameter estimation of multicomponent quadratic frequency-modulated signals. IEEE Trans Geosci Remote Sens 52(2):1418–1429CrossRefGoogle Scholar
  53. 53.
    Moloi NP, Ali MM (2005) An iterative global optimization algorithm for potential energy minimization. Comput Optim Appl 30(2):119–132MathSciNetzbMATHCrossRefGoogle Scholar
  54. 54.
    Liang JJ, Qu BY, Suganthan PN (2014) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, p 635Google Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Management Science, College of ManagementShenzhen UniversityShenzhenChina
  2. 2.Institute of Big Data Intelligent Management and DecisionShenzhen UniversityShenzhenChina
  3. 3.School of Economics and ManagementUniversity of Science and Technology BeijingBeijingChina
  4. 4.School of Computing, Informatics, and Decision Systems EngineeringArizona State UniversityTempeUSA
  5. 5.Institute of Physical Internet, School of Electrical and Information EngineeringJinan UniversityGuangzhouChina

Personalised recommendations