Advertisement

Evolutionary Intelligence

, Volume 12, Issue 4, pp 541–561 | Cite as

A hybridization of cuckoo search and particle swarm optimization for solving nonlinear systems

  • Abdelmonem M. IbrahimEmail author
  • Mohamed A. TawhidEmail author
Research Paper
  • 127 Downloads

Abstract

In numerical computations, one of the most strenuous problems is to solve systems of nonlinear equations. It is known that traditional numerical methods such as Newton methods and their variants require differentiability and/or good initial guess for the solutions. In practice, it will be difficult to get this initial solution and costly in term of the time to compute Jacobian. Therefore, there is a need to develop an algorithm to avoid the requirements of these traditional methods. This study proposes a new hybrid algorithm by incorporating cuckoo search (CS) with particle swarm optimization (PSO), called CSPSO, for solving systems of nonlinear equations. The goal of the hybridization between CS and PSO is to incorporate the best attributes of two algorithms together to structure a good-quality algorithm. One of the disadvantages to CS, it requires a large number of function evaluations to get the optimal solution, and to PSO, it is trapped into local minima. Our proposed hybrid algorithm attempts to overcome the disadvantages of CS and PSO. Computational experiments of nine benchmark systems of nonlinear equations and 28 benchmark functions of CEC 2013 with various dimensions are applied to test the performance of CSPSO. Computational results show that CSPSO outperforms other existing algorithms by obtaining the optimum solutions for most of the systems of nonlinear equations and 28 benchmark functions of CEC 2013, and reveals its efficacy in the comparison with other algorithms in the literature.

Keywords

Cuckoo search Hybrid algorithm Metaheuristic Particle swarm optimization System of nonlinear equations Unconstrained optimization problem 

Notes

Acknowledgements

We would like to thank the referees for carefully reading our manuscript and for giving such constructive comments which substantially helped improving the quality of the paper. NSERC supports the postdoctoral fellowship of the 1st author. The research of the 2nd author is supported in part by the Natural Sciences and Engineering Research Council of Canada (NSERC).

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

References

  1. 1.
    Moré JJ (1989) A collection of nonlinear model problems. No. CONF-8807156-1, Argonne National Lab., IL (USA). https://www.osti.gov/biblio/6449249
  2. 2.
    Beers KJ, Beers KJ (2007) Numerical methods for chemical engineering: applications in Matlab. Cambridge University Press, CambridgezbMATHGoogle Scholar
  3. 3.
    Judd KL, Guu SM (1997) Asymptotic methods for aggregate growth models. J Econ Dyn Control 21(6):1025–1042MathSciNetCrossRefGoogle Scholar
  4. 4.
    Parker TS, Chua LO (1987) Chaos: a tutorial for engineers. Proc IEEE 75(8):982–1008CrossRefGoogle Scholar
  5. 5.
    Yuan G, Lu X (2008) A new backtracking inexact bfgs method for symmetric nonlinear equations. Comput Math Appl 55(1):116–129.  https://doi.org/10.1016/j.camwa.2006.12.081 MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Kelley C (2003) Solving nonlinear equations with Newton’s method. Fundamentals of algorithms. Society for Industrial and Applied Mathematics, PhiladelphiaCrossRefGoogle Scholar
  7. 7.
    Koupaei JA, Hosseini S (2015) A new hybrid algorithm based on chaotic maps for solving systems of nonlinear equations. Chaos Solitons Fractals 81:233–245.  https://doi.org/10.1016/j.chaos.2015.09.027 MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Luo YZ, Tang GJ, Zhou LN (2008) Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-newton method. Appl Soft Comput 8:1068–1073CrossRefGoogle Scholar
  9. 9.
    Turgut OE, Turgut MS, Coban MT (2014) Chaotic quantum behaved particle swarm optimization algorithm for solving nonlinear system of equations. Comput Math Appl 68(4):508–530.  https://doi.org/10.1016/j.camwa.2014.06.013 MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Ouyang A, Zhou Y, Luo Q (2009) Hybrid particle swarm optimization algorithm for solving systems of nonlinear equations. In: IEEE international conference on granular computing, 2009, GRC ’09. pp 460–465Google Scholar
  11. 11.
    Yang Y, Zhou Q, Gong Y (2010) Hybrid artificial glowworm swarm optimization algorithm for solving system of nonlinear equations. J Comput Inf Syst 10(6):3431–3438Google Scholar
  12. 12.
    Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, vol 4. IEEE Publications, pp 1942–1948Google Scholar
  13. 13.
    Abd-El-Wahed W, Mousa A, El-Shorbagy M (2011) Integrating particle swarm optimization with genetic algorithms for solving nonlinear optimization problems. J Comput Appl Math 235(5):1446–1453MathSciNetCrossRefGoogle Scholar
  14. 14.
    Chang W-D (2009) PID control for chaotic synchronization using particle swarm optimization. Chaos Solitons Fractals 39(2):910–917CrossRefGoogle Scholar
  15. 15.
    Zielinski K, Weitkemper P, Laur R, Kammeyer KD (2009) Optimization of power allocation for interference cancellation with particle swarm optimization. IEEE Trans Evolut Comput 13(1):128–150CrossRefGoogle Scholar
  16. 16.
    Ouyang A, Li K, Truong TK, Sallam A, Sha EH-M (2014) Hybrid particle swarm optimization for parameter estimation of muskingum model. Neural Comput Appl 25(7):1785–1799.  https://doi.org/10.1007/s00521-014-1669-y issn: 1433-3058CrossRefGoogle Scholar
  17. 17.
    Ouyang A, Tang Z, Zhou X, Xu Y, Pan G, Li K (2015) Parallel hybrid PSO with CUDA for lD heat conduction equation. Comput Fluids 110:198–210.  https://doi.org/10.1016/j.compfluid.2014.05.020 MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Li L, Jiao L, Zhao J, Shang R, Gong M (2017) Quantum-behaved discrete multi-objective particle swarm optimization for complex network clustering. Pattern Recognit 63:1–14CrossRefGoogle Scholar
  19. 19.
    Marinakis Y, Marinaki M, Migdalas A (2017) Particle swarm optimization for the vehicle routing problem: a survey and a comparative analysis. In: Martí R, Panos P, Resende MGC (eds) Handbook of heuristics. Springer, Cham, pp 1–34.  https://doi.org/10.1007/978-3-319-07153-4_42-1 (ISBN: 978-3-319-07153-4)CrossRefGoogle Scholar
  20. 20.
    Zhang Y, Wang S, Ji G (2015) A comprehensive survey on particle swarm optimization algorithm and its applications. Math Prob Eng 2015:931256.  https://doi.org/10.1155/2015/931256 MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Yang X, Deb S (2009) Cuckoo search via lévy flights. In: 2009 World congress on nature biologically inspired computing (NaBIC), pp 210–214.  https://doi.org/10.1109/NABIC.2009.5393690
  22. 22.
    Rajabioun R (2011) Cuckoo optimization algorithm. Appl Soft Comput 11(8):5508–5518CrossRefGoogle Scholar
  23. 23.
    Huang J, Gao L, Li X (2015) An effective teaching-learning-based cuckoo search algorithm for parameter optimization problems in structure designing and machining processes. Appl Soft Comput 36:349–356CrossRefGoogle Scholar
  24. 24.
    Mellal MA, Williams EJ (2016) Total production time minimization of a multi-pass milling process via cuckoo optimization algorithm. Int J Adv Manuf Technol 87(1):747–754.  https://doi.org/10.1007/s00170-016-8498-3 CrossRefGoogle Scholar
  25. 25.
    Chiroma H, Herawan T, Fister I Jr, Fister I, Abdulkareem S, Shuib L, Hamza MF, Saadi Y, Abubakar A (2017) Bio-inspired computation: recent development on the modifications of the cuckoo search algorithm. Appl Soft Comput 61:149–173CrossRefGoogle Scholar
  26. 26.
    Shehab M, Khader AT, Al-Betar MA (2017) A survey on applications and variants of the cuckoo search algorithm. Appl Soft Comput 61:1041–1059.  https://doi.org/10.1016/j.asoc.2017.02.034 CrossRefGoogle Scholar
  27. 27.
    Yang X-S, Deb S (2014) Cuckoo search: recent advances and applications. Neural Comput Appl 24(1):169–174CrossRefGoogle Scholar
  28. 28.
    Dash J, Dam B, Swain R (2017) Optimal design of linear phase multi-band stop filters using improved cuckoo search particle swarm optimization. Appl Soft Comput 52:435–445CrossRefGoogle Scholar
  29. 29.
    Chi R, Su Y-x, Zhang Dh, Xx Chi, Zhang H-j (2017) A hybridization of cuckoo search and particle swarm optimization for solving optimization problems. Neural Comput Appl 31(1):653–670Google Scholar
  30. 30.
    Mirjalili S, Hashim SZM (2010) A new hybrid psogsa algorithm for function optimization. In: 2010 International conference on computer and information application, pp 374–377.  https://doi.org/10.1109/ICCIA.2010.6141614
  31. 31.
    Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61.  https://doi.org/10.1016/j.advengsoft.2013.12.007 CrossRefGoogle Scholar
  32. 32.
    Socha K, Dorigo M (2008) Ant colony optimization for continuous domains. Eur J Oper Res 185(3):1155–1173.  https://doi.org/10.1016/j.ejor.2006.06.046 MathSciNetCrossRefzbMATHGoogle Scholar
  33. 33.
    He S, Wu QH, Saunders JR (2009) Group search optimizer: an optimization algorithm inspired by animal searching behavior. IEEE Trans Evolut Comput 13(5):973–990.  https://doi.org/10.1109/TEVC.2009.2011992 issn: 1089-778XCrossRefGoogle Scholar
  34. 34.
    Ibrahim AM, Tawhid MA (2017) Conjugate direction de algorithm for solving systems of nonlinear equations. Appl Math Inf Sci 11(2):339–352.  https://doi.org/10.18576/amis/110201 CrossRefGoogle Scholar
  35. 35.
    Abdollahi M, Bouyer A, Abdollahi D (2016) Improved cuckoo optimization algorithm for solving systems of nonlinear equations. J Supercomput 72(3):1246–1269.  https://doi.org/10.1007/s11227-016-1660-8 issn: 1573-0484CrossRefGoogle Scholar
  36. 36.
    Abd-Elazim S, Ali E (2016) Optimal power system stabilizers design via cuckoo search algorithm. Int J Electr Power Energy Syst 20:99–107CrossRefGoogle Scholar
  37. 37.
    Yang X-S, Deb S (2010) Engineering optimisation by cuckoo search. Int J Math Model Numer Optim 1(4):330–343zbMATHGoogle Scholar
  38. 38.
    Esmin A, Coelho R, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45CrossRefGoogle Scholar
  39. 39.
    Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of international symposium on micro machine and human science. IEEE, pp 39–43Google Scholar
  40. 40.
    Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proceedings of IEEE international conference on evolutionary computation. IEEE Publications, pp 69–73Google Scholar
  41. 41.
    Yang X, Shi P, Shen W, Jang K, Pang S (2013) Multi-objective quantum-behaved particle swarm optimization with entropy based density assessment and chaotic mutation operator. J Comput Inf Syst 9(10):3873–3881Google Scholar
  42. 42.
    Liang JJ, Qu B-Y, Suganthan PN, Hernández-Díaz AG (2013) Problem definitions and evaluation criteria for the cec 2013 special session and competition on real-parameter optimization. In: Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, SingaporeGoogle Scholar
  43. 43.
    Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evolut Comput 1(1):3–18.  https://doi.org/10.1016/j.swevo.2011.02.002 CrossRefGoogle Scholar
  44. 44.
    Li MD, Zhao H, Weng XW, Han T (2016) A novel nature-inspired algorithm for optimization: virus colony search. Adv Eng Softw 92:65–88.  https://doi.org/10.1016/j.advengsoft.2015.11.004 CrossRefGoogle Scholar
  45. 45.
    Sacco W, Henderson N (2011) Finding all solutions of nonlinear systems using a hybrid metaheuristic with fuzzy clustering means. Appl Soft Comput 11(8):5424–5432.  https://doi.org/10.1016/j.asoc.2011.05.016 CrossRefGoogle Scholar
  46. 46.
    Henderson N, Sacco WF, Platt GM (2010) Finding more than one root of nonlinear equations via a polarization technique: an application to double retrograde vaporization. Chem Eng Res Des 88(5):551–561.  https://doi.org/10.1016/j.cherd.2009.11.001 CrossRefGoogle Scholar
  47. 47.
    Floudas C, Pardalos P, Adjiman C, Esposito W, Gumus Z, Harding S, Klepeis J, Meyer C, ASchweiger C (1999) Handbook of test problems in local and global optimization. Kluwer Academic Publishers, DordrechtCrossRefGoogle Scholar
  48. 48.
    Krzyworzcka S (1996) Extension of the lanczos and cgs methods to systems of nonlinear equations. J Comput Appl Math 69:181–190MathSciNetCrossRefGoogle Scholar
  49. 49.
    Mo Y, Liub H, Wang Q (2009) Conjugate direction particle swarm optimization solving systems of nonlinear equations. Comput Math Appl 57(11–12):1877–1882MathSciNetCrossRefGoogle Scholar
  50. 50.
    Grau-Snchez M, Grau A, Noguera M (2011) Frozen divided difference scheme for solving systems of nonlinear equations. J Comput Appl Math 235(6):1739–1743MathSciNetCrossRefGoogle Scholar
  51. 51.
    Sharma J, Arora H (2013) On efficient weighted-newton methods for solving systems of nonlinear equations. Appl Math Comput 222:497–506MathSciNetzbMATHGoogle Scholar
  52. 52.
    Abdollahi M, Isazadeh A, Abdollahi D (2013) Imperialist competitive algorithm for solving systems of nonlinear equations. Comput Math Appl 65(12):1894–1908.  https://doi.org/10.1016/j.camwa.2013.04.018 MathSciNetCrossRefzbMATHGoogle Scholar
  53. 53.
    Ibrahim AM, Tawhid MA (2018) A hybridization of differential evolution and monarch butterfly optimization for solving systems of nonlinear equations. J Comput Des Eng.  https://doi.org/10.1016/j.jcde.2018.10.006 CrossRefGoogle Scholar
  54. 54.
    Oliveira H, Petraglia A (2013) Solving nonlinear systems of functional equations with fuzzy adaptive simulated annealing. Appl Soft Comput 13(11):4349–4357CrossRefGoogle Scholar
  55. 55.
    Grosan C, Abraham A (2008) A new approach for solving nonlinear equations systems. IEEE Trans Syst Man Cybern Part A Syst Hum 38(3):698–714CrossRefGoogle Scholar
  56. 56.
    Hentenryck PV, McAllester D, Kapur D (1997) Solving polynomial systems using a branch and prune approach read more. SIAM J Numer Anal 34(2):797–827MathSciNetCrossRefGoogle Scholar
  57. 57.
    Wang C, Luo R, Wu K, Han B (2011) A new filled function method for an unconstrained nonlinear equation. J Comput Appl Math 235(6):1689–1699MathSciNetCrossRefGoogle Scholar
  58. 58.
    Jaberipour M, Khorram E, Karimi B (2011) Particle swarm algorithm for solving systems of nonlinear equations. Comput Math Appl 62(2):566–576MathSciNetCrossRefGoogle Scholar
  59. 59.
    Tawhid MA, Dsouza KB (2018) Hybrid binary bat enhanced particle swarm optimization algorithm for solving feature selection problems. Appl Comput Inf.  https://doi.org/10.1016/j.aci.2018.04.001 CrossRefGoogle Scholar
  60. 60.
    Tawhid MA, Dsouza KB (2018) Hybrid binary dragonfly enhanced particle swarm optimization algorithm for solving feature selection problems. Math Found Comput 1(2):181–200CrossRefGoogle Scholar
  61. 61.
    Ali AF, Tawhid MA (2016) Hybrid simulated annealing and pattern search method for solving minimax and integer programming problems. Pac J Optim 12(1):151–184MathSciNetzbMATHGoogle Scholar
  62. 62.
    Ali AF, Tawhid MA (2016) A hybrid cuckoo search algorithm with nelder mead method for solving global optimization problems. SpringerPlus 5(1):473CrossRefGoogle Scholar
  63. 63.
    Tawhid MA, Savsani P (2019) Discrete sine-cosine algorithm (DSCA) with local search for solving traveling salesman problem. Arab J Sci Eng 44(4):3669–3679CrossRefGoogle Scholar
  64. 64.
    Savsani P, Mohamed A (2018) Tawhid. discrete heat transfer search for solving travelling salesman problem. Math Found Comput 1(3):265–280CrossRefGoogle Scholar
  65. 65.
    Ali AF, Tawhid MA (2016) A hybrid particle swarm optimization and genetic algorithm with population partitioning for large scale optimization problems. Ain Shams Eng J 8(2):191–206CrossRefGoogle Scholar
  66. 66.
    Tawhid MA, Ali AF (2017) A hybrid social spider optimization and genetic algorithm for minimizing molecular potential energy function. Soft Comput 21(21):6499–6514CrossRefGoogle Scholar
  67. 67.
    Tawhid MA, Ali AF (2017) A hybrid grey wolf optimizer and genetic algorithm for minimizing potential energy function. Memet Comput 9(4):347–359CrossRefGoogle Scholar
  68. 68.
    Ali AF, Tawhid MA (2016) A hybrid pso and de algorithm for solving engineering optimization problems. Appl Math Inf Sci 10(2):431–449CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Mathematics, Faculty of ScienceAl-Azhar University, Assiut BranchAssiutEgypt
  2. 2.Department of Mathematics and Statistics, Faculty of ScienceThompson Rivers UniversityKamloopsCanada

Personalised recommendations