An efficient neural network for solving convex optimization problems with a nonlinear complementarity problem function

  • M. RanjbarEmail author
  • S. Effati
  • S. M. Miri
Methodologies and Application


In this paper, we present a one-layer recurrent neural network (NN) for solving convex optimization problems by using the Mangasarian and Solodov (MS) implicit Lagrangian function. In this paper by using Krush–Kuhn–Tucker conditions and MS function the NN model was derived from an unconstrained minimization problem. The proposed NN model is one layer and compared to the available NNs for solving convex optimization problems, which has a better performance in convergence time. The proposed NN model is stable in the sense of Lyapunov and globally convergent to optimal solution of the original problem. Finally, simulation results on several numerical examples are presented and the validity of the proposed NN model is demonstrated.


One-layer neural networks Convex programming Nonlinear complementarity problem 


Compliance with ethical standards

Conflict of interest

All authors have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.


  1. Bazaraa MS, Shetty CM (1979) Nonlinear programming. Theory and algorithms. Wiley, New YorkzbMATHGoogle Scholar
  2. Bazaraa MS, Jarvis JJ, Sherali HD (1990) Linear programming and network flows, 2nd edn. Wiley, HobokenzbMATHGoogle Scholar
  3. Bouzerdoum A, Pattison TR (1993) Neural network for quadratic optimization with bound constraints. IEEE Trans Neural Netw 4(2):293–304Google Scholar
  4. Chen JS (2007) On some NCP-functions based on the generalized Fischer–Burmeister function. Asia-Pac J Oper Res 24:401–420MathSciNetzbMATHGoogle Scholar
  5. Chen JS, Pan S (2008) A family of NCP functions and a descent method for the nonlinear complementarity problem. Comput Optim Appl 40:389–404MathSciNetzbMATHGoogle Scholar
  6. Chen JS, Ko CH, Pan S (2010) A neural network based on the generalized Fischer–Burmeister function for nonlinear complementarity problems. Inf Sci 180:697–711MathSciNetzbMATHGoogle Scholar
  7. Cottle RW, Pang JS, Stone RE (1992) The linear complementarity problem. Academic Press, New YorkzbMATHGoogle Scholar
  8. Effati S, Baymani M (2005) A new nonlinear neural network for solving convex nonlinear programming problems. Appl Math Comput 168:1370–1379MathSciNetzbMATHGoogle Scholar
  9. Effati S, Nazemi AR (2006) Neural network and its application for solving linear and quadratic programming problems. Appl Math Comput 172:305–331MathSciNetzbMATHGoogle Scholar
  10. Effati S, Ranjbar M (2011) A novel recurrent nonlinear neural network for solving quadratic programming problems. Appl Math Model 35:1688–1695MathSciNetzbMATHGoogle Scholar
  11. Effati S, Ghomashi A, Abbasi M (2011) A novel recurrent neural network for solving MLCPs and its application to linear and quadratic programming problems. Asia-Pac J Oper Res 28:523–541MathSciNetzbMATHGoogle Scholar
  12. Effati S, Mansoori A, Eshaghnezhad M (2015) An efficient projection neural network for solving bilinear programming problems. Neurocomputing 168:1188–1197Google Scholar
  13. Facchinei F (1998) Structural and stability properties of \(P_0\) nonlinear complementarity problems. Math Oper Res 23(3):735–745MathSciNetzbMATHGoogle Scholar
  14. Ferris MC, Kanzow C (2002) Complementarity and related problems: a survey. In: Handbook of applied optimization. Oxford University Press, New York, pp 514–530 Google Scholar
  15. Ferris MC, Mangasarian OL, Pang JS (eds) (2001) Complementarity: applications, algorithms and extensions. Kluwer Academic Publishers, DordrechtGoogle Scholar
  16. Fischer A (1992) A special Newton-type optimization method. Optimization 24:269–284MathSciNetzbMATHGoogle Scholar
  17. Fischer A (1997) Solution of the monotone complementarity problem with locally Lipschitzian functions. Math Program 76:513–532MathSciNetzbMATHGoogle Scholar
  18. He S, Zhang L, Zhang J (2015) The rate of convergence of a NLM based on F-B NCP for constrained optimization problems without strict complementarity. Asia-Pac J Oper Res 32(3):1550012MathSciNetzbMATHGoogle Scholar
  19. Hu SL, Huang ZH, Chen JS (2009) Properties of a family of generalized NCP-functions and a derivative free algorithm for complementarity problems. J Comput Appl Math 230:69–82MathSciNetzbMATHGoogle Scholar
  20. Huang X, Cui B (2016) A novel neural network for solving convex quadratic programming problems subject to equality and inequality constraints. Neurocomputing 214:23–31Google Scholar
  21. Kanzow C, Yamashita N, Fukushima M (1997) New NCP-functions and their properties. J Optim Theory Appl 94:115–135MathSciNetzbMATHGoogle Scholar
  22. Kennedy MP, Chua LO (1988) Neural networks for nonlinear programming. IEEE Trans Circuits Syst 35:554–562MathSciNetGoogle Scholar
  23. Liao LZ, Qi H, Qi L (2001) Solving nonlinear complementarity problems with neural networks: a reformulation method approach. J Comput Appl Math 131:342–359MathSciNetzbMATHGoogle Scholar
  24. Mangasarian OL, Soldov MV (1993) Nonlinear complementarity as unconstrained and constrained minimization. Math Program 62:277–297MathSciNetzbMATHGoogle Scholar
  25. Miller RK, Michel AN (1982) Ordinary differential equations. Academic Press, New YorkzbMATHGoogle Scholar
  26. Miri SM, Effati S (2015) On generalized convexity of nonlinear complementarity functions. J Optim Theory Appl 164(2):723–730MathSciNetzbMATHGoogle Scholar
  27. Nazemi AR (2012) A dynamic system model for solving convex nonlinear optimization problems. Commun Nonlinear Sci Numer Simul 17:1696–1705MathSciNetzbMATHGoogle Scholar
  28. Nazemi AR (2013) Solving general convex nonlinear optimization problems by an efficient neurodynamic model. Eng Appl Artif Intell 26(2):685–696Google Scholar
  29. Nazemi AR (2014) A neural network model for solving convex quadratic programming problems with some applications. Eng Appl Artif Intell 32:54–62Google Scholar
  30. Ranjbar M, Effati S, Miri SM (2017) An artificial neural network for solving quadratic zero-one programming problems. Neurocomputing 235:192–198Google Scholar
  31. Rodriguez VA, Domingues-Castro R, Rueda A, Huertas JL, Sanchez SE (1990) Nonlinear switched-capacitor neural networks for optimization problems. IEEE Trans Circuits Syst 37(3):384–397MathSciNetGoogle Scholar
  32. Slotin JJE, Li W (1991) Applied nonlinear control. Prentice Hall, Upper Saddle RiverGoogle Scholar
  33. Tank DW, Hopfield JJ (1986) Simple neural optimization networks: an A/D converter, signal decision network and a linear programming circuit. IEEE Trans Circuits Syst 33:533–541Google Scholar
  34. Wang J (1994) A deterministic annealing neural network for convex programming. Neural Netw 7(4):629–641zbMATHGoogle Scholar
  35. Xia Y (1996) A new neural network for solving linear programming problems and its application. IEEE Trans Neural Netw 7:525–529Google Scholar
  36. Xia Y, Wang J (2000) A recurrent neural network for solving linear projection equations. Neural Netw 13:337–350Google Scholar
  37. Xia Y, Wang J (2004) A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints. IEEE Trans Circuits Syst 51(7):1385–1394MathSciNetzbMATHGoogle Scholar
  38. Xia Y, Wang J (2005) A recurrent neural network for solving nonlinear convex programs subject to linear constraints. IEEE Trans Neural Netw 16(2):1045–1053Google Scholar
  39. Zhang XS (1996) Mathematical analysis of some neural networks for solving linear and quadratic programming. Acta Mathematicae Applicatae Sinica 12(1):1–10MathSciNetzbMATHGoogle Scholar
  40. Zhang Z, Constantinides AG (1992) Lagrange programming neural networks. IEEE Trans Circuits Syst 39(7):441–452zbMATHGoogle Scholar
  41. Zhang XS, Zhuo XJ, Jing ZJ (2002) An adaptive neural network model for nonlinear programming problems. Acta Mathematicae Applicatae Sinica 18(3):377–388MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Applied MathematicsFerdowsi University of MashhadMashhadIran

Personalised recommendations