Journal of Global Optimization

, Volume 31, Issue 2, pp 271–286 | Cite as

A Gradient-based Continuous Method for Large-scale Optimization Problems

  • Li-Zhi Liao
  • Liqun Qi
  • Hon Wah Tam


In this paper, we study a gradient-based continuous method for large-scale optimization problems. By converting the optimization problem into an ODE, we are able to show that the solution trajectory of this ODE tends to the set of stationary points of the original optimization problem. We test our continuous method on large-scale problems available in the literature. The simulation results are very attractive.


Continuous method Large-scale optimization Ordinary differential equation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Conn, A.R., Gould, N.I.M., Toint, P.L. 1998Testing a class of methods for solving minimization problems with simple bounds on the variablesMathematical Computational50399430Google Scholar
  2. 2.
    Gear, C.W. 1971Numerical Initial Value Problems in Ordinary Differential EquationPrentice HallNew JerseyGoogle Scholar
  3. 3.
    Hale, J.K. 1969Ordinary Differential EquationsWiley-InterscienceNew YorkGoogle Scholar
  4. 4.
    Han, Q.M., Liao, L.-Z., Qi, H.D., Qi, L.Q. 2001Stability analysis of gradient-based neural networks for optimization problemsJournal of Global Optimization19363381Google Scholar
  5. 5.
    Hiebert, K.L. and Shampine, L.F. (1980), Implicitly defined output points for solutions of ODEs, Sandia Report SAND80-0180.Google Scholar
  6. 6.
    Hindmarsh, A.C.,  et al. 1983ODEPACK, a systematized collection of ODE solversStepleman, R.S. eds. Scientific ComputingNorth-HollandAmsterdam5584Google Scholar
  7. 7.
    Hopfield, J.J. 1982Neural networks and physical systems with emergent collective computational abilityProceedings of the National Academic Science,7925542558Google Scholar
  8. 8.
    Hopfield, J.J., Tank, D.W. 1985Neural computation of decisions in optimization problemsBiological Cybernetics52141152Google Scholar
  9. 9.
    Moré, J., Garbow, B., Hillstrom, K. 1981Testing unconstrained, optimization softwareACM Transactions on Mathematical Software71741Google Scholar
  10. 10.
    Petzold, L.R. 1983Automatic selection of methods for solving stiff and nonstiff systems of ordinary differential equationsSIAM J. Scientific and Statistical Computing4136148Google Scholar
  11. 11.
    Slotine, J.-J.E., Li, W. 1991Applied Nonlinear ControlPrentice-HallEnglewood Cliffs, New JerseyGoogle Scholar
  12. 12.
    Xia, Y. 1996A new neural networks for solving linear programming problems and its applicationIEEE Transactions of Neural Network7525529Google Scholar
  13. 13.
    Xia, Y., Wang, J. 1998A general methodology for designing globally convergent optimization neural networksIEEE Transaction of Neural Network913311343Google Scholar
  14. 14.
    Zhang, X.-S. 2000Neural Network in OptimizationKluwer Academic PublishersDordrechtGoogle Scholar

Copyright information

© Springer 2005

Authors and Affiliations

  1. 1.Department of MathematicsHong Kong Baptist UniversityKowloon TongPR China
  2. 2.Department of Applied MathematicsThe Hong Kong Polytechnic UniversityHung HomHong Kong
  3. 3.Department of Computer ScienceHong Kong Baptist UniversityKowloon TongPR China

Personalised recommendations