Numerical Algorithms

, Volume 64, Issue 1, pp 1–20 | Cite as

A nonmonotone trust region method with new inexact line search for unconstrained optimization

Original Paper


In this paper, a new nonmonotone inexact line search rule is proposed and applied to the trust region method for unconstrained optimization problems. In our line search rule, the current nonmonotone term is a convex combination of the previous nonmonotone term and the current objective function value, instead of the current objective function value . We can obtain a larger stepsize in each line search procedure and possess nonmonotonicity when incorporating the nonmonotone term into the trust region method. Unlike the traditional trust region method, the algorithm avoids resolving the subproblem if a trial step is not accepted. Under suitable conditions, global convergence is established. Numerical results show that the new method is effective for solving unconstrained optimization problems.


Unconstrained optimization Inexact line search Trust region method Global convergence Numerical experiments 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ahookhosh, M., Amini, K.: A nonmotone trust region method with adaptive radius for unconstrained optimization. Comput. Math. Appl. 60, 411–422 (2010)MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Ahookhosh, M., Amini, K., Peyghami, M.R.: A nonmonotone trust-region line search method for large-scale unconstrained optimization. Appl. Math. Model. 36, 478–487 (2012)MathSciNetMATHCrossRefGoogle Scholar
  3. 3.
    Touati-Ahmed, D., Storey, C.: Efficient hybrid conjugate gradient techniques. J. Optim. Theory Appl. 64(2), 379–397 (1990)MathSciNetMATHCrossRefGoogle Scholar
  4. 4.
    Conn, A.R., Gould, N.I.M., Toint, Ph.L.: Trust-region Methods. SIAM Publications, Philadelphia, PA (2000)MATHCrossRefGoogle Scholar
  5. 5.
    Dolan, E.D., More, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91, 201–213 (2002)MathSciNetMATHCrossRefGoogle Scholar
  6. 6.
    Deng, N.Y., Xiao, Y., Zhou, F.J.: Nonmonotonic trust region algorithm. J. Optim. Theory Appl. 76(2), 259–285 (1993)MathSciNetMATHCrossRefGoogle Scholar
  7. 7.
    Dai, Y.H.: On the nonmonotone line search. J. Optim. Theory Appl. 112, 315–330 (2002)MathSciNetMATHCrossRefGoogle Scholar
  8. 8.
    Dai, Y.H.: A nonmonotone conjugate gradient algorithm for unconstrained optimization. J. Syst. Sci. Complex 15(2), 139–145 (2002)MathSciNetMATHGoogle Scholar
  9. 9.
    Fletcher, R.: An algorithm for solving linearly constrained optimization problems. Math. Program. 2, 133–165 (1972)MathSciNetMATHCrossRefGoogle Scholar
  10. 10.
    Fu, J., Sun, W.: Nonmotone adaptive trust region method for unconstrained optimization problems. Appl. Math. Comput. 163(1), 489–504 (2005)MathSciNetMATHCrossRefGoogle Scholar
  11. 11.
    Gertz, E.M.: Combination trust-region line search methods for unconstrained optimization. Ph.D. thesis, University of California, San Diego (1999)Google Scholar
  12. 12.
    Grippo, L., Lampariello, F., Lucidi, S.: A nonmonotone line search technique for Newton’s method. SIAM J. Numer. Anal. 23(4), 707–716 (1986)MathSciNetMATHCrossRefGoogle Scholar
  13. 13.
    Gu, N.Z., Mo, J.T.: Incorporating nonmonotone strategies into the trust region method for unconstrained optimization. Appl. Math. Comput. 55, 2158–2172 (2008)MathSciNetMATHGoogle Scholar
  14. 14.
    Grippo, L., Sciandrone, M.: Nonmonotone globalization techniques for the Barzilai-Borwein gradient method. Comput. Optim. Appl. 23, 143–169 (2002)MathSciNetMATHCrossRefGoogle Scholar
  15. 15.
    Ke, X., Han, J.: A class of nonmotone trust region algorithms for unconstrained optimization. Sci. China Ser. A 41(9), 927–932 (1998)MathSciNetMATHCrossRefGoogle Scholar
  16. 16.
    Liu, G., Han, J., Sun, D.: Global convergence of BFGS algorithm with nonmonotone linesearch. Optim. 34, 147–159 (1995)MathSciNetMATHCrossRefGoogle Scholar
  17. 17.
    Mo, J.T., Liu, C.Y., Yan, S.C.: A nonmonotone trust region method based on nonincreasing technique of weighted average of the successive function values. J. Comput. Appl. Math. 209, 97–108 (2007)MathSciNetMATHCrossRefGoogle Scholar
  18. 18.
    More, J.J., Garbow, B.S., Hillstrom, K.E.: Testing unconstrained optimization software. ACM Trans. Math. Softw. 7(1), 17–41 (1981)MathSciNetMATHCrossRefGoogle Scholar
  19. 19.
    Nocedal, J., Yuan, Y.: Combining trust region and line search techniques. In: Yuan, Y. (ed.) Advances in Nonlinear Programming, pp. 153–175. Kluwer Academic Publishers, Dordrecht (1996)Google Scholar
  20. 20.
    Powell, M.J.D.: Convergence properties of a class minimization algorithms. In: Mangasarian, O.L., Meyer, R.R., Robinson, S.M. (eds.) Nonlinear Programming, vol. 2, pp. 1–25. Academic Press, New York (1975)Google Scholar
  21. 21.
    Powell, M.J.D., Yuan, Y.: A trust region algorithm for equality constrained optimization. Math. Program. 49, 189–213 (1990)MathSciNetMATHCrossRefGoogle Scholar
  22. 22.
    Sun, W.Y.: Nonmonotone trust region method for solving optimization problems. Appl. Math. Comput. 156(1), 59–174 (2004)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Shi, Z.J., Shen, J.: New inexact line search method for unconstrained optimization. J. Optim. Theory Appl. 127(2), 425–446 (2005)MathSciNetMATHCrossRefGoogle Scholar
  24. 24.
    Shi, Z.J., Sun, G.: A diagonal-sparse quasi-Newton method for unconstrained optimization problem. J. Sys. Sci Math. Sci. 26(1), 101–112 (2006)MathSciNetMATHGoogle Scholar
  25. 25.
    Sun, W.Y., Han, J.Y., Sun, J.: On the global convergence of nonmonotone descent methods. J. Comput. Appl. Math. 146, 89–98 (2002)MathSciNetMATHCrossRefGoogle Scholar
  26. 26.
    Shi, Z.J., Wang, S.Q.: Nonmonotone adaptive trust region method. Eur. J. Oper. Res. 208, 28–36 (2011)MATHCrossRefGoogle Scholar
  27. 27.
    Toint, Ph.L.: An assessment of non-monotone line search techniques for unconstrained optimization. SIAM J. Sci. Stat. Comput. 17(3), 725–739 (1996)MathSciNetMATHCrossRefGoogle Scholar
  28. 28.
    Yuan, Y.: On a subproblem of trust region algorithms for constrained optimization. Math. Program. 47, 53–63 (1990)MATHCrossRefGoogle Scholar
  29. 29.
    Zhang, H., Hager, W.W.: A nonmonotone line search technique and its application to unconstrained optimization. SIAM J. Optim. 14(4), 1043–1056 (2004)MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  1. 1.School of Mathematics and Computer ScienceFujian Normal UniversityFuzhouPeople’s Republic of China

Personalised recommendations