Abstract
This paper proposes a nonmonotone line search filter method with reduced Hessian updating for solving nonlinear equality constrained optimization. In order to deal with large scale problems, a reduced Hessian matrix is approximated by BFGS updates. The new method assures global convergence without using a merit function. By Lagrangian function in the filter and nonmonotone scheme, the authors prove that the method can overcome Maratos effect without using second order correction step so that the locally superlinear convergence is achieved. The primary numerical experiments are reported to show effectiveness of the proposed algorithm.
Similar content being viewed by others
References
Fletcher R and Leyffer S, Nonlinear programming without a penalty function, Math. Program., 2002, 91: 239–269.
Audet C, Dennis J E, A pattern search filter method for nonlinear programming without derivatives, SIAM J. Optim., 2004, 14: 980–1010.
Chin C M and Fletcher R, On the global convergence of an SLP-filter algorithm that takes EQP steps, Math. Program., 2003, 96: 161–177.
Fletcher R, Leyffer S, and Toint P L, On the global convergence of a filter-SQP algorithm, SIAM J. Optim., 2002, 13: 44–59.
Fletcher R, Gould N I M, Leyffer S, Toint P L, and Wächter A, Global convergence of a trust-region SQP-filter algorithm for general nonlinear programming, SIAM J. Optim., 2002, 13: 635–659.
Gonzaga C C, Karas E, and Vanti M, A globally convergent filter method for nonlinear programming, Technical Report, Department of Mathematics, Federal University of Santa Catarina, Brazil, 2001 (Revised 2002).
Wächter A and Biegler L T, Global and local convergence of line search filter methods for nonlinear programming, CAPD Technical Report B-01-09, Department of Chemical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania, 2001 (Revised 2002)
Wächter A and Biegler L T, Line search filter methods for nonlinear programming: Motivation and Global convergence, SIAM J. Comput., 2005, 16: 1–31.
Wächter A and Biegler L T, Line search filter methods for nonlinear programming: Local convergence, SIAM J. Optim., 2005, 6: 32–48.
Dai Y H, On the nonmonotone line search, J. Optim. Theory Appl., 2001, 112: 315–330.
Grippo L, Lampariello F, and Ludidi S, A nonmonotone line search technique for Newtons method, SIAM J. Numer. Anal., 1986, 23: 707–716.
Liu G, Han J, and Sun D, Global convergence of BFGS algorithm with nonmonotone line search, Optimization, 1995, 34: 147–159.
Panier E R, Avoiding Maratos effect by means of nonmonotone line search constrained problems, SIAM J. Numer. Anal., 1991, 28: 1183–1190.
Sun W Y, Han J Y, and Sun J, Global convergence of non-monotone descent methods for unconstrained optimization problems, J. Comput. Appl. Math., 2002, 146: 89–98.
Toint P L, An assessment of nonmonotone line search technique for unconstrained optimization, SIAM J. on Scientific Comput., 1996, 17: 725–739.
Toint P L, A nonmonotone trust region algorithm for nonlinear programming subject to convex constraints, Math. Program., 1997, 77: 69–94.
Biegler L T, Nocedal J, and Schmid C, A reduced Hessian method for large-scale constrained optimization, SIAM J. Optim., 1995, 5: 314–347.
Nocedal J and Overton M L, Projected Hessian updating algorithms for nonlinearly constrained optimization, SIAM J. Numer. Anal., 1985, 22: 821–850.
Nocedal J and Wright S, Numerical Optimization, Springer-Verlag, New York, NY, 1999.
Hock W and Schittkowski K, Test examples for nonlinear programming codes, Lecture Notes in Economics and Mathematics System, vol. 187, Springer-Verlag, 1981.
Schittkowski K, More test examples for nonlinear mathematical programming codes, Lecture Notes in Economics and Mathematics System, vol. 282, Springer-Verlag, Berlin, Heidelberg, 1987.
Chamberlain R M, Powell M J D, Lemarechal C, and Pedersen H C, The watchdog technique for forcing convergence in algorithms for constrained optimization, Math. Programming Stud., 1982, 16: 1–17.
Biegler L T, Nocedal J, Schmid C, and Ternet D, Numerical experience with a reduced hessian method for large scale constrained optimization, Comput. Optim. Appl., 2000, 15: 45–67.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the National Science Foundation of China under Grant No. 10871130, the Ph.D Foundation under Grant No. 20093127110005, the Shanghai Leading Academic Discipline Project under Grant No. S30405, and the Innovation Program of Shanghai Municipal Education Commission under Grant No. 12YZ174.
This paper was recommended for publication by Editor WANG Shouyang.
Rights and permissions
About this article
Cite this article
Gu, C., Zhu, D. A nonmonotone line search filter method with reduced Hessian updating for nonlinear optimization. J Syst Sci Complex 26, 534–555 (2013). https://doi.org/10.1007/s11424-012-0036-2
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-012-0036-2