A Framework for Reduce-or-Retreat Minimization

  • Adam B. Levy
Part of the SpringerBriefs in Optimization book series (BRIEFSOPTI)


We introduce our framework, including all of the elements generated at each iteration, as well as the major components of reduction and retreat. The property of nonincreasing function values inherent in the framework is strengthened via the definition of a descent method, and lower-diminishing target-gaps are explored as the result of a successful run of a method within the framework. Finally, we develop our extended notion of approaching stationarity and link this property both to stationary points and to lower-diminishing target-gaps.


Stationary Point Descent Method Trial Point Nonincreasing Function Extended Notion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Audet, C., Dennis, J.E.: Analysis of generalized pattern searches. SIAM J. Optim. 13, 889–903 (2002)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Ciarlet, P.G., Raviart, P.-A.: General Lagrange and Hermite interpolation in n with applications to finite element methods. Arch. Rational Mech. Anal. 46, 177–199 (1972)MathSciNetMATHCrossRefGoogle Scholar
  3. 3.
    Conn, A.R., Scheinberg, K., Vicente, L.: Introduction to derivative-free optimization. In: MPS-SIAM Optimization series. SIAM, Philadelphia, USA (2008)Google Scholar
  4. 4.
    Kolda, T.G., Lewis, R.M., Torczon, V.: Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev. 45, 385–482 (2003)MathSciNetMATHCrossRefGoogle Scholar
  5. 5.
    Lagarias, J.C., Reeds, J.A., Wright, M.H., Wright, P.E.: Convergence properties of the Nelder-Mead simplex method in low dimensions. SIAM J. Optim. 9, 112–147 (1998)MathSciNetMATHCrossRefGoogle Scholar
  6. 6.
    McKinnon, K.I.M.: Convergence of the Nelder-Mead simplex method to a nonstationary point. SIAM J. Optim. 9, 148–158 (1998)MathSciNetMATHCrossRefGoogle Scholar
  7. 7.
    Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)MATHCrossRefGoogle Scholar
  8. 8.
    Torczon, V.: On the convergence of pattern search algorithms. SIAM J. Optim. 7, 1–25 (1997)MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Adam B. Levy 2012

Authors and Affiliations

  • Adam B. Levy
    • 1
  1. 1.Department of MathematicsBowdoin CollegeBrunswickUSA

Personalised recommendations