# Linearly Constrained Optimization Problems

Chapter
Part of the Springer Undergraduate Texts in Mathematics and Technology book series (SUMAT)

## Abstarct

The problems we consider in this chapter have general objective functions but the constraints are linear. Section 4.1 gives a short introduction to linear optimization (LO) — also referred to as linear programming, which is the historically entrenched term. LO is the simplest type of constrained optimization: the objective function and all constraints are linear. The classical, and still well usable algorithm to solve linear programs is the Simplex Method. Quadratic problems which we treat in section 4.2 are linearly constrained optimization problems with a quadratic objective function. Quadratic optimization is often considered to be an essential field in its own right. More important, however, it forms the basis of several algorithms for general nonlinearly constrained problems. In section 4.3 we give a concise outline of projection methods, in particular the feasible direction methods of Zoutendijk, Rosen and Wolfe. They are extensions of the steepest descent method and are closely related to the simplex algorithm and the active set method. Then we will discuss some basic ideas of SQP methods — more generally treated in section 5.2 — which have proven to be very efficient for wide classes of problems.

## Keywords

Projection Method Constrain Optimization Problem Feasible Point Linear Optimization Descent Direction
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

## References

1. St/Bu.
J. Stoer, R. Bulirsch (1996): Introduction to Numerical Analysis. Springer, Berlin, Heidelberg, New YorkGoogle Scholar
2. Fle.
R. Fletcher (2006): Practical Methods of Optimization. Wiley, ChichesterGoogle Scholar
3. Ba/Do.
E. W. Barankin, R. Dorfman (1958): On Quadratic Programming. Univ. of California Publ. in Statistics 2, pp. 285–318Google Scholar
4. Bl/Oe 1.
E. Blum, W. Oettli (1972): Direct Proof of the Existence Theorem for Quadratic Programming. Oper. Research 20, pp. 165–167Google Scholar
5. Co/We.
L. Collatz, W. Wetterling (1971): Optimierungsaufgaben. Springer, Berlin, Heidelberg, New YorkGoogle Scholar
6. Bl/Oe 2.
E. Blum, W. Oettli (1975): Mathematische Optimierung. Springer, Berlin, Heidelberg, New YorkGoogle Scholar
7. Go/Id.
D. Goldfarb, A. Idnani (1983): A Numerically Stable Dual Method for Solving Strictly Convex Quadratic Programs. Math. Progr. 27, pp. 1–33Google Scholar
8. Lu/Ye.
D. Luenberger, Y. Ye (2008): Linear and Nonlinear Programming. Springer, Berlin, Heidelberg, New YorkGoogle Scholar
9. Fle.
R. Fletcher (2006): Practical Methods of Optimization. Wiley, ChichesterGoogle Scholar
10. Fle.
R. Fletcher (2006): Practical Methods of Optimization. Wiley, ChichesterGoogle Scholar
11. MOT.
Matlab (2003): Optimization Toolbox, User’s Guide. The Mathworks Inc.Google Scholar
12. Col.
A.Ṙ. Colville (1968): A Comparative Study on Nonlinear Programming Codes. IBM New York Scientific Center Report 320-2949Google Scholar
13. Spe.
P. Spellucci (1993): Numerische Verfahren der nichtlinearen Optimierung. Birkhäuser, Basel, Boston, BerlinGoogle Scholar