Skip to main content

Part of the book series: Graduate Texts in Mathematics ((GTM,volume 264))

Abstract

Systems of ordinary differential equations such as x ′(t) = f(t,x(t)) are routinely used today to model a wide range of phenomena, in areas as diverse as aeronautics, power generation, robotics, economic growth, and natural resources. The great success of this paradigm is due in part to the fact that it suggests a natural mechanism through which the behavior of the system can be influenced by external factors. This is done by introducing an explicit control variable in the differential equation, a time-varying parameter that can be chosen (within certain limits) so as to attain a certain goal. This leads to the controlled differential equation

$$ x\,' (t) \: = \:f( t, x(t) , u(t)) ,\,\:\: u(t)\in\, U. $$

We present in this chapter the celebrated Pontryagin maximum principle, a set of necessary conditions for the optimal control of such a system.

The proof of the maximum principle, given in the book of Pontryagin, Boltyanskii, Gamkrelidze and Mischenko... represents, in a sense, the culmination of the efforts of mathematicians, for considerably more than a century,   to rectify the Lagrange multiplier rule.

L. C. Young (Calculus of Variations and Optimal Control Theory)

As a child, I merely knew this; now I can explain it.

David Deutsch (The Fabric of Reality)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 89.95
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    As in the calculus of variations, the anonymous norm ∥ x ∥ always refers to the relevant supremum norm, in this case supt  ∈  [ a,b ]| x(t)|.

  2. 2.

    We bow here to the usage which has come to prevail. It would be more accurate to refer to H as the pre-Hamiltonian. The true Hamiltonian of the problem is in fact M. Ah well.

  3. 3.

    While it is clear enough how this summarizes optimal behavior, the exact meaning of this feedback law as a dynamical system is somewhat unclear. The subject of “discontinuous feedback” addresses such issues.

  4. 4.

    We should mention that minimal-time problems with linear dynamics, of which the soft landing problem is but one example, can be studied on a systematic basis using time reversal and a technique called “backing out of the origin.” See Lee and Markus [30].

  5. 5.

    This is the compensating assumption used by Pontryagin and his collaborators.

  6. 6.

    The nonsmooth maximum principle fails with L in the adjoint inclusion (see Exer. 22.29).

  7. 7.

    See Clarke-Vinter [19] for details.

References

  1. F. H. Clarke and R. B. Vinter. Applications of optimal multiprocesses. SIAM J. Control Optim., 27:1048–1071, 1989.

    Article  MATH  MathSciNet  Google Scholar 

  2. E. B. Lee and L. Markus. Foundations of Optimal Control Theory. Wiley, New York, 1967.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Clarke, F. (2013). Necessary conditions. In: Functional Analysis, Calculus of Variations and Optimal Control. Graduate Texts in Mathematics, vol 264. Springer, London. https://doi.org/10.1007/978-1-4471-4820-3_22

Download citation

Publish with us

Policies and ethics