Skip to main content
SpringerLink
Log in

Hamilton-Jacobi-Bellman Equations and Optimal Control

  • Conference paper
Variational Calculus, Optimal Control and Applications

Part of the book series: International Series of Numerical Mathematics ((ISNM,volume 124))

Abstract

The aim of this paper is to offer a quick overview of some applications of the theory of viscosity solutions of Hamilton-Jacobi-Bellman equations connected to nonlinear optimal control problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pesch H. J.; Bulirsch, R.: The Maximum Principle, Bellman’s equation, and Caratheodory’s work. J. Optim. Theory Appl. 80, 1994.

    Google Scholar 

  2. Kruzkov, S. N.: The Cauchy problem in the large for certain nonlinear first order differential equations. Sov. Math. Dokl. 1, 1960.

    Google Scholar 

  3. Kruzkov, S. N.: Generalized solutions of the Hamilton-Jacobi equations of eikonal type I. Math. USSR Sbornik 27, 1975.

    Google Scholar 

  4. Cannarsa P.; Sinestrari, C.: Convexity properties of the minimum time function. Calc. Var. 3, 1995.

    Google Scholar 

  5. Sinestrari, C.: Semiconcavity of solutions of stationary Hamilton-Jacobi equations. Nonlinear Analysis 24, 1995.

    Google Scholar 

  6. Crandall, M. G.; Lions, P. L.: Viscosity solutions of Hamilton-Jacobi equations. Trans. Amer. Math. Soc. 277, 1983.

    Google Scholar 

  7. Bardi, M.; Capuzzo Dolcetta, I.: Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations. To appear, Birkhäuser 1997.

    Google Scholar 

  8. Lions, P. L.: Optimal control of diffusion processes and Hamilton-Jacobi equations. Comm. Partial Differential Equations 8, 1983.

    Google Scholar 

  9. Fleming, W. H.; Soner, M. H.: Controlled Markov processes and viscosity solutions. Springer Verlag 1993.

    Google Scholar 

  10. Li X.; Yong, J.: Optimal control theory for infinite dimensional systems. Birkhäuser 1995.

    Google Scholar 

  11. Capuzzo Dolcetta, I.: On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming. Appl. Math. Optim. 10, 1983.

    Google Scholar 

  12. Capuzzo Dolcetta, I.; Ishii, H.: Approximate solutions of the Bellman equation of deterministic control theory. Appl. Math. Optim. 11, 1984.

    Google Scholar 

  13. Bardi, M.: Some applications of viscosity solutions to optimal control and differential games. In Viscosity Solutions and Applications, I. Capuzzo Dolcetta, P. L. Lions (eds.). To appear in Lecture Notes in Mathematics, Springer 1997.

    Google Scholar 

  14. Barron, E. N.; Jensen, R.: Semicontinuous viscosity solutions of Hamilton-Jacobi equations with convex hamiltonians. Comm. Partial Differential Equations 15, 1990.

    Google Scholar 

  15. Barles, G.: Discontinuous viscosity solution of first order Hamilton-Jacobi equations: a guided visit. Nonlinear Analysis 20, 1993.

    Google Scholar 

  16. Soner, M. H.: Optimal control problems with state-space constraints I–II. SIAM J. Control Optim. 24, 1986.

    Google Scholar 

  17. Capuzzo Dolcetta, I.; Lions, P. L.: Hamilton-Jacobi equations with state constraints. Trans. Amer. Math. Soc. 318, 1990.

    Google Scholar 

  18. Gonzale, R.; Rofman, E.: On deterministic control problems: an approximation procedure for the optimal cost. SIAM J. Control Optim. 23, 1985.

    Google Scholar 

  19. Falcone, M.: A numerical approach to the infinite horizon problem of deterministic control theory. Appl. Math. Optim. 15, 1987.

    Google Scholar 

  20. Rouy, A.: Numerical approximation of viscosity solutions of Hamilton-Jacobi equations with Neumann type boundary conditions. Math. Models Methods Appl. Sci. 2, 1992.

    Google Scholar 

  21. Falcone, M.; Ferretti, R.: Discrete high-order schemes for viscosity solutions of Hamilton-Jacobi equations. Numer. Math. 67, 1994.

    Google Scholar 

  22. Bardi, M.; Bottacin, S.; Falcone, M.: Convergence of discrete schemes for discontinuous value functions of pursuit-evasion games. In G. J. Olsder, editor, New Trends in Dynamic Games and Applications. Birkhäuser 1995.

    Google Scholar 

  23. Arisawa, M.: Ergodic problem for the Hamilton-Jacobi-Bellman equation I and II. Cahiers du CEREMADE. 1995.

    Google Scholar 

  24. Barles, G.: Solutions de Viscosite des Equations de Hamilton-Jacobi Vol. 17. Mathematiques et Applications. Springer 1994.

    MATH  Google Scholar 

  25. Bardi, M.; Bagagiolo, F.; Capuzzo Dolcetta, I.: A viscosity solutions approach to some asymptotic problems in optimal control. In J. P. Zolesio, editor, Proceedings of the Conference “PDE’s Methods in Control, Shape Optimization and Stochastic Modelling”. M. Dekker 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Matematica, Università di Roma “La Sapienza”, Piazzale A. Moro 2, I 00185, Roma, Italy

    Italo Capuzzo Dolcetta

Authors
  1. Italo Capuzzo Dolcetta
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institut für Mathematik und Informatik, Ernst-Moritz-Arndt-Universität Greifswald, Jahnstr. 15a, D-17487, Greifswald, Germany

    Werner H. Schmidt , Knut Heier  & Leonhard Bittner ,  & 

  2. Zentrum Mathematik, Technische Universität München, Arcisstr. 21, D-80290, München, Germany

    Roland Bulirsch

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer Basel AG

About this paper

Cite this paper

Dolcetta, I.C. (1998). Hamilton-Jacobi-Bellman Equations and Optimal Control. In: Schmidt, W.H., Heier, K., Bittner, L., Bulirsch, R. (eds) Variational Calculus, Optimal Control and Applications. International Series of Numerical Mathematics, vol 124. Birkhäuser, Basel. https://doi.org/10.1007/978-3-0348-8802-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-0348-8802-8_13

  • Publisher Name: Birkhäuser, Basel

  • Print ISBN: 978-3-0348-9780-8

  • Online ISBN: 978-3-0348-8802-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation