Skip to main content

A generalized Hamilton-Jacobi-Bellman equation

  • Conference paper
  • First Online:
Control Theory of Distributed Parameter Systems and Applications

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 159))

Abstract

We interpret the following fully nonlinear second order partial differential equation

$$\left\{ \begin{gathered}\partial _t u + \mathop {\inf }\limits_\alpha \left\{ {\mathcal{L}\left( {x, \alpha } \right)u + f\left( {x, u, \partial _x u\sigma \left( {x, \alpha } \right),\alpha } \right)} \right\} = 0,\left( {x, t} \right) \in D \times \left( {0, T} \right), \hfill \\for \left( {x, t} \right) \in D \times \left[ {0, T} \right];u\left( {x, T} \right) = g\left( x \right). \hfill \\\end{gathered} \right.$$

as the value function of certain optimal controlled diffusion problem. Where A k is control domain. xxxL(x, α) is a second order elliptic partial differential operator parametrized by the control variable αA k. A particular case of this equation is when f=f(x, α). In this case, the equation is the well known Hamilton Jacobi Bellman equation.

The problem is formulated as follows: The state equation of the control problem is as classical one. The cost function is described by a solution of certain backward stochastic differential equation.

partially supported by the Chinese National Natural Science Fundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. R. Bellman, Dynamic Programming, Princeton Univ. Press, N.J. 1957.

    Google Scholar 

  2. W.H. Fleming and R.W. Rishel, Deterministic and Stoshastic Optimal Control, Springer-Verlag, 1975.

    Google Scholar 

  3. Krylov, Nonlinear Elliptic and Parabolic Equations of Second Order, D. Reidel Publishing Company, Dordrecht, 1987.

    Google Scholar 

  4. O. Ladyzenskaja, V. Slonnikov, N. Uralceva, Linear and Quasi-linear Equations of Parabolic Type, Translations of Maths Monograghs, Vol.23 AMS, Providence Rhode Island, 1968.

    Google Scholar 

  5. P.L.Lions, Optimal Control of Diffusion Processes and Hamilton Jacobi Equations, Part 1, 2, 3, Commu. in PDE, 1983.

    Google Scholar 

  6. M. Nisio, Some Remarks on Stochastic Optimal Controls, Proc. 3rd U.S.S.R.-Japan Symp. Prob. Theory, Lecture Notes in Maths 550, Springer, Berlin, 1976.

    Google Scholar 

  7. E. Pardoux and S. Peng, Adapted Solution of Backward Stochastic Equation, to appear in Systems and Control Letters.

    Google Scholar 

  8. S. Peng, A General Stochastic Maximum Principle for Optimal Control Problems, SIAM J. Cont. Vol.28 No.4, 1990.

    Google Scholar 

  9. S.Peng, Backward Stochastic Differential Equation and It's Application in Optimal Control, to appear.

    Google Scholar 

  10. S. Peng, Stochastic Hamilton-Jacobi-Bellman Equations, to appear.

    Google Scholar 

  11. S. Peng, Probabilistic Interpretation for Systems of Parabolic Partial Differential Equations, submitted.

    Google Scholar 

  12. S. Peng, Maximum Principle for Stochastic Optimal Control with Nonconvex Control Domain, to appear in Proceedings of 9th International Conference on Analysis and Optimization of Systems, Antibes, 1990.

    Google Scholar 

  13. S.Peng, A Generalized Dynamic Programming Principle, to appear.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Xunjing Li Jiongmin Yong

Rights and permissions

Reprints and permissions

Copyright information

© 1991 International Federation for Information Processing

About this paper

Cite this paper

Peng, S. (1991). A generalized Hamilton-Jacobi-Bellman equation. In: Li, X., Yong, J. (eds) Control Theory of Distributed Parameter Systems and Applications. Lecture Notes in Control and Information Sciences, vol 159. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0004444

Download citation

  • DOI: https://doi.org/10.1007/BFb0004444

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-53894-3

  • Online ISBN: 978-3-540-46372-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics