Abstract
We interpret the following fully nonlinear second order partial differential equation
as the value function of certain optimal controlled diffusion problem. Where A ∈ ℝ k is control domain. xxxL(x, α) is a second order elliptic partial differential operator parametrized by the control variable α ∈ A ⊂ ℝ k. A particular case of this equation is when f=f(x, α). In this case, the equation is the well known Hamilton Jacobi Bellman equation.
The problem is formulated as follows: The state equation of the control problem is as classical one. The cost function is described by a solution of certain backward stochastic differential equation.
partially supported by the Chinese National Natural Science Fundation.
Preview
Unable to display preview. Download preview PDF.
References
R. Bellman, Dynamic Programming, Princeton Univ. Press, N.J. 1957.
W.H. Fleming and R.W. Rishel, Deterministic and Stoshastic Optimal Control, Springer-Verlag, 1975.
Krylov, Nonlinear Elliptic and Parabolic Equations of Second Order, D. Reidel Publishing Company, Dordrecht, 1987.
O. Ladyzenskaja, V. Slonnikov, N. Uralceva, Linear and Quasi-linear Equations of Parabolic Type, Translations of Maths Monograghs, Vol.23 AMS, Providence Rhode Island, 1968.
P.L.Lions, Optimal Control of Diffusion Processes and Hamilton Jacobi Equations, Part 1, 2, 3, Commu. in PDE, 1983.
M. Nisio, Some Remarks on Stochastic Optimal Controls, Proc. 3rd U.S.S.R.-Japan Symp. Prob. Theory, Lecture Notes in Maths 550, Springer, Berlin, 1976.
E. Pardoux and S. Peng, Adapted Solution of Backward Stochastic Equation, to appear in Systems and Control Letters.
S. Peng, A General Stochastic Maximum Principle for Optimal Control Problems, SIAM J. Cont. Vol.28 No.4, 1990.
S.Peng, Backward Stochastic Differential Equation and It's Application in Optimal Control, to appear.
S. Peng, Stochastic Hamilton-Jacobi-Bellman Equations, to appear.
S. Peng, Probabilistic Interpretation for Systems of Parabolic Partial Differential Equations, submitted.
S. Peng, Maximum Principle for Stochastic Optimal Control with Nonconvex Control Domain, to appear in Proceedings of 9th International Conference on Analysis and Optimization of Systems, Antibes, 1990.
S.Peng, A Generalized Dynamic Programming Principle, to appear.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1991 International Federation for Information Processing
About this paper
Cite this paper
Peng, S. (1991). A generalized Hamilton-Jacobi-Bellman equation. In: Li, X., Yong, J. (eds) Control Theory of Distributed Parameter Systems and Applications. Lecture Notes in Control and Information Sciences, vol 159. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0004444
Download citation
DOI: https://doi.org/10.1007/BFb0004444
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-53894-3
Online ISBN: 978-3-540-46372-6
eBook Packages: Springer Book Archive