Abstract
In this paper, the authors first study two kinds of stochastic differential equations (SDEs) with Lévy processes as noise source. Based on the existence and uniqueness of the solutions of these SDEs and multi-dimensional backward stochastic differential equations (BSDEs) driven by Lévy processes, the authors proceed to study a stochastic linear quadratic (LQ) optimal control problem with a Lévy process, where the cost weighting matrices of the state and control are allowed to be indefinite. One kind of new stochastic Riccati equation that involves equality and inequality constraints is derived from the idea of square completion and its solvability is proved to be sufficient for the well-posedness and the existence of optimal control which can be of either state feedback or open-loop form of the LQ problems. Moreover, the authors obtain the existence and uniqueness of the solution to the Riccati equation for some special cases. Finally, two examples are presented to illustrate these theoretical results.
Similar content being viewed by others
References
D. Nualart and W. Schoutens, Chaotic and predictable representations for Lévy processes, Stochastic Processes and their Applications, 2000, 90(1): 109–122.
D. Nualart and W. Schoutens, BSDE’s and Feynman-Kac formula for Lévy processes with applications in finance, Bernoulli, 2001, 7(5): 761–776.
R. E. Kalman, Contributions to the theory of optimal control, Bol. Soc. Math. Mexicana, 1960, 5(1): 102–119.
W. M. Wonham, On a matrix equation of stochastic control, SIAM Journal Control Optimization, 1968, 6(4): 681–697.
W. M. Wonham, Random differential equation in control theory, Probabilistic Method in Applied Mathematics, 1970, 2: 131–212.
A. Bensoussan, Lectures on Stochastic Control, Lecture Notes in Mathematics, Springer, New York, 1982, 972: 1–62.
S. Peng, Stochastic Hamilton-Jacobi-Bellman equations, SIAM Journal Control Optimizatio, 1992, 30(2): 284–304.
S. P. Chen, X. J. Li, and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, II, SIAM Journal Control Optimization, 2000, 39(4): 1065–1081.
S. P. Chen, X. J. Li, and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal Control Optimization, 1998, 36(5): 1685–1702.
M. A. Rami, J. B. Moore, and X. Y. Zhou, Indefinite stochastic linear quadratic control and generalized differential Riccati equation, SIAM Journal Control Optimization, 2001, 40(4): 1296–1311.
J. M. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer, New York, 1999.
S. Hamadène and Y. Ouknine, Backward stochastic differential equations with jumps and random obstacle, Electronical Journal of Probability, 2003, 8(2): 1–20.
S. Hamadène and M. Hassani, BSDEs with two reflecting barriers driven by a Brownian motion and an independent Poisson noise and related Dynkin game, Electronic Journal of Probability, 2006, 11(5): 121–145.
Z. Wu and X. R. Wang, FBSDE with Poisson process and its application to linear quadratic stochastic optimal control problem with random jumps, Acta Automatic Sinica, 2003, 29(6): 821–826.
R. Penrose, A generalized inverse of matrices, in Proc. Cambridge Philos. Soc., Vol.52, 1956, 17–19.
N. Ikeda and S. Watanabe, Stochastic Differential Equations and Diffusion Process, North Holland, Kodanska, 1989.
K. Sato, Lévy Processes and Infinitely Divisible Distributions (Cambridge Studies in Advanced Mathematics 68), Cambridge University Press, Cambridge, 1999.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the National Basic Research Program of China (973 Program) under Grant No. 2007CB814904, the Natural Science Foundation of China under Grant No. 10671112 and Shandong Province under Grant No. Z2006A01, and Research Fund for the Doctoral Program of Higher Education of China under Grant No. 20060422018.
Rights and permissions
About this article
Cite this article
Tang, H., Wu, Z. Stochastic differential equations and stochastic linear quadratic optimal control problem with Lévy processes. J Syst Sci Complex 22, 122–136 (2009). https://doi.org/10.1007/s11424-009-9151-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-009-9151-0