Abstract
A general maximum principle (necessary and sufficient conditions) for an optimal control problem governed by a stochastic differential equation driven by an infinite dimensional martingale is established. The solution of this equation takes its values in a separable Hilbert space and the control domain need not be convex when studying optimality necessary conditions. The result is obtained by using the adjoint backward stochastic differential equation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Hussein, A.: Backward stochastic partial differential equations in infinite dimensions. Random Oper. Stoch. Equ. 14(1), 1–22 (2006)
Al-Hussein, A.: Backward stochastic partial differential equations driven by infinite dimensional martingales and applications. Stochastics 81(6), 601–626 (2009)
Al-Hussein, A.: Maximum principle for controlled stochastic evolution equations. Int. J. Math. Anal. 4(30), 1447–1464 (2010)
Al-Hussein, A.: Sufficient conditions of optimality for backward stochastic evolution equations. Commun. Stoch. Anal. 4(3), 433–442 (2010)
Al-Hussein, A.: Representation of infinite dimensional martingales. Random Oper. Stoch. Equ. 18, 127–130 (2010)
Al-Hussein, A.: Necessary conditions for optimal control of stochastic evolution equations in Hilbert spaces. Appl. Math. Optim. 63(3), 385–400 (2011)
Al-Hussein, A.: BSDEs driven by infinite dimensional martingales and their applications to stochastic optimal control. Random Oper. Stoch. Equ. 19, 45–61 (2011)
Al-Hussein, A.: Maximum principle for optimal control of infinite dimensional stochastic differential equations. Dyn. Syst. Appl. 21, 205–218 (2012)
Bally, V., Pardoux, É., Stoica, L.: Backward stochastic differential equations associated to a symmetric Markov process. Potential Anal. 22(1), 17–60 (2005)
Bensoussan, A.: Lectures on stochastic control. Nonlinear Filtering and Stochastic Control, Cortona, 1981. Lecture Notes in Math., vol. 972, pp. 1–62. Springer, Berlin (1982)
Bensoussan, A.: Stochastic Control of Partially Observable Systems. Cambridge University Press, Cambridge (1992)
Bismut, J.-M.: Théorie probabiliste du contrôle des diffusions. Mem. Amer. Math. Soc. 4, 167 (1976)
Cohn, D.: Measure Theory. Birkhäuser, Boston (1980)
Fuhrman, M., Tessitore, G.: Nonlinear Kolmogorov equations in infinite dimensional spaces: the backward stochastic differential equations approach and applications to optimal control. Ann. Probab. 30(3), 1397–1465 (2002)
Grecksch, W., Tudor, C.: Stochastic evolution equations. A Hilbert Space Approach. Mathematical Research, vol. 85. Akademie-Verlag, Berlin (1995)
Gyöngy, I., Krylov, N.V.: On stochastics equations with respect to semimartingales. I. Stochastics 4(1), 1–21 (1980)
Hu, Y., Peng, S.: Maximum principle for semilinear stochastic evolution control systems. Stochastics 33(3–4), 159–180 (1990)
Hu, Y., Peng, S.: Adapted solution of a backward semilinear stochastic evolution equation. Stoch. Anal. Appl. 9(4), 445–459 (1991)
Hu, Y., Peng, S.: Maximum principle for optimal control of stochastic system of functional type. Stoch. Anal. Appl. 14(3), 283–301 (1996)
Imkeller, P., Reveillac, A., Richter, A.: Differentiability of quadratic BSDEs generated by continuous martingales. Ann. Appl. Probab. 22(1), 285–336 (2012)
Krylov, N.V., Rozovskii, B.: Stochastic evolution equations. Stochastic Differential Equations: Theory and Applications. Interdisciplinary Mathematical Sciences, vol. 2, pp. 1–69. World Science Publisher, Hackensack (2007)
Li, X.J., Yong, J.M.: Optimal Control Theory for Infinite-Dimensional Systems. Systems & Control: Foundations & Applications. Birkhauser Boston Inc., Boston (1995)
Morlais, M.-A.: Quadratic BSDEs driven by a continuous martingale and applications to the utility maximization problem. Finance Stoch. 13(1), 121–150 (2009)
Mazliak, L.: The maximum principle in stochastic control and backward equations. Backward Stochastic Differential Equations, Paris, 1995–1996. Pitman Research Notes in Mathematics Series, vol. 364, pp. 101–113. Longman, Harlow (1997)
Métivier, M., Pellaumail, J.: Stochastic Integration. Probability and Mathematical Statistics. Academic Press, Harcourt Brace Jovanovich, Publishers, New York (1980)
Øksendal, B., Proske, F., Zhang, T.: Backward stochastic partial differential equations with jumps and application to optimal control of random jump fields. Stochastics 77(5), 381–399 (2005)
Pardoux, É., Peng, S.: Adapted solution of a backward stochastic differential equation. Syst. Control Lett. 14(1), 55–61 (1990)
Peng, S.: A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28(4), 966–979 (1990)
Peng, S.: Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27(2), 125–144 (1993)
Pontryagin, L.S.: Optimal regulation processes. Amer. Math. Soc. Transl. 18(2), 321–339 (1961)
Revuz, D., Yor, M.: Continuous Martingales and Brownian Motion. Grundlehren der Mathematischen Wissenschaften, Fundamental Principles of Mathematical Sciences, vol. 293, 3rd edn. Springer, Berlin (1999)
RozovskiÄ, B.L.: Stochastic evolution systems. Linear Theory and Applications to Nonlinear Filtering, Translated from the Russian by A. Yarkho. Mathematics and its Applications, Soviet Series, vol. 35. Kluwer Academic Publishers Group, Dordrecht (1990)
Tang, S., Li, X.: Maximum principle for optimal control of distributed parameter stochastic systems with random jumps. Differential Equations, Dynamical Systems, and Control Science. notes in pure and applied mathematics, vol. 152, pp. 867–890. Dekker, New York (1994)
Tudor, C.: Optimal control for semilinear stochastic evolution equations. Appl. Math. Optim. 20(3), 319–331 (1989)
Xu, W.S.: Stochastic maximum principle for optimal control problem of forward and backward system. J. Aust. Math. Soc. Ser. B 37(2), 172–185 (1995)
Yong, J., Zhou, X.Y.: Stochastic Controls. Hamiltonian Systems and HJB Equations. Springer, New York (1999)
Zhou, X.Y.: On the necessary conditions of optimal controls for stochastic partial differential equations. SIAM J. Control Optim. 31(6), 1462–1478 (1993)
Acknowledgments
The author would like to thank the Mathematics Institute, Warwick University, where part of this work was done, for hospitality during the summer of 2011. Many thanks and much gratitude to King Abdulaziz City for Science and Technology (KACST), Riyadh, Saudi Arabia, for their support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Al-Hussein, A. (2016). Necessary and Sufficient Conditions of Optimalcontrol for Infinite Dimensional SDEs. In: Eddahbi, M., Essaky, E., Vives, J. (eds) Statistical Methods and Applications in Insurance and Finance. CIMPA School 2013. Springer Proceedings in Mathematics & Statistics, vol 158. Springer, Cham. https://doi.org/10.1007/978-3-319-30417-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-30417-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-30416-8
Online ISBN: 978-3-319-30417-5
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)