Skip to main content
SpringerLink
Log in

Maximum principle for partially-observed optimal control problems of stochastic delay systems

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

This paper is concerned with partially-observed optimal control problems for stochastic delay systems. Combining Girsanov’s theorem with a standard variational technique, the authors obtain a maximum principle on the assumption that the system equation contains time delay and the control domain is convex. The related adjoint processes are characterized as solutions to anticipated backward stochastic differential equations in finite-dimensional spaces. Then, the proposed theoretical result is applied to study partially-observed linear-quadratic optimal control problem for stochastic delay system and an explicit observable control variable is given.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kolmanovsky V B and Maizenberg T L, Optimal control of stochastic systems with aftereffect, Automation and Remote Control, 1973, 1: 47–61.

    MathSciNet  Google Scholar 

  2. Øksendal B and Sulem A, A maximum principle for optimal control of stochastic systems with delay, with applications to finance, Optimal Control and Partial Differential Equations, Amsterdam: ISO Press, 2000, 64–79.

    Google Scholar 

  3. Larssen B, Dynamic programming in stochastic control of systems with delay, Stochastic and Stochastics Reports, 2002, 74(3): 651–673.

    Article  MathSciNet  MATH  Google Scholar 

  4. Peng S and Yang Z, Anticipated backward stochastic differential equations, Ann. Proba., 2009, 37(3): 877–902.

    Article  MathSciNet  MATH  Google Scholar 

  5. Bismut J M, An introductory approach to duality in optimal stochastic control, SIAM Rev., 1978, 20(1): 62–78.

    Article  MathSciNet  MATH  Google Scholar 

  6. Pardoux E and Peng S, Adapted solution of backward stochastic dierential equation, Systems Control Lett., 1990, 14(1): 55–61.

    Article  MathSciNet  MATH  Google Scholar 

  7. Chen L and Wu Z, Maximum principle for the stochastic optimal control problem with delay and application, Automatica, 2010, 46(6): 1074–1080.

    Article  MathSciNet  MATH  Google Scholar 

  8. Øksendal B, Sulem A, and Zhang T, Optimal control of stochastic delay equations and timeadvanced backward stochastic differential equations, Advances in Applied Probability, 2011, 43(2): 572–596.

    Article  MathSciNet  MATH  Google Scholar 

  9. Bensoussan A, Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions, Stochastics, 1983, 9(3): 169–222.

    Article  MathSciNet  MATH  Google Scholar 

  10. Li X and Tang S, General necessary conditions for partially observed optimal stochastic controls, J. Appl. Probab., 1995, 32(4): 1118–1137.

    Article  MathSciNet  MATH  Google Scholar 

  11. Tang S, The maximum principle for partially-observed optimal control of stochastic differential equations, SIAM J. Control Optim., 1998, 36(5): 1596–1617.

    Article  MathSciNet  MATH  Google Scholar 

  12. Zhang W, Zhao Y, and Sheng L, Some remarks on stability of stochastic singular systems with state-dependent noise, Automatica, 2014, 51: 273–277.

    Article  MathSciNet  MATH  Google Scholar 

  13. Wang G, Zhang C, and Zhang W, Stochastic maximum principle for mean-field type optimal control under partial information, IEEE Trans. Autom. Control, 2014, 59(2): 522–528.

    Article  MathSciNet  Google Scholar 

  14. Wang G and Wu Z, General maximum principles for partially observed risk-sensitive optimal control problems and applications to finance, J. Optim. Theory. Appl., 2009, 141(3): 677–700.

    Article  MATH  Google Scholar 

  15. Wu Z, A maximum principle for partially observed optimal control of forward-backward stochastic control systems, Sci. China Ser. F., 2010, 53(11): 2205–2214.

    MathSciNet  MATH  Google Scholar 

  16. Shi J and Wu Z, Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems, J. Optim. Theory. Appl., 2010, 145(3): 543–578.

    Article  MathSciNet  MATH  Google Scholar 

  17. Chen L and Wu Z, A type of generalized forward-backward stochastic differential equations and applications, Chin. Ann. Math. Ser. B, 2011, 32(2): 279–292.

    Article  MathSciNet  MATH  Google Scholar 

  18. Liptser R S and Shiryayev A N, Statistics of Random Process, Springer-Verlag, New York, 1977.

    Book  MATH  Google Scholar 

  19. Huang J, Li X, and Shi J, Froward-backward linear quadratic stochastic optimal control problem with delay, Systems Control Lett., 2012, 61(5): 623–630.

    Article  MathSciNet  MATH  Google Scholar 

  20. Huang J, Wang G, and Xiong J, A maximum principle for partial information backward stochastic control problems with applications, SIAM J. Control Optim., 2009, 48(4): 2106–2117.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu, 611731, China

    Shuang Wu & Lan Shu

  2. Department of Applied Mathematics, China University of Petroleum, Qingdao, 266580, China

    Shuang Wu

Authors
  1. Shuang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lan Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shuang Wu.

Additional information

This paper was recommended for publication by Editor XIE Lihua.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, S., Shu, L. Maximum principle for partially-observed optimal control problems of stochastic delay systems. J Syst Sci Complex 30, 316–328 (2017). https://doi.org/10.1007/s11424-016-5078-4

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-016-5078-4

Keywords

Search

Navigation