Skip to main content
Log in

Non-uniqueness of solutions of the Hamilton–Jacobi–Bellman equation for time-average control

  • Stochastic Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

In control of diffusion processes a very useful instrument is the equation for optimal strategy and cost. For the version of infinite time horizon with time averaging this equation is much more complicated than for the version of finite time horizon, and even than for the version of infinite time horizon with discounting. In particular, the equation solution may be non-unique. This problem of non-uniqueness is researched in book of A. Arapostathis et al., 2012, for special models—near-monotone. The result received in the book is extended in the article to an important general case—models with restrictions in control which guarantee ergodicity of the process. Besides we correct the proofs from the book.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Arapostathis, A., Borkar, V.S., and Ghosh, M.K., Ergodic Control of Diffusion Processes, in Encyclopedia of Mathematics and Its Applications 143, Cambridge: Cambridge Univ. Press., 2012.

    Google Scholar 

  2. Mandl, P., Analytical Treatment of One-Dimensional Markov Processes, Berlin: Springer Verlag, 1968.

    MATH  Google Scholar 

  3. Morton, R., On the Optimal Control of Stationary Diffusion Processes with Inaccessible Boundaries and no Discounting, J. Appl. Probab., 1971, no. 8, pp. 551–560.

    Article  MathSciNet  MATH  Google Scholar 

  4. Morton, R., On the Control of Diffusion Processes, J. Optim. Theory Appl., 1974, no. 14, pp. 51–162.

    Article  MathSciNet  Google Scholar 

  5. Pardoux, E. and Veretennikov, A.Yu., On the Poisson Equation and Diffusion Approximation. I, Ann. Probab., 2001, no. 29 (3), pp. 1061–1085.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. V. Anulova.

Additional information

Original Russian Text © S.V. Anulova, 2017, published in Avtomatika i Telemekhanika, 2017, No. 8, pp. 91–99.

This paper was recommended for publication by B.M. Miller, a member of the Editorial Board

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Anulova, S.V. Non-uniqueness of solutions of the Hamilton–Jacobi–Bellman equation for time-average control. Autom Remote Control 78, 1430–1437 (2017). https://doi.org/10.1134/S0005117917080045

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117917080045

Keywords

Navigation