Abstract
In control of diffusion processes a very useful instrument is the equation for optimal strategy and cost. For the version of infinite time horizon with time averaging this equation is much more complicated than for the version of finite time horizon, and even than for the version of infinite time horizon with discounting. In particular, the equation solution may be non-unique. This problem of non-uniqueness is researched in book of A. Arapostathis et al., 2012, for special models—near-monotone. The result received in the book is extended in the article to an important general case—models with restrictions in control which guarantee ergodicity of the process. Besides we correct the proofs from the book.
Similar content being viewed by others
References
Arapostathis, A., Borkar, V.S., and Ghosh, M.K., Ergodic Control of Diffusion Processes, in Encyclopedia of Mathematics and Its Applications 143, Cambridge: Cambridge Univ. Press., 2012.
Mandl, P., Analytical Treatment of One-Dimensional Markov Processes, Berlin: Springer Verlag, 1968.
Morton, R., On the Optimal Control of Stationary Diffusion Processes with Inaccessible Boundaries and no Discounting, J. Appl. Probab., 1971, no. 8, pp. 551–560.
Morton, R., On the Control of Diffusion Processes, J. Optim. Theory Appl., 1974, no. 14, pp. 51–162.
Pardoux, E. and Veretennikov, A.Yu., On the Poisson Equation and Diffusion Approximation. I, Ann. Probab., 2001, no. 29 (3), pp. 1061–1085.
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © S.V. Anulova, 2017, published in Avtomatika i Telemekhanika, 2017, No. 8, pp. 91–99.
This paper was recommended for publication by B.M. Miller, a member of the Editorial Board
Rights and permissions
About this article
Cite this article
Anulova, S.V. Non-uniqueness of solutions of the Hamilton–Jacobi–Bellman equation for time-average control. Autom Remote Control 78, 1430–1437 (2017). https://doi.org/10.1134/S0005117917080045
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117917080045