Abstract
This paper investigates sufficient conditions for Lipschitz regularity of the value function for an infinite horizon optimal control problem subject to state constraints. We focus on problems with a cost functional that includes a discount rate factor and allow time dependent dynamics and Lagrangian. Furthermore, our state constraints may be unbounded and with nonsmooth boundary. The key technical result used in our proof is an estimate on the distance of a given trajectory from the set of all its viable (feasible) trajectories (provided the discount rate is sufficiently large). These distance estimates are derived under a uniform inward pointing condition on the state constraint and imply, in particular, that feasible trajectories depend on initial states in a Lipschitz way with an exponentially increasing in time Lipschitz constant. As a corollary, we show that the value function of the original problem coincides with the value function of the relaxed infinite horizon problem.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aseev, S.M., Veliov, V.M.: Maximum principle for infinite-horizon optimal control problems with dominating discount. Dyn. Contin. Discrete Impuls. Syst. Ser. B Appl. Algorithms 19, 43–63 (2012)
Aseev, S.M., Veliov, V.M.: Maximum principle for infinite-horizon optimal control problems under weak regularity assumptions. Tr. Inst. Mat. Mekh. 20(3), 41–57 (2014)
Aubin, J.-P., Frankowska, H.: Set-valued analysis. In: Modern Birkhäuser Classics. Birkhäuser Boston Inc., Boston, MA (2009)
Basco, V., Cannarsa, P., Frankowska, H.: Necessary conditions for infinite horizon optimal control problems with state constraints. Math. Control Relat. Fields 8, 535–555 (2018)
Bettiol, P., Frankowska, H., Vinter, R.B.: \(L^\infty \) estimates on trajectories confined to a closed subset. J. Differ. Equ. 252(2), 1912–1933 (2012)
Bettiol, P., Frankowska, H., Vinter, R.B.: Improved sensitivity relations in state constrained optimal control. Appl. Math. Optim. 71(2), 353–377 (2015)
Cannarsa, P., Frankowska, H.: Value function, relaxation, and transversality conditions in infinite horizon optimal control. J. Math. Anal. Appl. 457(2), 1188–1217 (2018)
Carlson, D.A., Haurie, A.: Infinite Horizon Optimal Control: Theory and Applications. Springer, New York (1987)
Frankowska, H., Mazzola, M.: Discontinuous solutions of Hamilton-Jacobi-Bellman equation under state constraints. Calc. Var. Partial Differ. Equ. 46(3–4), 725–747 (2013)
Frankowska, H., Plaskacz, S.: A measurable upper semicontinuous viability theorem for tubes. Nonlinear Analysis: Theory, Methods & Applications 26(3), 565–582 (1996)
Ingalls, B., Sontag, E., Wang, Y.: An infinite-time relaxation theorem for differential inclusions. Proc. Am. Math. Soc. 131(2), 487–499 (2003)
Pickenhain, S.: On adequate transversality conditions for infinite horizon optimal control problems—a famous example of Halkin. In: Crespo Cuaresma, J., Palokangas, T., Tarasyev, A. (eds.) Dynamic Systems, Economic Growth, and the Environment, pp. 3–22. Springer, Berlin, Heidelberg (2010)
Soner, H.M.: Optimal control problems with state-space constraints I. SIAM J. Control Optim. 24, 552–562 (1986)
Vinter, R.B.: Optimal Control. Birkhäuser, Boston, MA (2000)
Acknowledgements
The second author was partially supported by the Air Force Office of Scientific Research under award number FA9550-18-1-0254.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Basco, V., Frankowska, H. (2019). Lipschitz Continuity of the Value Function for the Infinite Horizon Optimal Control Problem Under State Constraints. In: Alabau-Boussouira, F., Ancona, F., Porretta, A., Sinestrari, C. (eds) Trends in Control Theory and Partial Differential Equations. Springer INdAM Series, vol 32. Springer, Cham. https://doi.org/10.1007/978-3-030-17949-6_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-17949-6_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-17948-9
Online ISBN: 978-3-030-17949-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)