Abstract
In this paper we study the structure of approximate solutions of an autonomous nonconcave discrete-time optimal control system with a compact metric space of states. In the first part of the paper we discuss our recent results for systems described by a bounded upper semicontinuous objective function which determines an optimality criterion. These optimal control systems are discrete-time analogs of Lagrange problems in the calculus of variations. It is known that approximate solutions are determined mainly by the objective function, and are essentially independent of the choice of time interval and data, except in regions close to the endpoints of the time interval. Our goal is to study the structure of approximate solutions in regions close to the endpoints of the time intervals. The second part of the paper contains new results on the structure of solutions of optimal control systems which are discrete-time analogs of Bolza problems in the calculus of variations. These systems are described by a pair of objective functions which determines an optimality criterion.
JEL Classification: C02, C61, C67
Mathematics Subject Classification (2010): 49J99
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson BDO, Moore JB (1971) Linear optimal control. Prentice-Hall, Englewood Cliffs
Aseev SM, Veliov VM (2012) Maximum principle for infinite-horizon optimal control problems with dominating discount. Dyn Contin Discret Impuls Syst Ser B 19:43–63
Aubry S, Le Daeron PY (1983) The discrete Frenkel-Kontorova model and its extensions I. Physica D 8:381–422
Baumeister J, Leitao A, Silva GN (2007) On the value function for nonautonomous optimal control problems with infinite horizon. Syst Control Lett 56:188–196
Blot J (2009) Infinite-horizon Pontryagin principles without invertibility. J Nonlinear Convex Anal 10:177–189
Blot J, Cartigny P (2000) Optimality in infinite-horizon variational problems under sign conditions. J Optim Theory Appl 106:411–419
Blot J, Hayek N (2014) Infinite-horizon optimal control in the discrete-time framework. Springer briefs in optimization. Springer, New York
Cartigny P, Michel P (2003) On a sufficient transversality condition for infinite horizon optimal control problems. Autom J IFAC 39:1007–1010
Gaitsgory V, Rossomakhine S, Thatcher N (2012) Approximate solution of the HJB inequality related to the infinite horizon optimal control problem with discounting. Dyn Contin Discret Impuls Syst Ser B 19:65–92
Hayek N (2011) Infinite horizon multiobjective optimal control problems in the discrete time case. Optimization 60:509–529
Jasso-Fuentes H, Hernandez-Lerma O (2008) Characterizations of overtaking optimality for controlled diffusion processes. Appl Math Optim 57:349–369
Kolokoltsov V, Yang W (2012) The turnpike theorems for Markov games. Dyn Games Appl 2:294–312
Leizarowitz A (1985) Infinite horizon autonomous systems with unbounded cost. Appl Math Opt 13:19–43
Leizarowitz A (1986) Tracking nonperiodic trajectories with the overtaking criterion. Appl Math Opt 14:155–171
Leizarowitz A, Mizel VJ (1989) One dimensional infinite horizon variational problems arising in continuum mechanics. Arch Ration Mech Anal 106:161–194
Lykina V, Pickenhain S, Wagner M (2008) Different interpretations of the improper integral objective in an infinite horizon control problem. J Math Anal Appl 340:498–510
Makarov VL, Rubinov AM (1977) Mathematical theory of economic dynamics and equilibria. Springer, New York
Malinowska AB, Martins N, Torres DFM (2011) Transversality conditions for infinite horizon variational problems on time scales. Optim Lett 5:41–53
Marcus M, Zaslavski AJ (1999) The structure of extremals of a class of second order variational problems. Ann Inst Henri Poincaré Anal Non Lineare 16:593–629
McKenzie LW (1976) Turnpike theory. Econometrica 44:841–866
Mordukhovich BS (2011) Optimal control and feedback design of state-constrained parabolic systems in uncertainly conditions. Appl Anal 90:1075–1109
Mordukhovich BS, Shvartsman I (2004) Optimization and feedback control of constrained parabolic systems under uncertain perturbations. In: de Queiroz MS, Malisoff M, Wolensk P (eds) Optimal control, stabilization and nonsmooth analysis. Lecture notes in control and information sciences. Springer, Berlin/New York, pp 121–132
Ocana Anaya E, Cartigny P, Loisel P (2009) Singular infinite horizon calculus of variations. Applications to fisheries management. J Nonlinear Convex Anal 10:157–176
Pickenhain S, Lykina V, Wagner M (2008) On the lower semicontinuity of functionals involving Lebesgue or improper Riemann integrals in infinite horizon optimal control problems. Control Cybern 37:451–468
Porretta A, Zuazua E (2013) Long time versus steady state optimal control. SIAM J Control Optim 51:4242–4273
Samuelson PA (1965) A catenary turnpike theorem involving consumption and the golden rule. Am Econ Rev 55:486–496
Zaslavski AJ (2006) Turnpike properties in the calculus of variations and optimal control. Springer, New York
Zaslavski AJ (2007) Turnpike results for a discrete-time optimal control systems arising in economic dynamics. Nonlinear Anal 67:2024–2049
Zaslavski AJ (2009) Two turnpike results for a discrete-time optimal control systems. Nonlinear Anal 71:902–909
Zaslavski AJ (2010) Stability of a turnpike phenomenon for a discrete-time optimal control systems. J Optim Theory Appl 145:597–612
Zaslavski AJ (2011) Turnpike properties of approximate solutions for discrete-time control systems. Commun Math Anal 11:36–45
Zaslavski AJ (2011) Structure of approximate solutions for a class of optimal control systems. J Math Appl 34:1–14
Zaslavski AJ (2011) Stability of a turnpike phenomenon for a class of optimal control systems in metric spaces. Numer Algebra Control Optim 1:245–260
Zaslavski AJ (2011) The existence and structure of approximate solutions of dynamic discrete time zero-sum games. J Nonlinear Convex Anal 12:49–68
Zaslavski AJ (2013) Nonconvex optimal control and variational problems. Springer optimization and its applications. Springer, New York
Zaslavski AJ (2014) Turnpike properties of approximate solutions of nonconcave discrete-time optimal control problems. J Convex Anal 21:681–701
Zaslavski AJ (2014) Turnpike phenomenon and infinite horizon optimal control. Springer optimization and its applications. Springer, New York
Zaslavski AJ (2014) Turnpike properties for nonconcave problems. Adv Math Econ 18:101–134
Zaslavski AJ (2014) Structure of solutions of discrete time optimal control roblems in the regions close to the endpoints. Set-Valued Var Anal 22:809–842
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Japan
About this chapter
Cite this chapter
Zaslavski, A.J. (2015). Discrete Time Optimal Control Problems on Large Intervals. In: Kusuoka, S., Maruyama, T. (eds) Advances in Mathematical Economics Volume 19. Advances in Mathematical Economics, vol 19. Springer, Tokyo. https://doi.org/10.1007/978-4-431-55489-9_4
Download citation
DOI: https://doi.org/10.1007/978-4-431-55489-9_4
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-55488-2
Online ISBN: 978-4-431-55489-9
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)