Abstract
We consider the problem of stochastic linear regulator over an infinite time horizon with superexponentially stable matrix in the equation of state dynamics. The form of the optimal control based on the criterion taking into account the information about the parameters of disturbances and the matrix stability rate was determined. The results obtained were used to analyze the model of a system with extremely impatient agents where the objective functional includes discounting by the asymptotically unbounded rate.
Similar content being viewed by others
References
Kwakernaak, H., and Sivan, R., Linear Optimal Control Systems, New York: Wiley, 1972. Translated under the title Lineinye optimal’nye sistemy upravleniya, Moscow: Mir, 1977.
Sira-Ramirez, H. and Agrawal, S.K., Differentially Flat Systems, Boca Raton: CRC Press, 2004.
Demir, A. and Sangiovanni-Vincentelli, A., Analysis and Simulation of Noise in Nonlinear Electronic Circuits and Systems, New York: Springer, 2012.
Safdari, H., Cherstvy, A.G., Chechkin, A.V., Bodrova, A., and Metzler, R., Aging Underdamped Scaled Brownian Motion: Ensemble-and Time-Averaged Particle Displacements, Nonergodicity, and the Failure of the Overdamping Approximation, Phys. Rev. E, 2017, vol. 95, no. 1, pp. 012120.
Kim, E.J., Lee, U., Heseltine, J., and Hollerbach, R., Geometric Structure and Geodesic in a Solvable Model of Nonequilibrium Process, Phys. Rev. E, 2016, vol. 93, no. 6, pp. 062127.
Smith, P.L., Ratcliff, R., and Sewell, D.K., Modeling Perceptual Discrimination in Dynamic Noise: Time-changed Diffusion and Release from Inhibition, J. Math. Psychol., 2014, vol. 59, pp. 95–113.
Belkina, T.A. and Palamarchuk, E.S., On Stochastic Optimality for a Linear Controller with Attenuating Disturbances, Autom. Remote Control, 2013, vol. 74, no. 4, pp. 628–641.
Jamison, D.T. and Jamison, J., Characterizing the Amount and Speed of Discounting Procedures, J. Benefit-Cost Analysis, 2011, vol. 2, no. 2, pp. 1–56.
Takahashi, T., Oono, H., and Radford, M.H.B., Psychophysics of Time Perception and Intertemporal Choice Models, Phys. A: Statist. Mechan. Appl., 2008, vol. 387, no. 8, pp. 2066–2074.
Tonneau, F., Windows, Behav. Process., 2005, vol. 69, no. 2, pp. 237–247.
Chechile, R.A., Mathematical Tools for Hazard Function Analysis, J. Math. Psychol., 2003, vol. 47, no. 5, pp. 478–494.
Bleichrodt, H., Rohde, K.I.M., and Wakker, P.P., Non-hyperbolic Time Inconsistency, Games Econ. Behavior, 2009, vol. 66, no. 1, pp. 27–38.
Palamarchuk, E.S., Stabilization of Linear Stochastic Systems with a Discount: Modeling and Estimation of the Long-Term Effects from the Application of Optimal Control Strategies, Math. Models Comput. Simul., 2015, vol. 7, no. 4, pp. 381–388.
Caraballo, T., On the Decay Rate of Solutions of Non-autonomous Differential Systems, Electron. J. Differ. Equat., 2001, vol. 2001, no. 5, pp. 1–17.
Anderson, B.D.O., Ilchmann, A., and Wirth, F.R., Stabilizability of Linear Time-varying Systems, Syst. Control Lett., 2013, vol. 62, no. 9, pp. 747–755.
Inoue, M., Wada, T., Asai, T., and Ikeda, M., Non-exponential Stabilization of Linear Time-invariant Systems by Linear Time-varying Controllers, in Proc. 50th IEEE Conf. Decision and Control and European Control Conf., New York, 2011, pp. 4090–4095.
Palamarchuk, E.S., Analysis of Criteria for Long-run Average in the Problem of Stochastic Linear Regulator Autom. Remote Control, 2016, vol. 77, no. 10, pp. 1756–1767.
Palamarchuk, E.S., Estimating Risk in the Linear Economic Systems under Negative Time Preferences, Ekon. Mat. Metody, 2013, vol. 49, no. 3, pp. 99–116.
Carriere, J.F., Long-term Yield Rates for Actuarial Valuations, North Am. Actuarial J., 1999, vol. 3, no. 3, pp. 13–22.
Holmer, M.R., The Asset-liability Management Strategy System at Fannie Mae, Interfaces, 1994, vol. 24, no. 3, pp. 3–21.
Andritzky, J., Sovereign Default Risk Valuation: Implications of Debt Crises and Bond Restructurings, New York: Springer, 2006.
Steffensen, M., Differential Systems in Finance and Life Insurance, in Stochast. Econom. Dynamics, Copenhagen: Copenhagen Business School Press, 2007, pp. 317–360.
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © E.S. Palamarchuk, 2018, published in Avtomatika i Telemekhanika, 2018, No. 3, pp. 61–75.
Rights and permissions
About this article
Cite this article
Palamarchuk, E.S. Optimization of the Superstable Linear Stochastic System Applied to the Model with Extremely Impatient Agents. Autom Remote Control 79, 439–450 (2018). https://doi.org/10.1134/S0005117918030049
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117918030049