Skip to main content
Log in

Optimization of the Superstable Linear Stochastic System Applied to the Model with Extremely Impatient Agents

  • Stochastic Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

We consider the problem of stochastic linear regulator over an infinite time horizon with superexponentially stable matrix in the equation of state dynamics. The form of the optimal control based on the criterion taking into account the information about the parameters of disturbances and the matrix stability rate was determined. The results obtained were used to analyze the model of a system with extremely impatient agents where the objective functional includes discounting by the asymptotically unbounded rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kwakernaak, H., and Sivan, R., Linear Optimal Control Systems, New York: Wiley, 1972. Translated under the title Lineinye optimal’nye sistemy upravleniya, Moscow: Mir, 1977.

    MATH  Google Scholar 

  2. Sira-Ramirez, H. and Agrawal, S.K., Differentially Flat Systems, Boca Raton: CRC Press, 2004.

    MATH  Google Scholar 

  3. Demir, A. and Sangiovanni-Vincentelli, A., Analysis and Simulation of Noise in Nonlinear Electronic Circuits and Systems, New York: Springer, 2012.

    Google Scholar 

  4. Safdari, H., Cherstvy, A.G., Chechkin, A.V., Bodrova, A., and Metzler, R., Aging Underdamped Scaled Brownian Motion: Ensemble-and Time-Averaged Particle Displacements, Nonergodicity, and the Failure of the Overdamping Approximation, Phys. Rev. E, 2017, vol. 95, no. 1, pp. 012120.

    Article  Google Scholar 

  5. Kim, E.J., Lee, U., Heseltine, J., and Hollerbach, R., Geometric Structure and Geodesic in a Solvable Model of Nonequilibrium Process, Phys. Rev. E, 2016, vol. 93, no. 6, pp. 062127.

    Article  MathSciNet  Google Scholar 

  6. Smith, P.L., Ratcliff, R., and Sewell, D.K., Modeling Perceptual Discrimination in Dynamic Noise: Time-changed Diffusion and Release from Inhibition, J. Math. Psychol., 2014, vol. 59, pp. 95–113.

    Article  MathSciNet  MATH  Google Scholar 

  7. Belkina, T.A. and Palamarchuk, E.S., On Stochastic Optimality for a Linear Controller with Attenuating Disturbances, Autom. Remote Control, 2013, vol. 74, no. 4, pp. 628–641.

    Article  MathSciNet  MATH  Google Scholar 

  8. Jamison, D.T. and Jamison, J., Characterizing the Amount and Speed of Discounting Procedures, J. Benefit-Cost Analysis, 2011, vol. 2, no. 2, pp. 1–56.

    Article  Google Scholar 

  9. Takahashi, T., Oono, H., and Radford, M.H.B., Psychophysics of Time Perception and Intertemporal Choice Models, Phys. A: Statist. Mechan. Appl., 2008, vol. 387, no. 8, pp. 2066–2074.

    Article  Google Scholar 

  10. Tonneau, F., Windows, Behav. Process., 2005, vol. 69, no. 2, pp. 237–247.

    Article  Google Scholar 

  11. Chechile, R.A., Mathematical Tools for Hazard Function Analysis, J. Math. Psychol., 2003, vol. 47, no. 5, pp. 478–494.

    Article  MathSciNet  MATH  Google Scholar 

  12. Bleichrodt, H., Rohde, K.I.M., and Wakker, P.P., Non-hyperbolic Time Inconsistency, Games Econ. Behavior, 2009, vol. 66, no. 1, pp. 27–38.

    Article  MathSciNet  MATH  Google Scholar 

  13. Palamarchuk, E.S., Stabilization of Linear Stochastic Systems with a Discount: Modeling and Estimation of the Long-Term Effects from the Application of Optimal Control Strategies, Math. Models Comput. Simul., 2015, vol. 7, no. 4, pp. 381–388.

    Article  MathSciNet  Google Scholar 

  14. Caraballo, T., On the Decay Rate of Solutions of Non-autonomous Differential Systems, Electron. J. Differ. Equat., 2001, vol. 2001, no. 5, pp. 1–17.

    MathSciNet  MATH  Google Scholar 

  15. Anderson, B.D.O., Ilchmann, A., and Wirth, F.R., Stabilizability of Linear Time-varying Systems, Syst. Control Lett., 2013, vol. 62, no. 9, pp. 747–755.

    Article  MathSciNet  MATH  Google Scholar 

  16. Inoue, M., Wada, T., Asai, T., and Ikeda, M., Non-exponential Stabilization of Linear Time-invariant Systems by Linear Time-varying Controllers, in Proc. 50th IEEE Conf. Decision and Control and European Control Conf., New York, 2011, pp. 4090–4095.

    Chapter  Google Scholar 

  17. Palamarchuk, E.S., Analysis of Criteria for Long-run Average in the Problem of Stochastic Linear Regulator Autom. Remote Control, 2016, vol. 77, no. 10, pp. 1756–1767.

    Article  MathSciNet  MATH  Google Scholar 

  18. Palamarchuk, E.S., Estimating Risk in the Linear Economic Systems under Negative Time Preferences, Ekon. Mat. Metody, 2013, vol. 49, no. 3, pp. 99–116.

    Google Scholar 

  19. Carriere, J.F., Long-term Yield Rates for Actuarial Valuations, North Am. Actuarial J., 1999, vol. 3, no. 3, pp. 13–22.

    Article  MathSciNet  MATH  Google Scholar 

  20. Holmer, M.R., The Asset-liability Management Strategy System at Fannie Mae, Interfaces, 1994, vol. 24, no. 3, pp. 3–21.

    Article  Google Scholar 

  21. Andritzky, J., Sovereign Default Risk Valuation: Implications of Debt Crises and Bond Restructurings, New York: Springer, 2006.

  22. Steffensen, M., Differential Systems in Finance and Life Insurance, in Stochast. Econom. Dynamics, Copenhagen: Copenhagen Business School Press, 2007, pp. 317–360.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to E. S. Palamarchuk.

Additional information

Original Russian Text © E.S. Palamarchuk, 2018, published in Avtomatika i Telemekhanika, 2018, No. 3, pp. 61–75.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Palamarchuk, E.S. Optimization of the Superstable Linear Stochastic System Applied to the Model with Extremely Impatient Agents. Autom Remote Control 79, 439–450 (2018). https://doi.org/10.1134/S0005117918030049

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117918030049

Keywords

Navigation