Skip to main content
SpringerLink
Log in

Optimization of quasilinear stochastic control-nonlinear diffusion systems

  • Stochastic Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

Consideration was given to the problem of optimal control of the quasilinear stochastic continuous-time systems whose coefficients in the general case depend nonlinearly on the program control. A special case of this problem is represented by optimization of the incompletefeedback control strategies. An optimization algorithm was proposed based on the method of gradient descent in the functional space. Its relaxation property was substantiated in theoretical terms. The necessary optimality conditions are formulated and proved within the framework of the formulated problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Krasovskii, N.N. and Lidskii, E.A, Analytical Design of Controllers in Systems with Random Attributes. I. Statement of the Problem, Method of Solving, Autom. Remote Control, 1961, vol. 22, no. 9, pp. 1021–1026.

    MathSciNet  Google Scholar 

  2. Krasovskii, N.N. and Lidskii, E.A, Analytical Design of Controllers in Systems with Random Attributes. II. Equations of Optimum Solutions. Approximate Solution, Autom. Remote Control, 1961, vol. 22, no. 10, pp. 1141–1147.

    Google Scholar 

  3. Krasovskii, N.N. and Lidskii, E.A, Analytical Design of Controllers in Systems with Random Properties. III. Optimal Control in Linear Systems. Minimum Mean-Square Error, Autom. Remote Control, 1961, vol. 22, no. 11, pp. 1289–1295.

    Google Scholar 

  4. Kurzhanskii, A.B, On Analytical Design of Controller in the System with Control-dependent Noise, Differ. Uravn., 1965, vol. 1, no. 2, pp. 204–213.

    Google Scholar 

  5. Paraev, Yu.I., Vvedenie v statisticheskuyu dinamiku protsessov upravleniya i fil’tratsii (Introduction to the Statistical Dynamics of Processes of Control and Filtration), Moscow: Sovetskoe Radio, 1976.

    Google Scholar 

  6. Wonham, W.M., Random Differential Equations in Control Theory, in Probabilistic Methods in Applied Mathematics, Bharucha-Reid, A.T., Ed., New York: Academic, vol. 2, 1970, pp. 131–212.

    Google Scholar 

  7. McLane, P.J, Linear Optimal Stochastic Control Using Instantaneous Output Feedback, Int. J. Control, 1971, vol. 13, no. 2, pp. 383–396.

    Article  MathSciNet  MATH  Google Scholar 

  8. Carravetta, F. and Mavelli, G, Linear Output-feedback Control of Stochastic Linear Systems with State- and Control-dependent Disturbances, in Proc. 44 IEEE Conf. Decision Control, Eur. Control Conf., Seville, Spain, December 12–15, 2005, pp. 554–559.

    Google Scholar 

  9. Dombrovskii, V.V., Dombrovskii, D.V., and Lyashenko, E.A, Predictive Control of Random-parameter Systems with Multiplicative Noise. Application to Investment Portfolio Optimization, Autom. Remote Control, 2005, vol. 66, no. 4, pp. 583–595.

    Article  MathSciNet  MATH  Google Scholar 

  10. Rumyantsev, D.S. and Khrustalev, M.M, Numerical Methods to Design Optimal Control for Stochastic Dynamic Diffusion Systems, Izv. Ross. Akad. Nauk, Teor. Sist. Upravlen., 2007, no. 3, pp. 27–38.

    MATH  Google Scholar 

  11. Khrustalev, M.M., Rumyantsev, D.S., and Tsar’kov, K.A, Algorithm to Seek Suboptimal Control Strategies for Quasilinear Dynamic Srochastic Diffusion Systems, Izv. Ross. Akad. Nauk, Teor. Sist. Upravlen., 2014, no. 1, pp. 74–86.

    Google Scholar 

  12. Tsar’kov, K.A., Khrustalev, M.M., and Rumyantsev, D.S, Gradient Method of Optimization of the Control Strategies of Quasilinear Stochastic Systems under Information Constraints, in Trans. XII All-Russian Conf. on Control Probl. (VSPU-2014), Moscow: Inst. Probl. Upravlen., 2014, pp. 2383–2392.

    Google Scholar 

  13. Trushkova, E.A, Global Control Improvement Algorithms, Autom. Remote Control, 2011, vol. 72, no. 6, pp. 1282–1290.

    Article  MathSciNet  MATH  Google Scholar 

  14. Khrustalev, M.M. and Khalina, A.S, Conditions for Stabilizability and Optimality of the Quasilinear Stocastic Systems under Incomplete Feedsback over an Unlimited Time Interval, in Trans. XII All-Russian Conf, on Control Probl. (VSPU-2014), Moscow: Inst. Probl. Upravlen., 2014, pp. 1126–1134.

    Google Scholar 

  15. Korolyuk, V.S., Portenko, N.I., Skorokhod, A.V., and Turbin, A.F., Spravochnik po teorii veroyatnostei i matematicheskoi statistike (Reference Book on the Probability Theory and Mathematical Statistics), Moscow: Nauka, 1985.

    MATH  Google Scholar 

  16. Khrustalev, M.M, Sufficient Equilibrium Conditions, Izv. Ross. Akad. Nauk, Teor. Sist. Upravlen., 1995, no. 6, pp. 194–208.

    Google Scholar 

  17. Khrustalev, M.M, Conditions for Nash Equilibrium in the Stochastic Differential Games under Incomplte Information about the State. Method Lagrange, Izv. Ross. Akad. Nauk, Teor. Sist. Upravlen., 1996, no. 1, pp. 72–79.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, Russia

    M. M. Khrustalev, D. S. Rumyantsev & K. A. Tsar’kov

Authors
  1. M. M. Khrustalev
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. S. Rumyantsev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. A. Tsar’kov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. M. Khrustalev.

Additional information

Original Russian Text © M.M. Khrustalev, D.S. Rumyantsev, K.A. Tsar’kov, 2017, published in Avtomatika i Telemekhanika, 2017, No. 6, pp. 84–105.

This paper was recommended for publication by A.I. Kibzun, a member of the Editorial Board

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khrustalev, M.M., Rumyantsev, D.S. & Tsar’kov, K.A. Optimization of quasilinear stochastic control-nonlinear diffusion systems. Autom Remote Control 78, 1028–1045 (2017). https://doi.org/10.1134/S0005117917060054

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117917060054

Keywords

Search

Navigation