Skip to main content
SpringerLink
Log in

Markov decision processes with both continuous and impulsive control

  • Section I Controlled Stochastic Processes
  • Conference paper
  • First Online:
Stochastic Optimization

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 81))

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A.A. Yushkevich. Continuous time Markov decision processes with interventions. Stochastics, 9(1983)235–274.

    Google Scholar 

  2. G. De Leve. Generalized Markov decision processes. Mathematical Centre, Amsterdam, 1964.

    Google Scholar 

  3. F.A. Van der Duyn Schouten. Markov decision processes with a continuous time parameters. Thesis, Amsterdam, 1979.

    Google Scholar 

  4. A. Hordijk and F.A. Van der Duyn Schouten. Discretization and weak convergence in Markov decision drift processes. Mathematical Operations Research, 9(1984)112–141.

    Google Scholar 

  5. A. Bensoussan and J.-L. Lions. Contrôle impulsionnel et contrôle continu: methode des inequations quasi-variationnelles non-linear. Comptes Rendus de l'Academie des Sciences Series A, 278(1974)675–679.

    Google Scholar 

  6. H.J. Kushner. Probability Methods for Approximations in Stochastic Control and for Elliptic Equations. Academic Press, New York, 1977.

    Google Scholar 

  7. A.N. Shiryaev. Statistical sequential analysis. Translations of Math. Monographs, Vol. 18, Providence, R.I., 1973.

    Google Scholar 

  8. N.V. Krylov. Controlled Diffusion Processes. Springer-Verlag, 1980.

    Google Scholar 

  9. M.H.A. Davis. Piecewise deterministic Markov processes: a general class of non-diffusion stochastic models. Journal of the Royal Statistical Society (B) (1984).

    Google Scholar 

  10. D. Vermes. Optimal control of piecewise deterministic Markov processes. Stochastics (1984).

    Google Scholar 

  11. G. Pragarauskas. Some problems in optimal control theory concerning the solutions of stochastic integral equations. Thesis, Vilnius, 1983.

    Google Scholar 

  12. P.A. Meyer. Probabilitiés et potentiel. Hermann, Paris, 1966.

    Google Scholar 

  13. I.I. Gihman and A.V. Skorohod. Controlled Stochastic Processes. Springer-Verlag, 1979.

    Google Scholar 

  14. M. Kohlmann and R.A. Rishel. A variational inequality for a partially observed stopping time problem. In Stochastic Control Theory and Stochastic Differential Systems, Lecture Notes in Control and Information Sciences, Vol. 16, Springer-Verlag, 1979, pp. 472–480.

    Google Scholar 

  15. A.A. Yushkevich and R.Ya. Chitashvili. Controlled random sequences and Markov chains (in Russian). Uspehki Matematicheskie Nauk. 37(1982)213–242.

    Google Scholar 

  16. A.A. Yushkevich. Controlled jump Markov processes (in Russian). Doklady Academii Nauk SSSR, 233(1977)304–307.

    Google Scholar 

  17. E.B. Dynkin and A.A. Yushkevich. Controlled Markov Processes, Springer-Verlag, 1979.

    Google Scholar 

  18. A.A. Yushkevich and E.A. Fainberg. On homogeneous controlled Markov models with continuous time and a finite or countable state space (in Russian). Teoriya Veroyatnosti i ee Primeneniya, 24(1979)155–160.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Moscow Institute of Transport Engineering, Moscow, USSR

    A. A. Yushkevich

Authors
  1. A. A. Yushkevich
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Vadim I. Arkin A. Shiraev R. Wets

Rights and permissions

Reprints and permissions

Copyright information

© 1986 International Institute for Applied Systems Analysis

About this paper

Cite this paper

Yushkevich, A.A. (1986). Markov decision processes with both continuous and impulsive control. In: Arkin, V.I., Shiraev, A., Wets, R. (eds) Stochastic Optimization. Lecture Notes in Control and Information Sciences, vol 81. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0007100

Download citation

  • DOI: https://doi.org/10.1007/BFb0007100

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-16659-7

  • Online ISBN: 978-3-540-39841-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation