Abstract
In Markov decision theory we distinguish
-
(a)
discrete-time Markov decision processes
-
(b)
semi-Markov decision processes
-
(c)
continuous time Markov decision processes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Constantinides, G.M., (1976). Stochastic cash management with fixed and proportional transaction costs. Management Sci. 22, 1320–1331.
Constantinides, G.M. and S.F. Richard (1978). Existence of optimal simple policies for discounted-cost inventory and cash management in continuous time. Operations Res. 26, 620–636.
Davis, M.H.A., (1984). Piecewise-deterministic Markov processes: A general class of non-diffusion stochastic models. J.R. Statist.Soc. B. 46, 353–388.
Hordijk, A. and F.A. Van der Duyn Schouten (1984). Discretization and weak convergence in Markov decision drift processes. Math. Oper.Res. 9, 112–141.
Hordijk, A. and F.A. Van der Duyn Schouten (1985). Markov decision drift processes; conditions for optimality obtained by discretization. Math. Oper. Res. 10, 160–173.
Hordijk, A. and F.A. Van der Duyn Schouten (1983). Average optimal policies in Markov decision drift processes with applications to a queueing and a replacement model. Advances in Appl.Probability 15, 274–303.
De Kok, A.G., H.C. Tijms and F.A. Van der Duyn Schouten (1984). Approximations for the single product production-inventory problem with compound Poisson demand and service-level constraints. Advances in Appl. Probability 16, 378–401.
Lam, Y. and L.C. Thomas (1983). Adaptive control of M/M/1 queues-continuous time Markov decision process approach. J. Appl. Probability 20, 368–379.
Luss, H., (1976). Maintenance policies when deterioration can be observed by inspections. Operations Res. 24, 359–366.
Rosenfield, D., (1976). Markovian deterioration with uncertain information. Operations Res. 24, 141–155.
Tijms, H.C. and F.A. Van der Duyn Schouten (1985). A Markov decision algorithm for optimal inspections and revisions in a maintenance system with partial information. European J. of Oper. Res. 21, 245–253.
Van der Duyn Schouten, F.A., (1983). Markov decision processes with continuous time parameter. Math. Centre Tract 164. Mathematical Centre, Amsterdam.
Vermes, D., (1985). Optimal control of piecewise deterministic processes. Stochastics 14, 165–208.
Yushkevich, A.A., (1983). Continuous time Markov decision processes with interventions. Stochastics 9, 235–274.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1986 Springer Science+Business Media New York
About this chapter
Cite this chapter
Van der Duyn Schouten, F.A. (1986). Markov decision drift processes. In: Janssen, J. (eds) Semi-Markov Models. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-0574-1_5
Download citation
DOI: https://doi.org/10.1007/978-1-4899-0574-1_5
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4899-0576-5
Online ISBN: 978-1-4899-0574-1
eBook Packages: Springer Book Archive