Abstract
The method of uniformization or randomization for continuous-time Markov chains is shown to be extendable to chains with
-
(i)
time-inhomogeneous and
-
(ii)
unbounded
transition rates. Some approximate computational aspects are addressed also. A special application of uniformization of actual interest is included.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gihman, I.I. and Skorohod, A.V. (1979): “Controlled Stochastic Processes”. Springer, Berlin.
Grassman, W. (1990): “Finding Transient Solutions in Markovian Event Systems through Randomization”. Proceedings of The First International Conference on the Numerical Solution of Markov Chains. Januari 8–10, Raleigh, NC. 375–385.
Gross, D. and Miller, D.R. (1984): “The Randomization Technique as a Modelling Tool and Solution Procedure for Transient Markov Processes”. Oper. Res. 32, 343–361.
Jensen, A. (1953): “Markovian Chains as an Aid in the Study of Markov Processes”. Skan. Aktuarietdskr. 36, 87–91.
Melamed, B. and Yadin, M. (1984): “Randomization Procedures in the Computation of Cumulative-Time Distributions over Discrete State Markov Processes”. Oper. Res. 32, 926–943.
Van Dijk, N.M. (1989): “Aproximation Uniformization for Continuous-Time Markov Chains with an Application ro Performability Analysis”. Stochastic Process Appl. 40, 339–357.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Physica-Verlag Heidelberg
About this paper
Cite this paper
van Dijk, N.M. (1994). On Uniformization for Continuous-Time Markov Chains. In: Bachem, A., Derigs, U., Jünger, M., Schrader, R. (eds) Operations Research ’93. Physica, Heidelberg. https://doi.org/10.1007/978-3-642-46955-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-46955-8_29
Publisher Name: Physica, Heidelberg
Print ISBN: 978-3-7908-0794-3
Online ISBN: 978-3-642-46955-8
eBook Packages: Springer Book Archive