Skip to main content

On Uniformization for Continuous-Time Markov Chains

  • Conference paper
Operations Research ’93
  • 124 Accesses

Abstract

The method of uniformization or randomization for continuous-time Markov chains is shown to be extendable to chains with

  1. (i)

    time-inhomogeneous and

  2. (ii)

    unbounded

transition rates. Some approximate computational aspects are addressed also. A special application of uniformization of actual interest is included.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gihman, I.I. and Skorohod, A.V. (1979): “Controlled Stochastic Processes”. Springer, Berlin.

    Book  Google Scholar 

  2. Grassman, W. (1990): “Finding Transient Solutions in Markovian Event Systems through Randomization”. Proceedings of The First International Conference on the Numerical Solution of Markov Chains. Januari 8–10, Raleigh, NC. 375–385.

    Google Scholar 

  3. Gross, D. and Miller, D.R. (1984): “The Randomization Technique as a Modelling Tool and Solution Procedure for Transient Markov Processes”. Oper. Res. 32, 343–361.

    Article  Google Scholar 

  4. Jensen, A. (1953): “Markovian Chains as an Aid in the Study of Markov Processes”. Skan. Aktuarietdskr. 36, 87–91.

    Google Scholar 

  5. Melamed, B. and Yadin, M. (1984): “Randomization Procedures in the Computation of Cumulative-Time Distributions over Discrete State Markov Processes”. Oper. Res. 32, 926–943.

    Article  Google Scholar 

  6. Van Dijk, N.M. (1989): “Aproximation Uniformization for Continuous-Time Markov Chains with an Application ro Performability Analysis”. Stochastic Process Appl. 40, 339–357.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Physica-Verlag Heidelberg

About this paper

Cite this paper

van Dijk, N.M. (1994). On Uniformization for Continuous-Time Markov Chains. In: Bachem, A., Derigs, U., Jünger, M., Schrader, R. (eds) Operations Research ’93. Physica, Heidelberg. https://doi.org/10.1007/978-3-642-46955-8_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-46955-8_29

  • Publisher Name: Physica, Heidelberg

  • Print ISBN: 978-3-7908-0794-3

  • Online ISBN: 978-3-642-46955-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics