Abstract
This chapter is devoted to jump Markov processes and finite semi-Markov processes. In both cases, the index is considered as the calender time, continuously counted over the positive real line. Markov processes are continuous-time processes that share the Markov property with the discrete-time Markov chains. Their future evolution conditional to the past depends only on the last occupied state. Their extension to the so-called semi-Markov processes naturally arises in many types of applications. The future evolution of a semi-Markov process given the past depends on the occupied state too, but also on the time elapsed since the last transition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Girardin, V., Limnios, N. (2018). Markov and Semi-Markov Processes. In: Applied Probability. Springer, Cham. https://doi.org/10.1007/978-3-319-97412-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-97412-5_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97411-8
Online ISBN: 978-3-319-97412-5
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)