Abstract
In this chapter, we provide a background material that is needed to define and study Markov processes in discrete and continuous time. We start by giving basic examples of transition probabilities and the corresponding operators on the spaces of functions and measures. An emphasis is put on stochastic operators on the spaces of integrable functions. The importance of transition probabilities is that the distribution of a stochastic process with Markov property is completely determined by transition probabilities and initial distributions. The Markov property simply states that the past and the future are independent given the present. We refer the reader to Appendix A for the required theory on measure, integration, and basic concepts of probability theory.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2017 The Author(s)
About this chapter
Cite this chapter
Rudnicki, R., Tyran-KamiĆska, M. (2017). Markov Processes. In: Piecewise Deterministic Processes in Biological Models. SpringerBriefs in Applied Sciences and Technology(). Springer, Cham. https://doi.org/10.1007/978-3-319-61295-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-61295-9_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-61293-5
Online ISBN: 978-3-319-61295-9
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)