In spite of their simplicity, Markov processes with countable state space (and discrete time) are interesting mathematical objects with which a variety of real-world phenomena can be modelled. We give an introduction to the basic concepts and then study certain examples in more detail. The connection with discrete potential theory will be investigated later, in Chapter 19. Some readers might prefer to skip the somewhat technical construction of general Markov processes in Section 17.1.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Rights and permissions
Copyright information
© 2008 Springer-Verlag London Limited
About this chapter
Cite this chapter
(2008). Markov Chains. In: Probability Theory. Universitext. Springer, London. https://doi.org/10.1007/978-1-84800-048-3_17
Download citation
DOI: https://doi.org/10.1007/978-1-84800-048-3_17
Publisher Name: Springer, London
Print ISBN: 978-1-84800-047-6
Online ISBN: 978-1-84800-048-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)