Abstract
In this chapter we will start dealing with stochastic processes, which are the mathematical models for phenomena whose temporal evolution contains some randomness. Starting from the celebrated example of the random walk, we will introduce the central definition of Markov chains, which, although simple, provide extremely important models for physical systems. The description of Markov chains will allow us to introduce the central topic of thermalization and approach to equilibrium of random motions, that is the existence of asymptotic laws to which the Markov chains converge, in a sense that will be made rigorous. Finally, we will introduce Metropolis theorem, a cornerstone of numerical simulations, as will be discussed in the following chapter.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Rudin, W.: Real Complex Analysis. McGraw-Hill (1987)
Baldi, P. (1998). Calcolo Delle Probabilitá e Statistica. Milano: McGraw-Hill.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Vitali, E., Motta, M., Galli, D.E. (2018). Markov Chains. In: Theory and Simulation of Random Phenomena. UNITEXT for Physics. Springer, Cham. https://doi.org/10.1007/978-3-319-90515-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-90515-0_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-90514-3
Online ISBN: 978-3-319-90515-0
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)