Markov Chains and Monte Carlo Simulation

In this chapter, we present Markov chains that are the most fundamental and long-standing graphical model for modeling dependencies among data entities. We start by introducing various definitions, terminologies, and important properties of Markov chains, followed by describing the stationary distribution and associated theorems. At the end of this chapter, we present the Markov Chain Monte Carlo simulation (MCMC) that is one of the most important applications of Markov chains for probabilistic data sampling and model estimations.


Markov Chain Morkov Chain Monte Carlo Stationary Distribution Transition Matrix Transition Graph 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media, LLC 2007

Personalised recommendations