Advertisement

Markov Chains pp 119-144 | Cite as

Atomic Chains

  • Randal DoucEmail author
  • Eric Moulines
  • Pierre Priouret
  • Philippe Soulier
Chapter
Part of the Springer Series in Operations Research and Financial Engineering book series (ORFE)

Abstract

In this chapter, we enter the core of the theory of Markov chains. We will encounter for the first time the fundamental notions of state classification, dichotomy between transience and recurrence, period, existence, uniqueness (up to scale), and characterization of invariant measures, as well as the classical limit theorems: the law of large numbers and the central limit theorem. These notions will be introduced, and the results will be obtained by means of the simplifying assumption that the state space contains an accessible atom. An atom is a set of states out of which the chain exits under a distribution common to all its individual states. A singleton is thus an atom, but if the state space is not discrete, it will in most cases be useless by failing to be accessible. Let us recall that a set is accessible if the chains eventually enter this set wherever it starts from with positive probability.

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Randal Douc
    • 1
    Email author
  • Eric Moulines
    • 2
  • Pierre Priouret
    • 3
  • Philippe Soulier
    • 4
  1. 1.Département CITITelecom SudParisÉvryFrance
  2. 2.Centre de Mathématiques AppliquéesEcole PloytechniquePalaiseauFrance
  3. 3.Université Pierre et Marie CurieParisFrance
  4. 4.Université Paris NanterreNanterreFrance

Personalised recommendations