• Sean P. Meyn
  • Richard L. Tweedie
Part of the Communications and Control Engineering Series book series (CCE)


This chapter is devoted to the fundamental concept of irreducibility: the idea that all parts of the space can be reached by a Markov chain, no matter what the starting point. Although the initial results are relatively simple, the impact of an appropriate irreducibility structure will have wide-ranging consequences, and it is therefore of critical importance that such structures be well understood.


Random Walk Positive Probability Half Line General State Space Countable Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag London Limited 1993

Authors and Affiliations

  • Sean P. Meyn
    • 1
  • Richard L. Tweedie
    • 2
  1. 1.Coordinated Science Laboratory and the Department of Electrical and Computer EngineeringUniversity of IllinoisUrbanaUSA
  2. 2.Department of StatisticsColorado State UniversityFort CollinsUSA

Personalised recommendations