Advertisement

Topology and Continuity

  • Sean P. Meyn
  • Richard L. Tweedie
Chapter
  • 605 Downloads
Part of the Communications and Control Engineering Series book series (CCE)

Abstract

The structure of Markov chains is essentially probabilistic, as we have described it so far. In examining the stability properties of Markov chains, the context we shall most frequently use is also a probabilistic one: in Part II, stability properties such as recurrence or regularity will be defined as certain return to sets of positive ψ-measure, or as finite mean return times to petite sets, and so forth.

Keywords

Random Walk Lower Semicontinuous Reachable State Nonempty Interior Simple Linear Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag London Limited 1993

Authors and Affiliations

  • Sean P. Meyn
    • 1
  • Richard L. Tweedie
    • 2
  1. 1.Coordinated Science Laboratory and the Department of Electrical and Computer EngineeringUniversity of IllinoisUrbanaUSA
  2. 2.Department of StatisticsColorado State UniversityFort CollinsUSA

Personalised recommendations