Topology and Continuity
- 605 Downloads
The structure of Markov chains is essentially probabilistic, as we have described it so far. In examining the stability properties of Markov chains, the context we shall most frequently use is also a probabilistic one: in Part II, stability properties such as recurrence or regularity will be defined as certain return to sets of positive ψ-measure, or as finite mean return times to petite sets, and so forth.
KeywordsRandom Walk Lower Semicontinuous Reachable State Nonempty Interior Simple Linear Model
Unable to display preview. Download preview PDF.