Markov Chains

Abstract

We have seen in Chapter 16 that an important random process is the IID random process. When applicable to a specific problem, it lends itself to a very simple analysis. A Bernoulli random process,which consists of independent Bernoulli trials,is the archetypical example of this. In practice, it is found,however,that there is usually some dependence between samples of a random process. In Chapters 17 and 18 we modeled this dependence using wide sense stationary random process theory,but restricted the modeling to only the first two moments.