Advertisement

Transition Probabilities

  • Sean P. Meyn
  • Richard L. Tweedie
Chapter
  • 607 Downloads
Part of the Communications and Control Engineering Series book series (CCE)

Abstract

As with all stochastic processes, there are two directions from which to approach the formal definition of a Markov chain.

Keywords

Markov Chain Random Walk Interarrival Time Half Line Strong Markov Property 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag London Limited 1993

Authors and Affiliations

  • Sean P. Meyn
    • 1
  • Richard L. Tweedie
    • 2
  1. 1.Coordinated Science Laboratory and the Department of Electrical and Computer EngineeringUniversity of IllinoisUrbanaUSA
  2. 2.Department of StatisticsColorado State UniversityFort CollinsUSA

Personalised recommendations