Skip to main content

Markov property

  • Reference work entry
  • First Online:
  • 22 Accesses

When the behavior of a stochastic process {X(t), tT} at times in the future depends only on the present state of the process (past behavior of the process affects the future behavior only through the present state of the process); that is, for any n > 0, any set of time points t 1 < t 2 <... < t n < t n+1 in the time domain T, and any states x 1, x 2,..., x n and any set A in the same space, Pr{X(t n+1) ∈ A|X(t 1) = x 1,..., X(t n) = x n} = Pr{X(t n+1) ∈ A|X(t n) = x n}. Markov chains; Markov processes.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   532.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Kluwer Academic Publishers

About this entry

Cite this entry

Gass, S.I., Harris, C.M. (2001). Markov property . In: Gass, S.I., Harris, C.M. (eds) Encyclopedia of Operations Research and Management Science. Springer, New York, NY. https://doi.org/10.1007/1-4020-0611-X_583

Download citation

  • DOI: https://doi.org/10.1007/1-4020-0611-X_583

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-7923-7827-3

  • Online ISBN: 978-1-4020-0611-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics