Markov Decision Processes: The Noncompetitive Case

  • Jerzy Filar
  • Koos Vrieze


This chapter is devoted to the presentation of the basic theory of finite state/finite action Markov decision processes. Of course, in the context of this book, the entire subject of Markov decision processes forms only a special case of the competitive Markov decision processes, that is, Stochastic Games. Namely, this is the case where there is only one controller, and hence the underlying mathematical problem is “merely” an optimization problem.


Lution Summing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag New York, Inc. 1997

Authors and Affiliations

  • Jerzy Filar
    • 1
  • Koos Vrieze
    • 2
  1. 1.School of MathematicsUniversity of South AustraliaAdelaideAustralia
  2. 2.Department of MathematicsUniversity of LimburgMaastrichtThe Netherlands

Personalised recommendations