Zero-Sum Discrete-Time Markov Games with Unknown Disturbance Distribution

Discounted and Average Criteria

  • J. Adolfo Minjárez-Sosa

Table of contents

  1. Front Matter
    Pages i-xiv
  2. J. Adolfo Minjárez-Sosa
    Pages 1-8
  3. J. Adolfo Minjárez-Sosa
    Pages 9-29
  4. J. Adolfo Minjárez-Sosa
    Pages 31-46
  5. J. Adolfo Minjárez-Sosa
    Pages 69-94
  6. Back Matter
    Pages 95-120

About this book


This SpringerBrief deals with a class of discrete-time zero-sum Markov games with Borel state and action spaces, and possibly unbounded payoffs, under discounted and average criteria, whose state process evolves according to a stochastic difference equation. The corresponding disturbance process is an observable sequence of independent and identically distributed random variables with unknown distribution for both players. Unlike the standard case, the game is played over an infinite horizon evolving as follows. At each stage, once the players have observed the state of the game, and before choosing the actions, players 1 and 2 implement a statistical estimation process to obtain estimates of the unknown distribution. Then, independently, the players adapt their decisions to such estimators to select their actions and construct their strategies. This book presents a systematic analysis on recent developments in this kind of games. Specifically, the theoretical foundations on the procedures combining statistical estimation and control techniques for the construction of strategies of the players are introduced, with illustrative examples. In this sense, the book is an essential reference for theoretical and applied researchers in the fields of stochastic control and game theory, and their applications.


zero-sum Markov games Markov games difference-equation games probability measures and weak convergence stochastic kernels density estimation optimal strategies 91A15, 90C40, 62G05

Authors and affiliations

  • J. Adolfo Minjárez-Sosa
    • 1
  1. 1.Department of MathematicsUniversity of SonoraHermosilloMexico

Bibliographic information

  • DOI
  • Copyright Information The Author(s), under exclusive license to Springer Nature Switzerland AG 2020
  • Publisher Name Springer, Cham
  • eBook Packages Mathematics and Statistics
  • Print ISBN 978-3-030-35719-1
  • Online ISBN 978-3-030-35720-7
  • Series Print ISSN 2365-4333
  • Series Online ISSN 2365-4341
  • Buy this book on publisher's site
Industry Sectors
Finance, Business & Banking
IT & Software
Energy, Utilities & Environment
Oil, Gas & Geosciences