Repeated Games with Absorbing States

  • Frank Thuijsman
Conference paper
Part of the NATO Science Series book series (ASIC, volume 570)


In this paper we shall present a proof for the existence of limiting average ε-equilibria in non-zero-sum repeated games with absorbing states, i.e., stochastic games in which all states but one are absorbing. We assume that the action spaces shall be finite; hence there are only finitely many absorbing states. A limiting average ε-equilibrium is a pair of strategies (σ ε , τ ε , with ε > 0, such that for all σ and τ we have γ1(σ, τ ε ) ≤ γ1(σ ε , τ ε ) + ε and γ2(σ ε ,τ) ≤ γ2(σ ε τ ε ) + ε. The proof presented in this chapter is based on the publications by Vrieze and Thuijsman [7] and by Thuijsman [5]. Several examples will illustrate the proof.


Stationary Strategy Stochastic Game Repeated Game Average Reward Small Triangle 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aumann, R.J. (1981) Survey of repeated gamesin Essays in Game Theory and Mathematical Economics in Honor of Oskar Morgenstern, Bibliographisches Institüt, Mannheim, pp. 11–42.Google Scholar
  2. 2.
    Fink, A.M. (1964) Equilibrium in a stochastic n-person game, Journal of Science of Hiroshima University, Series A-I 28, 89–93.MathSciNetMATHGoogle Scholar
  3. 3.
    Kohlberg, E. (1974) Repeated games with absorbing states, Annals of Statistics 2, 724–738.MathSciNetMATHCrossRefGoogle Scholar
  4. 4.
    Sorin, S. (1986) Asymptotic properties of a non-zero-sum stochastic game, International Journal of Game Theory 15, 101–107.MathSciNetMATHCrossRefGoogle Scholar
  5. 5.
    Thuijsman, F. (1992) Optimality and equilibria in stochastic games, CWI-Tract 82, Center for Mathematics and Computer Science, Amsterdam.Google Scholar
  6. 6.
    Thuijsman, F. and Vrieze, O.J. (1991) Easy initial states in stochastic games, in T.E.S. Raghavan, T.S. Ferguson, T. Parthasarathy, and O.J. Vrieze (ads.), Stochastic Games and Related Topics, Kluwer Academic Publishers, Dordrecht, pp. 85–100.CrossRefGoogle Scholar
  7. 7.
    Vrieze, O.J. and Thuijsman, F. (1989) On equilibria in repeated games with absorbing states, International Journal of Game Theory 18, 293–310.MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2003

Authors and Affiliations

  • Frank Thuijsman
    • 1
  1. 1.Maastricht UniversityMaastrichtThe Netherlands

Personalised recommendations