Zero-Sum Ergodic Semi-Markov Games with Weakly Continuous Transition Probabilities
- 109 Downloads
Zero-sum ergodic semi-Markov games with weakly continuous transition probabilities and lower semicontinuous, possibly unbounded, payoff functions are studied. Two payoff criteria are considered: the ratio average and the time average. The main result concerns the existence of a lower semicontinuous solution to the optimality equation and its proof is based on a fixed-point argument. Moreover, it is shown that the ratio average as well as the time average payoff stochastic games have the same value. In addition, one player possesses an ε-optimal stationary strategy (ε>0), whereas the other has an optimal stationary strategy.
KeywordsZero-sum semi-Markov games Optimality equations ε-optimal strategies
- 13.Stockey, N.L., Lucas, R.E., Prescott, E.C.: Recursive Methods in Economic Dynamics. Harvard University Press, Cambridge (1989) Google Scholar
- 22.Hernández-Lerma, O., Lasserre, J.B.: Further Topics on Discrete-Time Markov Control Process. Springer, New York (1999) Google Scholar