Discrete-Time Cooperative Games Under Uncertainty

  • David W. K. Yeung
  • Leon A. Petrosyan
Part of the Static & Dynamic Game Theory: Foundations & Applications book series (SDGTFA)


In some economic processes in discrete-time, uncertainty may also arise. For instance, Smith and Zenou (Rev. Econ. Dyn. 6(1):54–79, 2003) considered a discrete-time stochastic job search model. Esteban-Bravo and Nogales (Comput. Oper. Res. 35:226–240, 2008) analyzed mathematical programming for stochastic discrete-time dynamics arising in economic systems, including examples in a stochastic national growth model and international growth model with uncertainty. The discrete-time counterpart of stochastic differential games is known as stochastic dynamic games. Basar and Ho (J. Econ. Theory 7:370–387, 1974) examined informational properties of the Nash solutions of stochastic nonzero-sum games. The elimination of the informational nonuniqueness in a Nash equilibrium through a stochastic formulation was first discussed in Basar (Int. J. Game Theory 5:65–90, 1976) and further examined in Basar (Automatica 11:547–551, 1975; In: New trends in dynamic system theory and economics, pp. 3–5, 1979; In: Dynamic policy games in economics, pp. 9–54, 1989). Basar and Mintz (In: Proceedings of the IEEE 11th conference on decision and control, pp. 188–192, 1972; Stochastics 1:25–69, 1973) and Basar (IEEE Trans. Autom. Control AC-23:233–243, 1978) developed an equilibrium solution of linear-quadratic stochastic dynamic games with noisy observation. Again, the SIAM Classics on Dynamic Noncooperative Game Theory by Basar and Olsder (Dynamic noncooperative game theory, 2nd edn. Academic Press, London, 1995) gave a comprehensive treatment of noncooperative stochastic dynamic games. Yeung and Petrosyan (J. Optim. Theory Appl. 145(3):579–596, 2010) provided the techniques in characterizing subgame consistent solutions for stochastic dynamic. Furthermore, they also presented a stochastic dynamic game in resource extraction. Analyses of noncooperative and cooperative discrete-time dynamic games with random game horizons were presented in Yeung and Petrosyan (J. Optim. Theory Appl. forthcoming, 2011). The recently emerging robust control techniques in discrete time along the lines of Hansen and Sargent (Robustness. Princeton University Press, Princeton, 2008) should prove to be fruitful in developing into stochastic dynamic interactive economic models.


Nash Equilibrium Optimality Principle Joint Payoff Stochastic Differential Game Nash Equilibrium Solution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Basar, T.: Nash strategies for M-person differential games with mixed information structures. Automatica 11, 547–551 (1975) MathSciNetMATHCrossRefGoogle Scholar
  2. Basar, T.: On the uniqueness of the Nash solution in linear-quadratic differential games. Int. J. Game Theory 5, 65–90 (1976) MathSciNetMATHCrossRefGoogle Scholar
  3. Basar, T.: Decentralized multicriteria optimization of linear stochastic systems. IEEE Trans. Autom. Control AC-23, 233–243 (1978) MathSciNetCrossRefGoogle Scholar
  4. Basar, T.: Information structures and equilibria in dynamic games. In: Aoki, M., Marzollo, A. (eds.) New Trends in Dynamic System Theory and Economics, pp. 3–5. Academic Press, New York (1979) Google Scholar
  5. Basar, T.: Time consistency and robustness of equilibria in noncooperative dynamic games. In: Van der Ploeg, F., de Zeeuw, A. (eds.) Dynamic Policy Games in Economics, pp. 9–54. North-Holland, Amsterdam (1989) Google Scholar
  6. Basar, T., Ho, Y.C.: Informational properties of the Nash solutions of two stochastic nonzero-sum games. J. Econ. Theory 7, 370–387 (1974) MathSciNetCrossRefGoogle Scholar
  7. Basar, T., Mintz, M.: On the existence of linear saddle-point strategies for a two-person zero-sum stochastic game. In: Proceedings of the IEEE 11th Conference on Decision and Control, New Orleans, LA, 1972, pp. 188–192. IEEE Computer Society Press, Los Alamitos (1972) Google Scholar
  8. Basar, T., Mintz, M.: A multistage pursuit-evasion game that admits a Gaussian random process as a maximum control policy. Stochastics 1, 25–69 (1973) MathSciNetMATHGoogle Scholar
  9. Basar, T., Olsder, G.J.: Dynamic Noncooperative Game Theory, 2nd edn. Academic Press, London (1995) MATHGoogle Scholar
  10. Esteban-Bravo, M., Nogales, F.J.: Solving dynamic stochastic economic models by mathematical programming decomposition methods. Comput. Oper. Res. 35, 226–240 (2008) MathSciNetMATHCrossRefGoogle Scholar
  11. Hansen, L.P., Sargent, T.J.: Robustness. Princeton University Press, Princeton (2008) MATHGoogle Scholar
  12. Smith, A.E., Zenou, Y.: A discrete-time stochastic model of job matching. Rev. Econ. Dyn. 6(1), 54–79 (2003) CrossRefGoogle Scholar
  13. Yeung, D.W.K., Petrosyan, L.A.: Subgame-consistent solutions for cooperative stochastic dynamic games. J. Optim. Theory Appl. 145(3), 579–596 (2010) MathSciNetMATHCrossRefGoogle Scholar
  14. Yeung, D.W.K., Petrosyan, L.A.: Subgame consistent cooperative solution of dynamic games with random horizon. J. Optim. Theory Appl. 150, 78–97 (2011) MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.SRS Consortium for Advanced Study in Cooperative Dynamic GamesHong Kong Shue Yan UniversityHong KongPeople’s Republic of China
  2. 2.Center of Game TheorySt. Petersburg State UniversitySaint PetersburgRussia
  3. 3.Faculty of Applied Mathematics and Control ProcessesSt. Petersburg State UniversitySaint PetersburgRussia

Personalised recommendations