Skip to main content
SpringerLink
Log in

Dynamic Potential Games: The Discrete-Time Stochastic Case

  • Published:
Dynamic Games and Applications Aims and scope Submit manuscript

Abstract

This paper concerns a class of nonstationary discrete-time stochastic noncooperative games. Our goals are threefold. First, we give conditions to find Nash equilibria by means of the Euler equation approach. Second, we identify subclasses of dynamic potential games. Finally, within one of this subclasses, we identify a further subclass for which Nash equilibria are also Pareto (or cooperative) solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Acemoglu D (2009) Introduction to modern economic growth. Princeton University Press, Princeton

    MATH  Google Scholar 

  2. Amir R, Nannerup N (2006) Information structure and the tragedy of the commons in resource extraction. J Bioecon 8:147–165

    Article  Google Scholar 

  3. Aumann RJ (1974) Subjectivity and correlation in randomized strategies. J Math Econ 1:67–96

    Article  MATH  MathSciNet  Google Scholar 

  4. Aumann RJ (1987) Correlated equilibrium as an expression of Bayesian rationality. Econometrica 55:1–18

    Article  MATH  MathSciNet  Google Scholar 

  5. Bauso D, Giarre L, Pesenti R (2008) Consensus in noncooperative dynamic games: a multiretailer inventory application. IEEE Trans Autom Control 53:998–1003

    Article  MathSciNet  Google Scholar 

  6. Beckmann M, McGuire CB, Winsten CB (1956) Studies in the economics of transportation. Yale University Press, New Haven

    Google Scholar 

  7. Bensoussan A, Frehse J, Yam P (2013) Mean field games and mean field type control theory. Springer, New York

    Book  MATH  Google Scholar 

  8. Brânzei R, Mallozzi L, Tijs S (2003) Supermodular games and potential games. J Math Econ 39:39–49

    Article  MATH  Google Scholar 

  9. Candogan O, Menache I, Ozdaglar A, Parrillo PA (2011) Flows and decompositions of games: harmonic and potential games. Math Oper Res 36:474–503

    Article  MATH  MathSciNet  Google Scholar 

  10. Dechert WD (1978) Optimal control problems from second order difference equations. J Econ Theory 19:50–63

    Article  MATH  MathSciNet  Google Scholar 

  11. Dechert, W.D. (1997) Noncooperative dynamic games: a control theoretic approach. University of Houston. Unpublished manuscript

  12. Dechert WD, O’Donnell SI (2006) The stochastic lake game: a numerical solution. J Econ Dyn Control 30:1569–1587

    Article  MATH  MathSciNet  Google Scholar 

  13. Dockner EJ, Jorgensen S, Long NV, Sorger G (2000) Differential games in economics and management science. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  14. Dubey P, Haimanko O, Zapechelnyuk A (2006) Strategic complements and substitutes, and potential games. Games Econ Behav 54:77–94

    Article  MATH  MathSciNet  Google Scholar 

  15. González-Sánchez D, Hernández-Lerma O (2013) An inverse optimal problem in discrete-time stochastic control. J Differ Equ Appl 19:39–53

    Article  MATH  Google Scholar 

  16. González-Sánchez D, Hernández-Lerma O (2014) On the Euler equation approach to discrete-time nonstationary optimal control problems. J Dyn Games 1:57–78

    Article  MATH  Google Scholar 

  17. Gopalakrishnan R, Marden JR, Wierman A (2013) Potential games are necessary to ensure pure Nash equilibria in cost sharing games. Submitted for publication. http://ecee.colorado.edu/marden/files/ec_cost_sharing. Accessed 13 March 2014

  18. Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes: basic optimality criteria. Springer, New York

    Book  Google Scholar 

  19. Jørgensen S, Zaccour G (2004) Differential games in marketing. Kluwer Academic Publishers, Boston

    Book  Google Scholar 

  20. Josa-Fambellida R, Rincón-Zapatero JP (2007) New approach to stochastic optimal control. J Optim Theory Appl 135:163–177

    Article  MathSciNet  Google Scholar 

  21. Judd KL (1998) Numerical methods in economics. MIT Press, Cambridge

    MATH  Google Scholar 

  22. Levhari D, Mirman LD (1980) The great fish war: an example using dynamic Cournot-Nash solution. Bell J Econ 11:322–334

    Article  MathSciNet  Google Scholar 

  23. Maldonado W, Moreira H (2003) A contractive method for computing the stationary solution of the Euler equation. Econ Bull 3:1–14

    Google Scholar 

  24. Maldonado W, Moreira H (2006) Solving Euler equations: classical methods and the \(C^1\) contraction mapping method revisited, Revista Brasileira de Economía 60, pp. 167–178. http://bibliotecadigital.fgv.br/ojs/index.php/rbe/article/view/925/514. Accessed 13 March 2014

  25. Marden JR (2012) State based potential games. Automatica 48:3075–3088

    Article  MATH  MathSciNet  Google Scholar 

  26. Marden JR, Arslan G, Shamma JS (2009) Cooperative control and potential games. IEEE Trans Syst Man Cyber Part B 39:1393–1407

    Article  Google Scholar 

  27. Martin-Herran G, Rincon-Zapatero JP (2005) Efficient Markov perfect Nash equilibrium: theory and application to dynamic fishery games. J Econ Dyn Control 29:1073–1096

    Article  MATH  MathSciNet  Google Scholar 

  28. Monderer D, Shapley LS (1996) Potential games. Games Econ Behav 14:124–143

    Article  MATH  MathSciNet  Google Scholar 

  29. Neyman A (1997) Correlated equilibrium and potential games. Int J Game Theory 26:223–227

    Article  MATH  MathSciNet  Google Scholar 

  30. Potters JAM, Raghavan TES, Tijs SH et al (2009) Pure equilibrium strategies for stochastic games via potential functions. In: Bernhard P (ed) Advances in dynamic games and application. Springer, New York

    Google Scholar 

  31. Rosenthal RW (1973) A class of games possessing pure-strategy Nash equilibria. Int J Game Theory 2:65–67

    Article  MATH  Google Scholar 

  32. Sandholm WH (2009) Large population potential games. J Econ Theory 144:1710–1725

    Article  MATH  MathSciNet  Google Scholar 

  33. Seierstad A (2009) Stochastic control in discrete and continuous time. Springer, New York

    Book  MATH  Google Scholar 

  34. Seierstad A (2013) Pareto improvements of Nash equilibria in differential games. Dyn Games Appl 67:70. doi:10.1007/s13235-013-0093-8

    Google Scholar 

  35. Slade ME (1994) What does an oligopoly maximize? J Ind Econ 42:45–61

    Article  Google Scholar 

  36. Stokey NL, Lucas RE, Prescott EC (1989) Recursive methods in economic dynamics. Harvard University Press, Cambridge, MA

    MATH  Google Scholar 

  37. Ui T (2001) Robust equilibria of potential games. Econometrica 69:1373–1380

    Article  MATH  MathSciNet  Google Scholar 

  38. Ui T (2008) Correlated equilibrium and concave games. Int J Game Theory 37:1–13

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. SEPI–ESE–IPN, Plan de Agua Prieta 66, Col. Plutarco Elías Calles, 11340 , Mexico DF, Mexico

    David González-Sánchez

  2. Mathematics Department, CINVESTAV–IPN, A. Postal 14–740, 07000 , Mexico DF, Mexico

    Onésimo Hernández-Lerma

Authors
  1. David González-Sánchez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Onésimo Hernández-Lerma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Onésimo Hernández-Lerma.

Rights and permissions

Reprints and permissions

About this article

Cite this article

González-Sánchez, D., Hernández-Lerma, O. Dynamic Potential Games: The Discrete-Time Stochastic Case. Dyn Games Appl 4, 309–328 (2014). https://doi.org/10.1007/s13235-014-0105-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13235-014-0105-3

Keywords

Mathematics Subject Classification

Search

Navigation