Skip to main content

Stochastic Games in Economics and Related Fields: An Overview

  • Conference paper
Stochastic Games and Applications

Part of the book series: NATO Science Series ((ASIC,volume 570))

Abstract

This survey provides an extensive account of research in economics based on the stochastic games paradigm. Its area-by-area coverage is in the form of an overview, and includes applications in resource economics, industrial organization, macroeconomics, market games, and experimental and empirical economics. As to methodologically defined frameworks, the coverage is somewhat more detailed (to the extent that the material is not covered elsewhere in this volume), and includes the open-loop concept, the linear-quadratic model, myopic equilibrium, games of perfect information, and stochastic games with a continuum of players. It is hoped that the survey might be useful as a general guide both to economists and to game theorists.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amir, R. (2003) Stochastic games in economics: The lattice-theoretic approach, in A. Neyman and S. Sorin (eds.)Stochastic Games and Applications NATO Science Series C, Mathematical and Physical Sciences, Vol. 570, Kluwer Academic Publishers, Dordrecht, Chapter 29, pp. 443–453.

    Google Scholar 

  2. Amir, R. and Lambson, V. (2002) Entry, exit and imperfect competition in the long run, Journalof Economic Theoryto appear.

    Google Scholar 

  3. Amir, R. and Wooders, J. (2001) One-way spillovers, endogenous innovator/imitator roles and research joint venturesGames and Economic Behavior31, 1–25.

    Article  MathSciNet  Google Scholar 

  4. Athey, S. and Schmutzler, A. (2001) Investment and market dominanceRAND Journal of Economics 32,1–26.

    Article  Google Scholar 

  5. Barro, R. and Gordon, D. (1983) A positive theory of monetary policy in a natural rate modelJournal of Political Economy91, 589–610.

    Article  Google Scholar 

  6. Basar, T. and Bernhardt, P. (1995)H¡ã¡ãOptimal Control and RelatedMinimax Design Problems:ADynamicGame Approach, 2nd ed., Birkhauser, Boston, MA.

    Book  Google Scholar 

  7. Basar, T. and Olsder, G. (1999)DynamicNoncooperativeGame Theory, SIAM Classics, Philadelphia.

    MATH  Google Scholar 

  8. Beggs, A. and Klemperer, P. (1992) Multi-period competition with switching costsEconometrica60, 651–666.

    Article  MATH  Google Scholar 

  9. Bergin, J. and Bernhardt, D. (1992), Anonymous sequential games with aggregate uncertaintyJournal of Mathematical Economics21, 543–562.

    Article  MathSciNet  MATH  Google Scholar 

  10. Bergin, J. and Bernhardt, D. (1995) Anonymous sequential games: Existence and characterizationEconomic Theory5, 461–489.

    Article  MathSciNet  MATH  Google Scholar 

  11. Bertsekas, D. (1976)Dynamic Programming and StochasticControl, Academic Press, New York.

    MATH  Google Scholar 

  12. Blonski, M. (1999) When is rational behavior consistent with rules of thumb? A link between evolutionary terminology and neoclassical methodologyJournal ofMathematical Economics32, 131–144.

    MathSciNet  MATH  Google Scholar 

  13. Brander, J. and Spencer, B. (1983) Strategic commitment with R&D: The symmetric caseBell Journal of Economics14, 225–235.

    Article  Google Scholar 

  14. Cabral, L. and Riordan, M. (1994) The learning curve, market dominance, and predatory pricingEconometrica56, 1115–1140.

    Article  Google Scholar 

  15. Cave, J. (1987) Long-term competition in a dynamic game: The Cold Fish War, RandJournal of Economics18, 596–610.

    MathSciNet  Google Scholar 

  16. Chen, Y. and Rosenthal, R. (1996) Dynamic duopoly with slowly changing consumer loyalties, InternationalJournal of Industrial Organization14, 269–296.

    Article  Google Scholar 

  17. Cohen, D. and Michel, P. (1988) How should control theory be used to calculate a time-consistent government policy?Review of Economic Studies55, 263–274.

    Article  MATH  Google Scholar 

  18. Crombs, D., Sevy, D. and Ponssard, J. (1987) Selection in dynamic entry gamesGames and Economic Behavior21, 62–84.

    Google Scholar 

  19. Cyert, R. and DeGroot, M. (1970) Multiperiod decision models with alternating choice as the solution to the duopoly problem, QuarterlyJournal of Economics84, 419–429.

    Google Scholar 

  20. Dana, R.-A. and Montrucchio, L. (1993) Stationary Markovian strategies in dynamic games, in R. Becker et al. (eds.)General Equilibrium Growthand Trade. Vol 2. The Legacy of Lionel McKenzieAcademic Press, San Diego, CA, pp. 331–351.

    Google Scholar 

  21. Dasgupta, P. and Heal, G. (1979)Economic Theory and Exhaustible ResourcesCambridge University Press, Cambridge.

    MATH  Google Scholar 

  22. Dockner, E., Jorgensen, S., Van Long, N. and Sorger, G. (2000)Differential Games in Economics and Management ScienceCambridge University Press, Cambridge.

    Book  MATH  Google Scholar 

  23. Doganoglu, T. (2001) Dynamic price competition with persistent consumer taste, University of Kiel, Germany.

    Google Scholar 

  24. Dutta, P. and Sundaram, R. (1991) How different can strategic models be?Journal of Economic Theory60, 42–61.

    Article  MathSciNet  Google Scholar 

  25. Dutta, P. and Sundaram, R. (1992) Markovian equilibrium in a class of stochastic games: Existence theorems for discounted and undiscounted modelsEconomic Theory2, 197–214.

    Article  MathSciNet  MATH  Google Scholar 

  26. Dutta, P. and Sundaram, R. (1993) The tragedy of the commons?Economic Theory3, 413–26.

    Article  MathSciNet  MATH  Google Scholar 

  27. Ericson, R. and Pakes, A. (1995) Markov-perfect industry dynamics: A framework for empirical workReview of Economic Studies62, 53–82.

    Article  MATH  Google Scholar 

  28. Farrell, J. and Shapiro, C. (1988) Dynamic competition with switching costsRAND Journal of Economics19, 123–137.

    Article  MathSciNet  Google Scholar 

  29. Fershtman, C. and Kamien, M. (1987) Dynamic duopolistic competition with sticky pricesEconometrica55, 1151–1164.

    Article  MathSciNet  MATH  Google Scholar 

  30. Fisher, R. and Mirman, L. (1994) Strategic dynamic interactionJournal of Economic Dynamics and Control16, 267–287.

    Article  Google Scholar 

  31. Fisher, R. and Mirman, L. (1996) The complete fish wars: Biological and dynamic interactionsJournal of Environmental Economics andManagement 30, 34–42.

    Article  Google Scholar 

  32. Flaherty, M. T. (1980) Dynamic limit pricing, barriers to entry, and rational firmsJournal of Economic Theory23, 160–182.

    Article  MathSciNet  MATH  Google Scholar 

  33. Flaherty, M. T. (1980) Industry structure and cost-reducing investmentEconometrica48, 1187–1209.

    Article  MathSciNet  MATH  Google Scholar 

  34. Fudenberg, D. and Tirole, J. (1983) Learning by doing and market performanceBell Journal of Economics14, 522–530.

    Article  Google Scholar 

  35. Fudenberg, D. and Tirole, J. (1986)Dynamic Models of OligopolyHarwood Academic Publishers, Chur, Switzerland.

    Google Scholar 

  36. Fudenberg, D. and Tirole, J. (1991)Game TheoryMIT Press. Cambridge, MA.

    Google Scholar 

  37. Harris, C. (1986) Existence and characterization of perfect equilibrium in games of perfect informationEconometrica53, 613–628.

    Article  Google Scholar 

  38. Harris, C. and Vickers, J. (1985) Perfect equilibrium in a model of a raceReview of Economic Studies52, 193–209.

    Article  MathSciNet  MATH  Google Scholar 

  39. Harris, C. and Vickers, J. (1987) Racing with uncertaintyReview of Economic Studies54, 1–21.

    Article  MathSciNet  MATH  Google Scholar 

  40. Hellwig, M. and Leininger, W. (1987) On the existence of subgame-perfect equilibrium in infinite-action games of perfect informationJournal of Economic Theory43, 55–75.

    Article  MathSciNet  MATH  Google Scholar 

  41. Herr, A., Gardner, R. and Walker, J. (1997) An experimental study of time-independent and time-dependent externalities in the commonsGamesand Economic Behavior19, 77–96.

    Article  MathSciNet  MATH  Google Scholar 

  42. Heyman, D. and Sobel, M. (1984)Stochastic Models in Operations Research Volume II: Stochastic OptimizationMcGraw Hill, New York.

    MATH  Google Scholar 

  43. Hopenhayn, H. (1992) Entry, exit, and firm dynamics in long-run equilibriumEconometrica60, 1127–50.

    Article  MathSciNet  MATH  Google Scholar 

  44. Jensen, H. and Lockwood, B. (1998) A note on discontinuous value functions and strategies in affine-quadratic differential gamesEconomics Letters61, 301–306.

    Article  MathSciNet  MATH  Google Scholar 

  45. Jovanovic, B. (1982) Selection and the evolution of industryEconometrica50, 649–670.

    Article  MathSciNet  MATH  Google Scholar 

  46. Karatzas, I., Shubik, M. and Sudderth, W. (1994) Construction of stationary Markov equilibria in a strategic market game, Mathematicsof Operations Research4,975–1006.

    MathSciNet  Google Scholar 

  47. Karatzas, I., Shubik, M. and Sudderth, W. (1997) A strategic market game with secured lendingJournalof Mathematical Economics28, 207–247.

    MathSciNet  MATH  Google Scholar 

  48. Keser, C. (1993) Some results of experimental duopoly markets with demand inertiaJournal of Industrial Economics41, 133–151.

    Article  Google Scholar 

  49. Keser, C. and Gardner, R. (1999) Strategic behavior of experienced subjects in a common pool resource gameInternational Journal ofGame Theory28, 241–252.

    MATH  Google Scholar 

  50. Kirman, A. and Sobel, M. (1974) Dynamic oligopoly with inventoriesEconometrica42, 279–287.

    Article  MathSciNet  MATH  Google Scholar 

  51. Kydland, F. and Prescott, E. (1977) Rules rather than discretion: The inconsistency of optimal plans, Journalof Political Economy85, 473–491.

    Article  Google Scholar 

  52. Lambson, V. E. (1992) Competitive profits in the long runReview of Economic Studies59, 125–142.

    Article  MATH  Google Scholar 

  53. Lee, T. and Wilde, L. (1980) Market structure and innovation: A reformulationQuarterlyJournal of Economics94, 429–436.

    Google Scholar 

  54. Levhari, D. and Mirman, L. (1980) The Great Fish War: An example using a dynamic Cournot-Nash solutionBell Journal of Economics11, 322–334.

    Article  MathSciNet  Google Scholar 

  55. Lewis, T. and Schmalensee, R. (1980) On oligopolistic markets for nonrenewable natural resourcesQuarterly Journal of Economics95, 475–491.

    Article  MATH  Google Scholar 

  56. Lindsey, R. (1989) Import disruptions, exhaustible resources and intertemporal security of supply, CanadianJournal of Economics22, 340–363.

    Google Scholar 

  57. Loury, G. (1979) Market structure and innovation,Quarterly Journal of Economics 93,395–410.

    MATH  Google Scholar 

  58. Monahan, G. and Sobel, M. (1994) Stochastic dynamic market share attraction gamesGamesand Economic Behavior 6,130–149.

    Article  MathSciNet  MATH  Google Scholar 

  59. Padilla, J. (1995), Revisiting dynamic duopoly with switching costsJournal of Economic Theory 67,520–530.

    Article  MATH  Google Scholar 

  60. Pakes, A. and Ericson, R. (1998) Empirical implications of alternative models of firm dynamicsJournal of Economic Theory 79,1–45.

    Article  MATH  Google Scholar 

  61. Pindyck, R. (1977) Optimal economic stabilization policies under decentralized control and conflicting objectivesIEEE Transactions on Automatic Control 22,517–530.

    Article  MathSciNet  MATH  Google Scholar 

  62. Reinganum, J. (1981) Dynamic games of innovationJournal of Economic Theory 25,21–41.

    Article  MathSciNet  MATH  Google Scholar 

  63. Reinganum, J. (1982) A dynamic game of R&D: Patent protection and competitive behaviorEconometrica 50,671–688.

    Article  MathSciNet  MATH  Google Scholar 

  64. Reinganum, J. and Stokey, N. (1985) Oligopoly extraction of a common-property natural resource: The inportance of the period of commitment in dynamic games, InternationalEconomic Review 26,161–173.

    MathSciNet  MATH  Google Scholar 

  65. Reynolds, S. (1987) Capacity investment, preemption and commitment in an infinite-horizon modelInternational Economic Review 28,69–88.

    Article  MathSciNet  MATH  Google Scholar 

  66. Reynolds, S. (1991), Oligopoly with capacity adjustment costsJournal of Economic Dynamicsand Control 15,491–514.

    MATH  Google Scholar 

  67. Rosenthal, R.W. (1982) A dynamic model of duopoly with consumer loyaltiesJournal of Economic Theory 27,69–76.

    Article  MATH  Google Scholar 

  68. Rosenthal, R.W. (1986) Dynamic duopoly with incomplete consumer loyaltiesInternational Economic Review 27,399–406.

    Article  MathSciNet  MATH  Google Scholar 

  69. Salant, S. (1976) Exhaustible resources and industrial structure: A Cournot-Nash approach to the world oil marketJournal of Political Economy 84,1079–1093.

    Article  Google Scholar 

  70. Schwalbe, U. and Walker, P. (2001) Zermelo and the early history of game theoryGames and Economic Behavior 34,123–137.

    Article  MathSciNet  MATH  Google Scholar 

  71. Shubik, M. and Whitt, W. (1973) Fiat money in an economy with one nondurable good and no credit, in A. Blaquiere (ed.)Topics in Differential GamesNorth-Holland, Amsterdam, pp. 401–448.

    Google Scholar 

  72. Slade, M. (1995) Empirical games: The oligopoly case, CanadianJournal of Economics 28,368–402.

    Google Scholar 

  73. Slade, M. (1998) Optimal pricing with costly adjustment: Evidence from retail grocery prices, Reviewof Economic Studies 65,87–107.

    Article  MATH  Google Scholar 

  74. Sobel, M. (1982) Stochastic fishery game with myopic equilibria, in L. Mirman and D. Spulber (eds.)Essays in the Economics of Renewable ResourcesNorth-Holland, Amsterdam, pp. 259–268.

    Google Scholar 

  75. Spence, M. (1979) Investment strategy and growth in a new marketBell Journal of Economics 10,1–19.

    Article  Google Scholar 

  76. Spence, M. (1981) The learning curve and competitionBell Journal of Economics 12,49–70.

    Article  Google Scholar 

  77. Spence, M. (1984) Cost reduction, competition, and industry performanceEconometrica 52,101–121.

    Article  Google Scholar 

  78. Stokey, N. and Lucas, R. with E. Prescott (1989)Recursive Methods in Economics DynamicsHarvard University Press, Cambridge, MA.

    Google Scholar 

  79. Walker, M. and Wooders, J. (2000) Equilibrium play in matches: Binary Markov games, mimeo, University of Arizona.

    Google Scholar 

  80. Walker, M. and Wooders, J. (2001) Minmax play at WimbledonAmerican Economic Reviewto appear.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Science+Business Media New York

About this paper

Cite this paper

Amir, R. (2003). Stochastic Games in Economics and Related Fields: An Overview. In: Neyman, A., Sorin, S. (eds) Stochastic Games and Applications. NATO Science Series, vol 570. Springer, Dordrecht. https://doi.org/10.1007/978-94-010-0189-2_30

Download citation

  • DOI: https://doi.org/10.1007/978-94-010-0189-2_30

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-1493-2

  • Online ISBN: 978-94-010-0189-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics