Skip to main content

On Differential Games with Long-Time-Average Cost

  • Chapter
  • First Online:

Part of the book series: Annals of the International Society of Dynamic Games ((AISDG,volume 10))

Abstract

The paper deals with the ergodicity of deterministic zero-sum differential games with long-time-average cost. Some new sufficient conditions are given, as well as a class of games that are not ergodic. In particular, we settle the issue of ergodicity for the simple games whose associated Isaacs equation is a convex-concave eikonal equation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. O. Alvarez and M. Bardi, Viscosity solutions methods for singular perturbations in deterministic and stochastic control, SIAM J. Control Optim. 40 (2001), 1159–1188.

    Article  MATH  MathSciNet  Google Scholar 

  2. O. Alvarez and M. Bardi, Singular perturbations of degenerate parabolic PDEs: a general convergence result, Arch. Rational Mech. Anal. 170 (2003), 17–61.

    Article  MATH  MathSciNet  Google Scholar 

  3. O. Alvarez and M. Bardi, Ergodic problems in differential games, in “Advances in Dynamic Game Theory”, S. Jorgensen, M. Quincampoix, and T.L. Vincent, eds., pp. 131–152, Ann. Internat. Soc. Dynam. Games, vol. 9, Birkhäuser, Boston, 2007.

    Chapter  Google Scholar 

  4. O. Alvarez and M. Bardi, Ergodicity, stabilization, and singular perturbations of Bellman-Isaacs equations, Memoirs American Math. Soc., to appear.

    Google Scholar 

  5. O. Alvarez, M. Bardi, and C. Marchi, Multiscale problems and homogenization for second-order Hamilton-Jacobi equations, J. Differential Equations 243 (2007), 349–387.

    Article  MATH  MathSciNet  Google Scholar 

  6. M. Arisawa, Ergodic problem for the Hamilton-Jacobi-Bellman equation II, Ann. Inst. H. Poincaré Anal. Non Linéaire 15 (1998), 1–24.

    Article  MATH  MathSciNet  Google Scholar 

  7. M. Arisawa and P.-L. Lions, On ergodic stochastic control, Comm. Partial Diff. Eq. 23 (1998), 2187–2217.

    MathSciNet  Google Scholar 

  8. Z. Artstein and V. Gaitsgory, The value function of singularly perturbed control systems, Appl. Math. Optim. 41 (2000), 425–445.

    Article  MATH  MathSciNet  Google Scholar 

  9. M. Bardi and I. Capuzzo-Dolcetta, Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations, Birkhäuser, Boston, 1997.

    MATH  Google Scholar 

  10. M. Bardi and A. Cesaroni, Almost sure properties of controlled diffusions and worst case properties of deterministic systems, ESAIM Control Optim. Calc. Var. 14 (2008), 343–355.

    Article  MATH  MathSciNet  Google Scholar 

  11. M. Bardi and P. Goatin, Invariant sets for controlled degenerate diffusions: a viscosity solutions approach, in “Stochastic Analysis, Control, Optimization and Applications: A Volume in Honor of W.H. Fleming”, W.M. McEneaney, G.G. Yin, and Q. Zhang, eds., pp. 191–208, Birkhäuser, Boston, 1999.

    Google Scholar 

  12. M. Bardi and P. Soravia, Hamilton-Jacobi equations with singular boundary conditions on a free boundary and applications to differential games. Trans. Amer. Math. Soc. 325 (1991), 205–229.

    Article  MATH  MathSciNet  Google Scholar 

  13. T. Başar and P. Bernhard, H -optimal control and related minimax design problems. A dynamic game approach, 2nd edition, Birkhäuser, Boston, 1995.

    Google Scholar 

  14. A. Bensoussan, Perturbation methods in optimal control, Wiley/Gauthiers-Villars, Chichester, 1988.

    MATH  Google Scholar 

  15. P. Cardaliaguet, A differential game with two players and one target, SIAM J. Control Optim. 34 (1996), 1441–1460.

    Article  MATH  MathSciNet  Google Scholar 

  16. D.A. Carlson and A.B. Haurie, A turnpike theory for infinite horizon openloop differential games with decoupled controls, in “New Trends in Dynamic Games and Applications”, G.J. Olsder, ed., pp.353–376, Ann. Internat. Soc. Dynam. Games, vol. 3, Birkhäuser Boston, 1995.

    Google Scholar 

  17. D.A. Carlson, A.B. Haurie, and A. Leizarowitz, Infinite horizon optimal control: Deterministic and stochastic systems, Springer-Verlag, Berlin, 1991.

    MATH  Google Scholar 

  18. R.J. Elliott and N.J. Kalton, The existence of value in differential games, Memoirs American Math. Soc., vol. 126. American Mathematical Society, Providence, RI, 1972.

    Google Scholar 

  19. L. Evans, Periodic homogenisation of certain fully nonlinear partial differential equations, Proc. Roy. Soc. Edinburgh Sect. A 120 (1992), 245–265.

    MATH  MathSciNet  Google Scholar 

  20. L. Evans and P.E. Souganidis, Differential games and representation formulas for solutions of Hamilton-Jacobi-Isaacs equations, Indiana Univ. Math. J. 33 (1984), 773–797.

    Article  MathSciNet  Google Scholar 

  21. W.H. Fleming and W.M. McEneaney, Risk-sensitive control on an infinite time horizon, SIAM J. Control Optim. 33 (1995), 1881–1915.

    Article  MATH  MathSciNet  Google Scholar 

  22. R.A. Freeman and P.V. Kokotovic, Robust nonlinear control design. Statespace and Lyapunov techniques, Birkäuser, Boston, 1996.

    Google Scholar 

  23. V. Gaitsgory, Limit Hamilton-Jacobi-Isaacs equations for singularly perturbed zero-sum differential games, J. Math. Anal. Appl. 202 (1996), 862–899.

    Article  MATH  MathSciNet  Google Scholar 

  24. M.K. Ghosh and K.S.M. Rao, Differential Games with Ergodic Payoff SIAM J. Control Optim. 43 (2005), 2020–2035.

    Article  MATH  MathSciNet  Google Scholar 

  25. L. Grüne, On the relation between discounted and average optimal value functions, J. Diff. Eq. 148 (1998), 65–99.

    Article  Google Scholar 

  26. Y. Kabanov and S. Pergamenshchikov, Two-scale stochastic systems. Asymptotic analysis and control, Springer-Verlag, Berlin, 2003.

    MATH  Google Scholar 

  27. P.V. Kokotović, H.K. Khalil, and J. O'Reilly, Singular perturbation methods in control: analysis and design, Academic Press, London, 1986.

    MATH  Google Scholar 

  28. H.J. Kushner, Weak convergence methods and singularly perturbed stochastic control and filtering problems, Birkhäuser, Boston, 1990.

    MATH  Google Scholar 

  29. H.J. Kushner, Numerical approximations for stochastic differential games: the ergodic case, SIAM J. Control Optim. 42 (2004), 1911–1933.

    Article  MATH  MathSciNet  Google Scholar 

  30. P.-L. Lions, Neumann type boundary conditions for Hamilton-Jacobi equations, Duke Math. J. 52 (1985), 793–820.

    Article  MATH  MathSciNet  Google Scholar 

  31. P.-L. Lions, G. Papanicolaou, and S.R.S. Varadhan, Homogenization of Hamilton-Jacobi equations, Unpublished, 1986.

    Google Scholar 

  32. M. Quincampoix and F. Watbled, Averaging method for discontinuous Mayer's problem of singularly perturbed control systems, Nonlinear Anal. 54 (2003), 819–837.

    Article  MATH  MathSciNet  Google Scholar 

  33. P. Soravia, Pursuit-evasion problems and viscosity solutions of Isaacs equations, SIAM J. Control Optim. 31 (1993), 604–623.

    Article  MATH  MathSciNet  Google Scholar 

  34. P. Soravia, Stability of dynamical systems with competitive controls: the degenerate case, J. Math. Anal. Appl. 191 (1995), 428–449.

    Article  MATH  MathSciNet  Google Scholar 

  35. S. Sorin, New approaches and recent advances in two-person zero-sum repeated games, in “Advances in Dynamic Games”, A.S. Nowak and K. Szajowski, eds., pp. 67–93, Ann. Internat. Soc. Dynam. Games, vol. 7, Birkhäuser, Boston, 2005.

    Chapter  Google Scholar 

  36. N.N. Subbotina, Asymptotics for singularly perturbed differential games, in “Game Theory and Applications”, vol. VII, pp. 175–196, Nova Science Publishers, Huntington, NY, 2001.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Martino Bardi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Birkhäuser Boston

About this chapter

Cite this chapter

Bardi, M. (2009). On Differential Games with Long-Time-Average Cost. In: Pourtallier, O., Gaitsgory, V., Bernhard, P. (eds) Advances in Dynamic Games and Their Applications. Annals of the International Society of Dynamic Games, vol 10. Birkhäuser Boston. https://doi.org/10.1007/978-0-8176-4834-3_1

Download citation

Publish with us

Policies and ethics