Skip to main content

On Linear-Quadratic Gaussian Dynamic Games

  • Chapter
  • First Online:
Advances in Dynamic and Mean Field Games (ISDG 2016)

Part of the book series: Annals of the International Society of Dynamic Games ((AISDG,volume 15))

Included in the following conference series:

  • 821 Accesses

Abstract

Stochastic dynamic games with partial information are considered. Because the LQG hypothesis is common in control theory for its analytic convenience, we exclusively focus on linear-quadratic Gaussian dynamic games (LQGDGs) – we confine our attention to “zero-sum” LQGDGs where the players have partial information. However, LQGDGs with a nonclassical information pattern can be problematic, as Witsenhausen’s counterexample illustrates. The state of affairs concerning dynamic games and dynamic team problems with partial information is not satisfactory, and the solution of “zero-sum” LQGDGs where the players have partial information has been the Holy Grail/long-standing goal of the controls and games communities. Delayed commitment strategies as opposed to prior commitment strategies are required. The goal is to obtain a Nash equilibrium in delayed commitment strategies such that the optimal solution is time consistent/subgame perfect. In this article the current literature is discussed, and informational aspects are emphasized. Information patterns which render the game amenable to solution by the method of dynamic programming are of interest, so that the correct solution of LQGDGs with partial information can be obtained in closed-form.

The views expressed in this article are those of the author and do not reflect the official policy or position of the United States Air Force, Department of Defense, or the US Government.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. W. W. Willman: “Formal Solutions for a Class of Pursuit-Evasion Games”, IEEE Trans. on AC, Vol. 14 (1969), pp. 504–509.

    Article  MathSciNet  Google Scholar 

  2. Hans S. Witsenhausen: “A Counterexample in Stochastic Optimum Control”, SIAM Journal of Control, Vol. 6, 1968, pp. 131–147.

    Article  Google Scholar 

  3. Pachter, M. and K. Pham: “Informational Issues in Decentralized Control”, in Dynamics of Information Systems: Computational and Mathematical Challenges, C. Vogiatzis, J. Walteros and P. Pardalos, Eds., Springer 2014.

    MATH  Google Scholar 

  4. Hans S. Witsenhausen: “Separation of Estimation and Control for Discrete Time Systems”, Proceedings of the IEEE, Vol. 59, No. 11, November 1971, pp. 1557–1566.

    Article  Google Scholar 

  5. Y. C. Ho, A. E. Bryson, S. Baron: “Differential Games and Optimal Pursuit-Evasion Strategies”, IEEE Trans. on AC, Vol. 10, No. 4, October 1965, pp. 385–389.

    Article  MathSciNet  Google Scholar 

  6. Basar, T., P. Bernhard: “H - Optimal Control and Related Minimax Design Problems: a dynamic game approach”, Birkhhauser, Boston, 2008.

    Google Scholar 

  7. Engwerda, J.: “LQ Dynamic Optimization and Differential Games”, Wiley, 2005.

    Google Scholar 

  8. Pachter, M. and K. Pham: “Discrete-Time Linear-Quadratic Dynamic Games”, Journal of Optimization Theory and Applications, Vol. 146 No 1, July 2010, pp 151–179.

    Article  MathSciNet  MATH  Google Scholar 

  9. M. Pachter: “Static Linear-Quadratic Gaussian Games”, in Advances in DynamicGames, V. Krivan and G. Zaccour, Eds., pp. 85–105, Birkhauser 2013.

    Google Scholar 

  10. Radner, R.: “Static Teams and Stochastic Games”, The Annals of Mathematical Statistics, Vol. 33, No. 3, Sept. 1962, pp. 857–867.

    Article  Google Scholar 

  11. Ben-Zion Kurtaran and Raphael Sivan: “Linear-Quadratic-Gaussian Control with One-Step-Delay Sharing Pattern”, IEEE Trans. on AC, October 1974, pp. 571–574.

    MATH  Google Scholar 

  12. M. Pachter: “Static Linear-Quadratic Gaussian Games” in Advances in Dynamic Games, V. Krivan and G. Zaccour Eds., pp. 85–105, Birkhauser 2013.

    Google Scholar 

  13. Ben-Zion Kurtaran: “A Concise Derivation of the LQG One-Step-Delay Sharing Problem Solution”, IEEE Trans. on AC, December 1975, pp.108–110.

    MATH  Google Scholar 

  14. M. Pachter: “LQG Dynamic Games With a Control-Sharing Information Pattern”, Dynamic Games And Applications, Vol. 7, No 2, pp. 289–322, DOI 10.1007/s13235-016-0182-6, 2017.

    Article  MathSciNet  MATH  Google Scholar 

  15. Pachter, M. and K. Pham: “Discrete-Time Linear-Quadratic Dynamic Games”, Journal of Optimization Theory and Applications, Vol. 146 No 1, July 2010, pp 151–179.

    Article  MathSciNet  MATH  Google Scholar 

  16. A. W. Merz: “Noisy Satellite Pursuit-Evasion Guidance”, AIAA J. Guidance, Control and Dynamics, Vol. 12, No. 6, pp.901–905, 1989.

    Article  MathSciNet  Google Scholar 

  17. M. Pachter: “Kalman Filtering When the Large Bandwidth Control is Not Known”, IEEE Trans. on AES, Vol. 48, No. 1, pp.542–551, January 2012.

    Google Scholar 

  18. I. Barkana, Marcelo C. M. Teixeira, L. Hsu: “Mitigation of Symmetry Condition in Positive Realness for Adaptive Control”, Automatica, Vol. 42, Issue 9, pp.1611–1616, September 2006.

    Google Scholar 

  19. M. L. Littman: “Markov Games as a Framework for Multi-Agent Reinforcement Learning”, Proceedings of the Eleventh International Conference on Machine Learning, pp. 157–163, San Francisco, CA, 1994.

    Google Scholar 

  20. M. L. Littman: “Value Function Reinforcement Learning in Markov Games” Journal of Cognitive Systems Research 2 (2001), pp. 55–66.

    Article  Google Scholar 

  21. S. M. LaValle: Planning Algorithms, Cambridge University Press, 2006.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Meir Pachter .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Pachter, M. (2017). On Linear-Quadratic Gaussian Dynamic Games. In: Apaloo, J., Viscolani, B. (eds) Advances in Dynamic and Mean Field Games. ISDG 2016. Annals of the International Society of Dynamic Games, vol 15. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-70619-1_14

Download citation

Publish with us

Policies and ethics