Abstract
Stochastic dynamic games with partial information are considered. Because the LQG hypothesis is common in control theory for its analytic convenience, we exclusively focus on linear-quadratic Gaussian dynamic games (LQGDGs) – we confine our attention to “zero-sum” LQGDGs where the players have partial information. However, LQGDGs with a nonclassical information pattern can be problematic, as Witsenhausen’s counterexample illustrates. The state of affairs concerning dynamic games and dynamic team problems with partial information is not satisfactory, and the solution of “zero-sum” LQGDGs where the players have partial information has been the Holy Grail/long-standing goal of the controls and games communities. Delayed commitment strategies as opposed to prior commitment strategies are required. The goal is to obtain a Nash equilibrium in delayed commitment strategies such that the optimal solution is time consistent/subgame perfect. In this article the current literature is discussed, and informational aspects are emphasized. Information patterns which render the game amenable to solution by the method of dynamic programming are of interest, so that the correct solution of LQGDGs with partial information can be obtained in closed-form.
The views expressed in this article are those of the author and do not reflect the official policy or position of the United States Air Force, Department of Defense, or the US Government.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
W. W. Willman: “Formal Solutions for a Class of Pursuit-Evasion Games”, IEEE Trans. on AC, Vol. 14 (1969), pp. 504–509.
Hans S. Witsenhausen: “A Counterexample in Stochastic Optimum Control”, SIAM Journal of Control, Vol. 6, 1968, pp. 131–147.
Pachter, M. and K. Pham: “Informational Issues in Decentralized Control”, in Dynamics of Information Systems: Computational and Mathematical Challenges, C. Vogiatzis, J. Walteros and P. Pardalos, Eds., Springer 2014.
Hans S. Witsenhausen: “Separation of Estimation and Control for Discrete Time Systems”, Proceedings of the IEEE, Vol. 59, No. 11, November 1971, pp. 1557–1566.
Y. C. Ho, A. E. Bryson, S. Baron: “Differential Games and Optimal Pursuit-Evasion Strategies”, IEEE Trans. on AC, Vol. 10, No. 4, October 1965, pp. 385–389.
Basar, T., P. Bernhard: “H ∞ - Optimal Control and Related Minimax Design Problems: a dynamic game approach”, Birkhhauser, Boston, 2008.
Engwerda, J.: “LQ Dynamic Optimization and Differential Games”, Wiley, 2005.
Pachter, M. and K. Pham: “Discrete-Time Linear-Quadratic Dynamic Games”, Journal of Optimization Theory and Applications, Vol. 146 No 1, July 2010, pp 151–179.
M. Pachter: “Static Linear-Quadratic Gaussian Games”, in Advances in DynamicGames, V. Krivan and G. Zaccour, Eds., pp. 85–105, Birkhauser 2013.
Radner, R.: “Static Teams and Stochastic Games”, The Annals of Mathematical Statistics, Vol. 33, No. 3, Sept. 1962, pp. 857–867.
Ben-Zion Kurtaran and Raphael Sivan: “Linear-Quadratic-Gaussian Control with One-Step-Delay Sharing Pattern”, IEEE Trans. on AC, October 1974, pp. 571–574.
M. Pachter: “Static Linear-Quadratic Gaussian Games” in Advances in Dynamic Games, V. Krivan and G. Zaccour Eds., pp. 85–105, Birkhauser 2013.
Ben-Zion Kurtaran: “A Concise Derivation of the LQG One-Step-Delay Sharing Problem Solution”, IEEE Trans. on AC, December 1975, pp.108–110.
M. Pachter: “LQG Dynamic Games With a Control-Sharing Information Pattern”, Dynamic Games And Applications, Vol. 7, No 2, pp. 289–322, DOI 10.1007/s13235-016-0182-6, 2017.
Pachter, M. and K. Pham: “Discrete-Time Linear-Quadratic Dynamic Games”, Journal of Optimization Theory and Applications, Vol. 146 No 1, July 2010, pp 151–179.
A. W. Merz: “Noisy Satellite Pursuit-Evasion Guidance”, AIAA J. Guidance, Control and Dynamics, Vol. 12, No. 6, pp.901–905, 1989.
M. Pachter: “Kalman Filtering When the Large Bandwidth Control is Not Known”, IEEE Trans. on AES, Vol. 48, No. 1, pp.542–551, January 2012.
I. Barkana, Marcelo C. M. Teixeira, L. Hsu: “Mitigation of Symmetry Condition in Positive Realness for Adaptive Control”, Automatica, Vol. 42, Issue 9, pp.1611–1616, September 2006.
M. L. Littman: “Markov Games as a Framework for Multi-Agent Reinforcement Learning”, Proceedings of the Eleventh International Conference on Machine Learning, pp. 157–163, San Francisco, CA, 1994.
M. L. Littman: “Value Function Reinforcement Learning in Markov Games” Journal of Cognitive Systems Research 2 (2001), pp. 55–66.
S. M. LaValle: Planning Algorithms, Cambridge University Press, 2006.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Pachter, M. (2017). On Linear-Quadratic Gaussian Dynamic Games. In: Apaloo, J., Viscolani, B. (eds) Advances in Dynamic and Mean Field Games. ISDG 2016. Annals of the International Society of Dynamic Games, vol 15. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-70619-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-70619-1_14
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-319-70618-4
Online ISBN: 978-3-319-70619-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)