Abstract
In this chapter, we study the approximation of Witsenhausen’s counterexample and the Gaussian relay channel problem by using the results of the previous chapter. In particular, our goal is to establish that finite models obtained through the uniform quantization of the observation and action spaces result in a sequence of policies whose costs converge to the value function. We note that the operation of quantization has typically been the method to show that a non-linear policy can perform better than an optimal linear policy, both for Witsenhausen’s counterexample [10, 86] and the Gaussian relay channel problem [88, 152]. Our findings show that for a large class of problems, quantized policies not only may perform better than linear policies, but that they are actually almost optimal.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
M. Baglietto, T. Parisini, R. Zoppoli, Numerical solutions to the Witsenhausen counterexample by approximating networks. IEEE Trans. Autom. Control 46(9), 1471–1477 (2001)
R. Bansal, T. Başar, Stochastic team problems with nonclassical information revisited: When is an affine law optimal? IEEE Trans. Autom. Control 32, 554–559 (1987)
G. Gnecco, M. Sanguinetti, New insights into Witsenhausen’s counterexample. Optim. Lett. 6, 1425–1446 (2012)
J. Karlsson, A. Gattami, T.J. Oechtering, M. Skoglund, Iterative source-channel coding approach to Witsenhausen’s counterexample, in ACC 2011, San Francisco (2011)
J.T. Lee, E. Lau, Y. Ho, The Witsenhausen counterexample: a hierarchical search approach for nonconvex optimization problems. IEEE Trans. Autom. Control 46(3), 382–397 (2001)
N. Li, R. Marden, J.S. Shamma, Learning approach to the Witsenhausen counterexample from a view of potential games, in CDC 2009, Shanghai (2009), pp. 157–162
G.M. Lipsa, N.C. Martins, Optimal memoryless control in Gaussian noise: a simple counterexample. Automatica 47, 552–558 (2011)
W.M. McEneaney, S.H. Han, Optimization formulation and monotonic solution method for the Witsenhausen problem. Automatica 55, 55–65 (2015)
M. Mehmetoglu, E. Akyol, K. Rose, A deterministic annealing approach to Witsenhausen’s counterexample, in ISIT 2014, Honolulu (2014)
C.H. Papadimitriou, J. Tsitsiklis, Intractable problems in control theory. SIAM J. Control Optim. 24(4), 639–654 (1986)
N. Saldi, S. Yüksel, T. Linder, Finite model approximations and asymptotic optimality of quantized policies in decentralized stochastic control. IEEE Trans. Autom. Control 62(5), 2360–2373 (2017)
H.S. Witsenhausen, A counterexample in stochastic optimum control. SIAM J. Control Optim. 6(1), 131–147 (1968)
A.A. Zaidi, S. Yüksel, T. Oechtering, M. Skoglund, On optimal policies for control and estimation over a Gaussian relay channel. Automatica 49(9), 2892–2897 (2013)
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Saldi, N., Linder, T., Yüksel, S. (2018). Asymptotic Optimality of Finite Models for Witsenhausen’s Counterexample and Beyond. In: Finite Approximations in Discrete-Time Stochastic Control. Systems & Control: Foundations & Applications. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-79033-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-79033-6_9
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-319-79032-9
Online ISBN: 978-3-319-79033-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)