Abstract
In this chapter, we review some recent contributions and present new findings on the properties of information/measurement channels in stabilization and optimization problems in networked control. First, we discuss a finite horizon optimal control problem, and investigate structural and topological properties of such a problem over the space of information channels. Existence of optimal channels is discussed and structure and existence of optimal quantization policies is investigated, first for static settings and then for dynamic settings. We then consider the stabilization problem of open-loop unstable linear systems controlled over communication channels. We present tight necessary and sufficient conditions for stochastic stabilizability of such systems driven by Gaussian noise over channels. Stochastic stability notions include ergodicity and the existence of finite second moments. In the analysis, a partial order for optimization and a total order for stabilization are obtained on the set of channels and some research directions are presented.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abaya, E.F., Wise, G.L.: Convergence of vector quantizers with applications to optimal quantization. SIAM J. Appl. Math. 44, 183–189 (1984)
Bao, L., Skoglund, M., Johansson, K.H.: Iterative encoder-controller design for feedback control over noisy channels. IEEE Trans. Autom. Control 57, 265–278 (2011)
Bar-Shalom, Y., Tse, E.: Dual effect, certainty equivalence and separation in stochastic control. IEEE Trans. Autom. Control 19, 494–500 (1974)
Blackwell, D.: Equivalent comparison of experiments. Ann. Math. Stat. 24, 265–272 (1953)
Bogachev, V.I.: Measure Theory. Springer, Berlin (2007)
Boll, C.: Comparison of experiments in the infinite case. PhD Dissertation, Stanford University (1955)
Borkar, V.S., Mitter, S.K.: LQG control with communication constraints. In: Kailath Festschrift. Kluwer Academic, Boston (1997)
Borkar, V.S., Mitter, S.K., Tatikonda, S.: Optimal sequential vector quantization of Markov sources. SIAM J. Control Optim. 40, 135–148 (2001)
Borkar, V., Mitter, S., Sahai, A., Tatikonda, S.: Sequential source coding: an optimization viewpoint. In: Proceedings of the IEEE Conference on Decision and Control, pp. 1035–1042 (2005)
Cam, L.L.: Comparison of experiments—a short review. In: Ferguson, T., Shapley, L. (eds.) Statistics, Probability and Game Theory Papers in Honor of David Blackwell. IMS Lecture Notes Monograph Ser. (1996)
Como, G., Fagnani, F., Zampieri, S.: Anytime reliable transmission of real-valued information through digital noisy channels. SIAM J. Control Optim. 48, 3903–3924 (2010)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, New York (1991)
Curry, R.E.: Estimation and Control with Quantized Measurements. MIT Press, Cambridge (1969)
Dabora, R., Goldsmith, A.: On the capacity of indecomposable finite-state channels with feedback. In: Proceedings of the Allerton Conf. Commun. Control Comput., pp. 1045–1052 (2008)
Devroye, L., Györfi, L.: Non-parametric Density Estimation: The L 1 View. Wiley, New York (1985)
Dobrushin, R.L.: An asymptotic bound for the probability error of information transmission through a channel without memory using the feedback. Probl. Kibern. 8, 161–168 (1962)
Fischer, T.R.: Optimal quantized control. IEEE Trans. Autom. Control 27, 996–998 (1982)
Fu, M.: Lack of separation principle for quantized linear quadratic Gaussian control. IEEE Trans. Autom. Control 57, 2385–2390 (2012)
Gray, R.M.: Entropy and Information Theory. Springer, New York (1990)
György, A., Linder, T.: Codecell convexity in optimal entropy-constrained vector quantization. IEEE Trans. Inf. Theory 49, 1821–1828 (2003)
Johnston, A., Yüksel, S.: Stochastic stabilization of partially observed and multi-sensor systems driven by Gaussian noise under fixed-rate information constraints. IEEE Trans. Autom. Control (2012, under review). arXiv:1209.4365
Johnston, A., Yüksel, S.: Stochastic stabilization of partially observed and multi-sensor systems driven by Gaussian noise under fixed-rate information constraints. In: Proceedings of the IEEE Conference on Decision and Control, Hawaii (2012)
Lewis, J.B., Tou, J.T.: Optimum sampled-data systems with quantized control signals. IEEE Trans. Ind. Appl. 82, 229–233 (1965)
Luenberger, D.: Linear and Nonlinear Programming. Addison–Wesley, Reading (1984)
Mahajan, A., Teneketzis, D.: On the design of globally optimal communication strategies for real-time noisy communication with noisy feedback. IEEE J. Sel. Areas Commun. 26, 580–595 (2008)
Mahajan, A., Teneketzis, D.: Optimal design of sequential real-time communication systems. IEEE Trans. Inf. Theory 55, 5317–5338 (2009)
Mahajan, A., Teneketzis, D.: Optimal performance of networked control systems with non-classical information structures. SIAM J. Control Optim. 48, 1377–1404 (2009)
Martins, N.C., Dahleh, M.A.: Feedback control in the presence of noisy channels: “Bode-like” fundamental limitations of performance. IEEE Trans. Autom. Control 53, 1604–1615 (2008)
Martins, N.C., Dahleh, M.A., Elia, N.: Feedback stabilization of uncertain systems in the presence of a direct link. IEEE Trans. Autom. Control 51(3), 438–447 (2006)
Matveev, A.S.: State estimation via limited capacity noisy communication channels. Math. Control Signals Syst. 20, 1–35 (2008)
Matveev, A.S., Savkin, A.V.: The problem of LQG optimal control via a limited capacity communication channel. Syst. Control Lett. 53, 51–64 (2004)
Matveev, A.S., Savkin, A.V.: Estimation and Control over Communication Networks. Birkhäuser, Boston (2008)
Merhav, N.: On optimum parameter modulation-estimation from a large deviations perspective. IEEE Trans. Inf. Theory 58, 172–182 (2012)
Merhav, N.: Exponential error bounds on parameter modulation-estimation for discrete memoryless channels. IEEE Trans. Inf. Theory (under review). arXiv:1212.4649
Meyn, S.P., Tweedie, R.: Markov Chains and Stochastic Stability. Springer, London (1993)
Minero, P., Franceschetti, M., Dey, S., Nair, G.N.: Data rate theorem for stabilization over time-varying feedback channels. IEEE Trans. Autom. Control 54(2), 243–255 (2009)
Nair, G.N., Evans, R.J.: Stabilizability of stochastic linear systems with finite feedback data rates. SIAM J. Control Optim. 43, 413–436 (2004)
Nair, G.N., Fagnani, F., Zampieri, S., Evans, J.R.: Feedback control under data constraints: an overview. In: Proceedings of the IEEE, pp. 108–137 (2007)
Permuter, H.H., Weissman, T., Goldsmith, A.J.: Finite state channels with time-invariant deterministic feedback. IEEE Trans. Inf. Theory 55(2), 644–662 (2009)
Phelps, R.: Lectures on Choquet’s Theorem. Van Nostrand, New York (1966)
Pollard, D.: Quantization and the method of k-means. IEEE Trans. Inf. Theory 28, 199–205 (1982)
Sahai, A.: Anytime Information Theory. Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA (2001)
Sahai, A., Mitter, S.: The necessity and sufficiency of anytime capacity for stabilization of a linear system over a noisy communication link—part I: scalar systems. IEEE Trans. Inf. Theory 52(8), 3369–3395 (2006)
Şen, N., Alajaji, F., Yüksel, S.: Feedback capacity of a class of symmetric finite-state Markov channels. IEEE Trans. Inf. Theory 56, 4110–4122 (2011)
Silva, E.I., Derpich, M.S., Østergaard, J.: A framework for control system design subject to average data-rate constraints. IEEE Trans. Autom. Control 56, 1886–1899 (2011)
Tatikonda, S., Mitter, S.: Control under communication constraints. IEEE Trans. Autom. Control 49(7), 1056–1068 (2004)
Tatikonda, S., Mitter, S.: The capacity of channels with feedback. IEEE Trans. Inf. Theory 55(1), 323–349 (2009)
Tatikonda, S., Sahai, A., Mitter, S.: Stochastic linear control over a communication channels. IEEE Trans. Autom. Control 49, 1549–1561 (2004)
Teneketzis, D.: On the structure of optimal real-time encoders and decoders in noisy communication. IEEE Trans. Inf. Theory 52, 4017–4035 (2006)
Verdú, S., Han, T.S.: A general formula for channel capacity. IEEE Trans. Inf. Theory 40, 1147–1157 (1994)
Walrand, J.C., Varaiya, P.: Causal coding and control of Markov chains. Syst. Control Lett. 3, 189–192 (1983)
Walrand, J.C., Varaiya, P.: Optimal causal coding-decoding problems. IEEE Trans. Inf. Theory 19, 814–820 (1983)
Witsenhausen, H.S.: On the structure of real-time source coders. Bell Syst. Tech. J. 58, 1437–1451 (1979)
Wong, W.S., Brockett, R.W.: Systems with finite communication bandwidth constraints—part ii: stabilization with limited information feedback. IEEE Trans. Autom. Control 42, 1294–1299 (1997)
Yüksel, S.: Stochastic stabilization of noisy linear systems with fixed-rate limited feedback. IEEE Trans. Autom. Control 55, 2847–2853 (2010)
Yüksel, S.: Characterization of information channels for asymptotic mean stationarity and stochastic stability of non-stationary/unstable linear systems. IEEE Trans. Inf. Theory 58, 6332–6354 (2012)
Yüksel, S.: Jointly optimal LQG quantization and control policies for multi-dimensional linear Gaussian sources. In: Proceedings of the Annual Allerton Conference on Communications, Control and Computing, Monticello, IL (2012)
Yüksel, S.: On optimal causal coding of partially observed Markov sources in single and multi-terminal settings. IEEE Trans. Inf. Theory 59, 424–437 (2013)
Yüksel, S., Başar, T.: Control over noisy forward and reverse channels. IEEE Trans. Autom. Control 56, 1014–1029 (2011)
Yüksel, S., Başar, T.: Stochastic Networked Control Systems: Stabilization and Optimization Under Information Constraints. Birkhäuser, Boston (2013)
Yüksel, S., Linder, T.: Optimization and Convergence of Observation Channels in Stochastic Control, pp. 637–642. American Control Conference, San Francisco (2011)
Yüksel, S., Linder, T.: On optimal zero-delay quantization of vector Markov sources. In: Proceedings of the IEEE Conference on Decision and Control, Hawaii (2012)
Yüksel, S., Linder, T.: Optimization and convergence of observation channels in stochastic control. SIAM J. Control Optim. 50, 864–887 (2012)
Yüksel, S., Meyn, S.P.: Random-time, state-dependent stochastic drift for Markov chains and application to stochastic stabilization over erasure channels. IEEE Trans. Autom. Control 58, 47–59 (2013)
Zaidi, A.A., Oechtering, T.J., Yüksel, S., Skoglund, M.: Stabilization and control over Gaussian networks. In: Como, G., Bernhardsson, B., Rantzer, A. (eds.) Information and Control in Networks. Springer, Berlin (2013)
Acknowledgements
This research has been supported by the Natural Sciences and Engineering Research Council of Canada (NSERC). Some of the figures in this chapter have appeared in [64] and [60].
The author is grateful to Giacomo Como, Bo Bernhardsson, and Anders Rantzer for hosting the workshop that took place in Lund University, which led to the publication of this book chapter. Some of the research reported in this chapter are results of the author’s collaborations with Tamer Başar, Tamás Linder, Sean Meyn, and Andrew Johnston. Discussions with Giacomo Como, Aditya Mahajan, Nuno Martins, Maxim Raginsky, Anant Sahai, Naci Saldi, Sekhar Tatikonda, Demos Teneketzis, and Tsachy Weissman are gratefully acknowledged.
This research was supported by LCCC—Linnaeus Grant VR 2007-8646, Swedish Research Council.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Yüksel, S. (2014). Design of Information Channels for Optimization and Stabilization in Networked Control. In: Como, G., Bernhardsson, B., Rantzer, A. (eds) Information and Control in Networks. Lecture Notes in Control and Information Sciences, vol 450. Springer, Cham. https://doi.org/10.1007/978-3-319-02150-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-02150-8_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02149-2
Online ISBN: 978-3-319-02150-8
eBook Packages: EngineeringEngineering (R0)