Skip to main content

Design of Information Channels for Optimization and Stabilization in Networked Control

  • Chapter
Information and Control in Networks

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 450))

Abstract

In this chapter, we review some recent contributions and present new findings on the properties of information/measurement channels in stabilization and optimization problems in networked control. First, we discuss a finite horizon optimal control problem, and investigate structural and topological properties of such a problem over the space of information channels. Existence of optimal channels is discussed and structure and existence of optimal quantization policies is investigated, first for static settings and then for dynamic settings. We then consider the stabilization problem of open-loop unstable linear systems controlled over communication channels. We present tight necessary and sufficient conditions for stochastic stabilizability of such systems driven by Gaussian noise over channels. Stochastic stability notions include ergodicity and the existence of finite second moments. In the analysis, a partial order for optimization and a total order for stabilization are obtained on the set of channels and some research directions are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abaya, E.F., Wise, G.L.: Convergence of vector quantizers with applications to optimal quantization. SIAM J. Appl. Math. 44, 183–189 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  2. Bao, L., Skoglund, M., Johansson, K.H.: Iterative encoder-controller design for feedback control over noisy channels. IEEE Trans. Autom. Control 57, 265–278 (2011)

    Article  MathSciNet  Google Scholar 

  3. Bar-Shalom, Y., Tse, E.: Dual effect, certainty equivalence and separation in stochastic control. IEEE Trans. Autom. Control 19, 494–500 (1974)

    Article  MathSciNet  MATH  Google Scholar 

  4. Blackwell, D.: Equivalent comparison of experiments. Ann. Math. Stat. 24, 265–272 (1953)

    Article  MathSciNet  MATH  Google Scholar 

  5. Bogachev, V.I.: Measure Theory. Springer, Berlin (2007)

    Book  MATH  Google Scholar 

  6. Boll, C.: Comparison of experiments in the infinite case. PhD Dissertation, Stanford University (1955)

    Google Scholar 

  7. Borkar, V.S., Mitter, S.K.: LQG control with communication constraints. In: Kailath Festschrift. Kluwer Academic, Boston (1997)

    Google Scholar 

  8. Borkar, V.S., Mitter, S.K., Tatikonda, S.: Optimal sequential vector quantization of Markov sources. SIAM J. Control Optim. 40, 135–148 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  9. Borkar, V., Mitter, S., Sahai, A., Tatikonda, S.: Sequential source coding: an optimization viewpoint. In: Proceedings of the IEEE Conference on Decision and Control, pp. 1035–1042 (2005)

    Chapter  Google Scholar 

  10. Cam, L.L.: Comparison of experiments—a short review. In: Ferguson, T., Shapley, L. (eds.) Statistics, Probability and Game Theory Papers in Honor of David Blackwell. IMS Lecture Notes Monograph Ser. (1996)

    Google Scholar 

  11. Como, G., Fagnani, F., Zampieri, S.: Anytime reliable transmission of real-valued information through digital noisy channels. SIAM J. Control Optim. 48, 3903–3924 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  12. Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, New York (1991)

    Book  MATH  Google Scholar 

  13. Curry, R.E.: Estimation and Control with Quantized Measurements. MIT Press, Cambridge (1969)

    Google Scholar 

  14. Dabora, R., Goldsmith, A.: On the capacity of indecomposable finite-state channels with feedback. In: Proceedings of the Allerton Conf. Commun. Control Comput., pp. 1045–1052 (2008)

    Google Scholar 

  15. Devroye, L., Györfi, L.: Non-parametric Density Estimation: The L 1 View. Wiley, New York (1985)

    Google Scholar 

  16. Dobrushin, R.L.: An asymptotic bound for the probability error of information transmission through a channel without memory using the feedback. Probl. Kibern. 8, 161–168 (1962)

    Google Scholar 

  17. Fischer, T.R.: Optimal quantized control. IEEE Trans. Autom. Control 27, 996–998 (1982)

    Article  MATH  Google Scholar 

  18. Fu, M.: Lack of separation principle for quantized linear quadratic Gaussian control. IEEE Trans. Autom. Control 57, 2385–2390 (2012)

    Article  Google Scholar 

  19. Gray, R.M.: Entropy and Information Theory. Springer, New York (1990)

    Book  MATH  Google Scholar 

  20. György, A., Linder, T.: Codecell convexity in optimal entropy-constrained vector quantization. IEEE Trans. Inf. Theory 49, 1821–1828 (2003)

    Article  Google Scholar 

  21. Johnston, A., Yüksel, S.: Stochastic stabilization of partially observed and multi-sensor systems driven by Gaussian noise under fixed-rate information constraints. IEEE Trans. Autom. Control (2012, under review). arXiv:1209.4365

  22. Johnston, A., Yüksel, S.: Stochastic stabilization of partially observed and multi-sensor systems driven by Gaussian noise under fixed-rate information constraints. In: Proceedings of the IEEE Conference on Decision and Control, Hawaii (2012)

    Google Scholar 

  23. Lewis, J.B., Tou, J.T.: Optimum sampled-data systems with quantized control signals. IEEE Trans. Ind. Appl. 82, 229–233 (1965)

    Article  Google Scholar 

  24. Luenberger, D.: Linear and Nonlinear Programming. Addison–Wesley, Reading (1984)

    MATH  Google Scholar 

  25. Mahajan, A., Teneketzis, D.: On the design of globally optimal communication strategies for real-time noisy communication with noisy feedback. IEEE J. Sel. Areas Commun. 26, 580–595 (2008)

    Article  Google Scholar 

  26. Mahajan, A., Teneketzis, D.: Optimal design of sequential real-time communication systems. IEEE Trans. Inf. Theory 55, 5317–5338 (2009)

    Article  MathSciNet  Google Scholar 

  27. Mahajan, A., Teneketzis, D.: Optimal performance of networked control systems with non-classical information structures. SIAM J. Control Optim. 48, 1377–1404 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  28. Martins, N.C., Dahleh, M.A.: Feedback control in the presence of noisy channels: “Bode-like” fundamental limitations of performance. IEEE Trans. Autom. Control 53, 1604–1615 (2008)

    Article  MathSciNet  Google Scholar 

  29. Martins, N.C., Dahleh, M.A., Elia, N.: Feedback stabilization of uncertain systems in the presence of a direct link. IEEE Trans. Autom. Control 51(3), 438–447 (2006)

    Article  MathSciNet  Google Scholar 

  30. Matveev, A.S.: State estimation via limited capacity noisy communication channels. Math. Control Signals Syst. 20, 1–35 (2008)

    Article  MATH  Google Scholar 

  31. Matveev, A.S., Savkin, A.V.: The problem of LQG optimal control via a limited capacity communication channel. Syst. Control Lett. 53, 51–64 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  32. Matveev, A.S., Savkin, A.V.: Estimation and Control over Communication Networks. Birkhäuser, Boston (2008)

    Google Scholar 

  33. Merhav, N.: On optimum parameter modulation-estimation from a large deviations perspective. IEEE Trans. Inf. Theory 58, 172–182 (2012)

    Article  Google Scholar 

  34. Merhav, N.: Exponential error bounds on parameter modulation-estimation for discrete memoryless channels. IEEE Trans. Inf. Theory (under review). arXiv:1212.4649

  35. Meyn, S.P., Tweedie, R.: Markov Chains and Stochastic Stability. Springer, London (1993)

    Book  MATH  Google Scholar 

  36. Minero, P., Franceschetti, M., Dey, S., Nair, G.N.: Data rate theorem for stabilization over time-varying feedback channels. IEEE Trans. Autom. Control 54(2), 243–255 (2009)

    Article  MathSciNet  Google Scholar 

  37. Nair, G.N., Evans, R.J.: Stabilizability of stochastic linear systems with finite feedback data rates. SIAM J. Control Optim. 43, 413–436 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  38. Nair, G.N., Fagnani, F., Zampieri, S., Evans, J.R.: Feedback control under data constraints: an overview. In: Proceedings of the IEEE, pp. 108–137 (2007)

    Google Scholar 

  39. Permuter, H.H., Weissman, T., Goldsmith, A.J.: Finite state channels with time-invariant deterministic feedback. IEEE Trans. Inf. Theory 55(2), 644–662 (2009)

    Article  MathSciNet  Google Scholar 

  40. Phelps, R.: Lectures on Choquet’s Theorem. Van Nostrand, New York (1966)

    MATH  Google Scholar 

  41. Pollard, D.: Quantization and the method of k-means. IEEE Trans. Inf. Theory 28, 199–205 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  42. Sahai, A.: Anytime Information Theory. Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA (2001)

    Google Scholar 

  43. Sahai, A., Mitter, S.: The necessity and sufficiency of anytime capacity for stabilization of a linear system over a noisy communication link—part I: scalar systems. IEEE Trans. Inf. Theory 52(8), 3369–3395 (2006)

    Article  MathSciNet  Google Scholar 

  44. Şen, N., Alajaji, F., Yüksel, S.: Feedback capacity of a class of symmetric finite-state Markov channels. IEEE Trans. Inf. Theory 56, 4110–4122 (2011)

    Google Scholar 

  45. Silva, E.I., Derpich, M.S., Østergaard, J.: A framework for control system design subject to average data-rate constraints. IEEE Trans. Autom. Control 56, 1886–1899 (2011)

    Article  Google Scholar 

  46. Tatikonda, S., Mitter, S.: Control under communication constraints. IEEE Trans. Autom. Control 49(7), 1056–1068 (2004)

    Article  MathSciNet  Google Scholar 

  47. Tatikonda, S., Mitter, S.: The capacity of channels with feedback. IEEE Trans. Inf. Theory 55(1), 323–349 (2009)

    Article  MathSciNet  Google Scholar 

  48. Tatikonda, S., Sahai, A., Mitter, S.: Stochastic linear control over a communication channels. IEEE Trans. Autom. Control 49, 1549–1561 (2004)

    Article  MathSciNet  Google Scholar 

  49. Teneketzis, D.: On the structure of optimal real-time encoders and decoders in noisy communication. IEEE Trans. Inf. Theory 52, 4017–4035 (2006)

    Article  MathSciNet  Google Scholar 

  50. Verdú, S., Han, T.S.: A general formula for channel capacity. IEEE Trans. Inf. Theory 40, 1147–1157 (1994)

    Article  MATH  Google Scholar 

  51. Walrand, J.C., Varaiya, P.: Causal coding and control of Markov chains. Syst. Control Lett. 3, 189–192 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  52. Walrand, J.C., Varaiya, P.: Optimal causal coding-decoding problems. IEEE Trans. Inf. Theory 19, 814–820 (1983)

    Article  MathSciNet  Google Scholar 

  53. Witsenhausen, H.S.: On the structure of real-time source coders. Bell Syst. Tech. J. 58, 1437–1451 (1979)

    Article  MATH  Google Scholar 

  54. Wong, W.S., Brockett, R.W.: Systems with finite communication bandwidth constraints—part ii: stabilization with limited information feedback. IEEE Trans. Autom. Control 42, 1294–1299 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  55. Yüksel, S.: Stochastic stabilization of noisy linear systems with fixed-rate limited feedback. IEEE Trans. Autom. Control 55, 2847–2853 (2010)

    Article  Google Scholar 

  56. Yüksel, S.: Characterization of information channels for asymptotic mean stationarity and stochastic stability of non-stationary/unstable linear systems. IEEE Trans. Inf. Theory 58, 6332–6354 (2012)

    Article  Google Scholar 

  57. Yüksel, S.: Jointly optimal LQG quantization and control policies for multi-dimensional linear Gaussian sources. In: Proceedings of the Annual Allerton Conference on Communications, Control and Computing, Monticello, IL (2012)

    Google Scholar 

  58. Yüksel, S.: On optimal causal coding of partially observed Markov sources in single and multi-terminal settings. IEEE Trans. Inf. Theory 59, 424–437 (2013)

    Article  Google Scholar 

  59. Yüksel, S., Başar, T.: Control over noisy forward and reverse channels. IEEE Trans. Autom. Control 56, 1014–1029 (2011)

    Article  Google Scholar 

  60. Yüksel, S., Başar, T.: Stochastic Networked Control Systems: Stabilization and Optimization Under Information Constraints. Birkhäuser, Boston (2013)

    Book  Google Scholar 

  61. Yüksel, S., Linder, T.: Optimization and Convergence of Observation Channels in Stochastic Control, pp. 637–642. American Control Conference, San Francisco (2011)

    Google Scholar 

  62. Yüksel, S., Linder, T.: On optimal zero-delay quantization of vector Markov sources. In: Proceedings of the IEEE Conference on Decision and Control, Hawaii (2012)

    Google Scholar 

  63. Yüksel, S., Linder, T.: Optimization and convergence of observation channels in stochastic control. SIAM J. Control Optim. 50, 864–887 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  64. Yüksel, S., Meyn, S.P.: Random-time, state-dependent stochastic drift for Markov chains and application to stochastic stabilization over erasure channels. IEEE Trans. Autom. Control 58, 47–59 (2013)

    Article  Google Scholar 

  65. Zaidi, A.A., Oechtering, T.J., Yüksel, S., Skoglund, M.: Stabilization and control over Gaussian networks. In: Como, G., Bernhardsson, B., Rantzer, A. (eds.) Information and Control in Networks. Springer, Berlin (2013)

    Google Scholar 

Download references

Acknowledgements

This research has been supported by the Natural Sciences and Engineering Research Council of Canada (NSERC). Some of the figures in this chapter have appeared in [64] and [60].

The author is grateful to Giacomo Como, Bo Bernhardsson, and Anders Rantzer for hosting the workshop that took place in Lund University, which led to the publication of this book chapter. Some of the research reported in this chapter are results of the author’s collaborations with Tamer Başar, Tamás Linder, Sean Meyn, and Andrew Johnston. Discussions with Giacomo Como, Aditya Mahajan, Nuno Martins, Maxim Raginsky, Anant Sahai, Naci Saldi, Sekhar Tatikonda, Demos Teneketzis, and Tsachy Weissman are gratefully acknowledged.

This research was supported by LCCC—Linnaeus Grant VR 2007-8646, Swedish Research Council.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Serdar Yüksel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Yüksel, S. (2014). Design of Information Channels for Optimization and Stabilization in Networked Control. In: Como, G., Bernhardsson, B., Rantzer, A. (eds) Information and Control in Networks. Lecture Notes in Control and Information Sciences, vol 450. Springer, Cham. https://doi.org/10.1007/978-3-319-02150-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02150-8_6

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02149-2

  • Online ISBN: 978-3-319-02150-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics