Skip to main content
SpringerLink
Log in
Book cover

Coordination Control of Distributed Systems pp 291–305Cite as

On Shannon’s Duality of a Source and a Channel and Nonanticipative Communication and Communication for Control

  • Chapter
  • First Online:

  • 1865 Accesses

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 456))

Abstract

This chapter provides a brief introduction to the Fundamental Problem of Communication, as formulated by Shannon, and evolved over the years into various generalities, including the authors’ views on Duality of a Source to a Channel. Suggestions for further research are described, with emphasis on the importance of this duality in nonanticipative or real-time information transmission in both communication and communication for control, of delay-sensitive applications.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Shannon CE (1948) A mathematical theory of communication. Bell Sys Tech J 27:379–423, 1948.

    Google Scholar 

  2. Berger T (1971) Rate Distortion Theory: a mathematical basis for data compression. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  3. Shannon CE (1959) Coding theorems for a discrete source with a fidelity criterion. IRE Nat Conv Rec 4:142–163

    Google Scholar 

  4. Richardson T, Urbanke R (2008) Modern coding theory. Cambridge University Press, Cambridge

    Google Scholar 

  5. Marko H (1973) The bidirectional communication theory-A generalization of information theory. IEEE Trans Commun 21(12):1345–1351

    Google Scholar 

  6. Csiszár I, Körner J (1981) Information theory: coding theorems for discrete memoryless systems. Academic Press, Waltham

    Google Scholar 

  7. Gallager RG (1968) Information theory and reliable communication. Wiley, New York

    Google Scholar 

  8. Cover TM, Thomas JA (1991) Elements of information theory. Wiley-Interscience, New York

    Google Scholar 

  9. Gray RM (1990) Entropy and information theory. Springer, Berlin

    Google Scholar 

  10. Han TS (2003) Information-spectrum methods in information theory. Springer, Berlin

    Google Scholar 

  11. Gamal AE, Kim YH (2011) Network information theory. Cambridge University Press, Cambridge

    Google Scholar 

  12. Ihara S (1993) Information theory for continuous systems. World-Scientific, Singapore

    Google Scholar 

  13. Massey JL (1990) Causality, feedback and directed information. In: International symposium on information theory and its applications (ISITA). Nov 27–30:303–305

    Google Scholar 

  14. Kramer G (1998) Directed information for channels with feedback. Ph.D thesis, Swiss Federal Institute of Technology, Zurich, Switzerland

    Google Scholar 

  15. Tatikonda S (2000) Control under communication constraints. Ph.D thesis, Massachusetts Institute of Technology (MIT), MA, USA

    Google Scholar 

  16. Chen J, Berger T (2005) The capacity of finite-state channels with feedback. IEEE Trans Inf Theory 51(3):780–798

    Google Scholar 

  17. Tatikonda S, Mitter S (2009) The capacity of channels with feedback. IEEE Trans Inf Theory 55(1):323–349

    Google Scholar 

  18. Permuter HH, Weissman T, Goldsmith A (2009) Finite state channels with time-invariant deterministic feedback. IEEE Trans Inf Theory 55(2):644–662

    Google Scholar 

  19. Kramer G (2008) Topics in multi-user information theory. Found Trends Inf Theory 4(4–5):265–444

    Google Scholar 

  20. Cover TM, Pombra S (1989) Gaussian feedback capacity. IEEE Trans Inf Theory 35(1):37–43

    Google Scholar 

  21. Neuhoff DL, Gilbert R (1982) Causal source codes. IEEE Trans Inf Theory 28(5):701–713

    Google Scholar 

  22. Berger T (2003) Shannon lecture: living information theory. IEEE Inf Theory Soc Newslett 53(1)

    Google Scholar 

  23. Gastpar M, Rimoldi B, Vetterli M (2003) To code or not to code: lossy source-channel communication revisited. IEEE Trans Inf Theory 49(5):1147–1158

    Google Scholar 

  24. Wong W, Brockett R (1997) Systems with finite communication bandwidth constraints I: state estimation problems. IEEE Trans Autom Control 42(9):1294–1299

    Google Scholar 

  25. Nair GN, Evans RJ, Mareels IMY, Moran W (2004) Topological feedback entropy and nonlinear stabilization. IEEE Trans Autom Control 49(9):1585–1597

    Google Scholar 

  26. Gorbunov AK, Pinsker MS (1973) Nonanticipatory and prognostic epsilon entropies and message generation rates. Probl Inf Transm 9(3):184–191

    MathSciNet  Google Scholar 

Download references

Acknowledgments

The authors are grateful to Jan H. van Schuppen for stimulating discussions and technical suggestions, during the preparation of this manuscript and throughout the years.

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering (ECE), University of Cyprus, 75 Kallipoleos, P.O. Box 20537, CY-1678, Nicosia, Cyprus

    Charalambos D. Charalambous, Christos K. Kourtellaris & Photios A. Stavrou

Authors
  1. Charalambos D. Charalambous
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christos K. Kourtellaris
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Photios A. Stavrou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Charalambos D. Charalambous .

Editor information

Editors and Affiliations

  1. Delft Institute of Applied Mathematics, Delft University of Technology, Delft, The Netherlands

    Jan H. van Schuppen

  2. Dipartimento d'Informatica, Università degli studi di Verona, Verona, Italy

    Tiziano Villa

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Charalambous, C.D., Kourtellaris, C.K., Stavrou, P.A. (2015). On Shannon’s Duality of a Source and a Channel and Nonanticipative Communication and Communication for Control. In: van Schuppen, J., Villa, T. (eds) Coordination Control of Distributed Systems. Lecture Notes in Control and Information Sciences, vol 456. Springer, Cham. https://doi.org/10.1007/978-3-319-10407-2_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-10407-2_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10406-5

  • Online ISBN: 978-3-319-10407-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation