An Introduction to Single-User Information Theory

  • Fady Alajaji
  • Po-Ning Chen

Table of contents

  1. Front Matter
    Pages i-xvii
  2. Fady Alajaji, Po-Ning Chen
    Pages 1-4
  3. Fady Alajaji, Po-Ning Chen
    Pages 5-54
  4. Fady Alajaji, Po-Ning Chen
    Pages 55-104
  5. Fady Alajaji, Po-Ning Chen
    Pages 105-163
  6. Fady Alajaji, Po-Ning Chen
    Pages 165-217
  7. Fady Alajaji, Po-Ning Chen
    Pages 219-262
  8. Back Matter
    Pages 263-323

About this book


This book presents a succinct and mathematically rigorous treatment of the main pillars of Shannon’s information theory, discussing the fundamental concepts and indispensable results of Shannon’s mathematical theory of communications. It includes five meticulously written core chapters (with accompanying problems), emphasizing the key topics of information measures; lossless and lossy data compression; channel coding; and joint source-channel coding for single-user (point-to-point) communications systems. It also features two appendices covering necessary background material in real analysis and in probability theory and stochastic processes.

The book is ideal for a one-semester foundational course on information theory for senior undergraduate and entry-level graduate students in mathematics, statistics, engineering, and computing and information sciences. A comprehensive instructor’s solutions manual is available.


Information measures lossless source coding Fundamentals of channel coding Gaussian channels discrete systems continuous alphabet systems lossy source coding joint source-channel coding

Authors and affiliations

  • Fady Alajaji
    • 1
  • Po-Ning Chen
    • 2
  1. 1.Department of Mathematics and StatisticsQueen’s UniversityKingstonCanada
  2. 2.Department of Electrical and Computer EngineeringNational Chiao Tung UniversityHsinchuTaiwan

Bibliographic information