Information Theory for Electrical Engineers

Textbook

Part of the Signals and Communication Technology book series (SCT)

1. Front Matter
Pages i-ix
2. Orhan Gazi
Pages 1-95
3. Orhan Gazi
Pages 175-233
4. Orhan Gazi
Pages 235-271
5. Back Matter
Pages 273-276

Introduction

This book explains the fundamental concepts of information theory, so as to help students better understand modern communication technologies. It was especially written for electrical and communication engineers working on communication subjects. The book especially focuses on the understandability of the topics, and accordingly uses simple and detailed mathematics, together with a wealth of solved examples.

The book consists of four chapters, the first of which explains the entropy and mutual information concept for discrete random variables. Chapter 2 introduces the concepts of entropy and mutual information for continuous random variables, along with the channel capacity. In turn, Chapter 3 is devoted to the typical sequences and data compression. One of Shannon’s most important discoveries is the channel coding theorem, and it is critical for electrical and communication engineers to fully comprehend the theorem. As such, Chapter 4 solely focuses on it.

To gain the most from the book, readers should have a fundamental grasp of probability and random variables; otherwise, they will find it nearly impossible to understand the topics discussed.

Keywords

Shannon theorem Textbook Information Theory channel coding theorem Discrete entropy Mutual information Channel capacity

Authors and affiliations

1. 1.Department of Electronics and Communication EngineeringÇankaya UniversityAnkaraTurkey

Orhan Gazi is an associate professor in electronic and communication engineering department, Cankaya University.

He got his BS, MS, and PhD degrees all in electrical and electronics engineering from Middle East Technical University, Ankara-Turkey, in 1996, 2001, and 2007 respectively.

His research area involves signal processing, information theory, and forward error correction. Recently he is studying on polar channel codes and preparing publications in this area.

Bibliographic information

• Book Title Information Theory for Electrical Engineers
• Authors Orhan Gazi
• Series Title Signals and Communication Technology
• Series Abbreviated Title Signals, Communication Technology
• DOI https://doi.org/10.1007/978-981-10-8432-4
• Copyright Information Springer Nature Singapore Pte Ltd. 2018
• Publisher Name Springer, Singapore
• eBook Packages Engineering Engineering (R0)
• Hardcover ISBN 978-981-10-8431-7
• Softcover ISBN 978-981-13-4149-6
• eBook ISBN 978-981-10-8432-4
• Series ISSN 1860-4862
• Series E-ISSN 1860-4870
• Edition Number 1
• Number of Pages IX, 276
• Number of Illustrations 120 b/w illustrations, 2 illustrations in colour
• Topics
• Buy this book on publisher's site
Industry Sectors
Automotive
Biotechnology
IT & Software
Telecommunications
Pharma
Materials & Steel