Information Measures

Information and Its Description in Science and Engineering

  • Christoph Arndt

Table of contents

  1. Front Matter
    Pages I-XIX
  2. Christoph Arndt
    Pages 1-6
  3. Christoph Arndt
    Pages 7-21
  4. Christoph Arndt
    Pages 23-45
  5. Christoph Arndt
    Pages 47-84
  6. Christoph Arndt
    Pages 85-132
  7. Christoph Arndt
    Pages 133-177
  8. Christoph Arndt
    Pages 179-195
  9. Christoph Arndt
    Pages 197-206
  10. Christoph Arndt
    Pages 261-326
  11. Christoph Arndt
    Pages 327-346
  12. Christoph Arndt
    Pages 347-361
  13. Christoph Arndt
    Pages 363-398
  14. Christoph Arndt
    Pages 399-431
  15. Christoph Arndt
    Pages 433-462
  16. Christoph Arndt
    Pages 463-473
  17. Back Matter
    Pages 475-547

About this book


This book is an introduction to the mathematical description of information in science and engineering. The necessary mathematical theory will be treated in a more vivid way than in the usual theorem-proof structure. This enables the reader to develop an idea of the connections between different information measures and to understand the trains of thoughts in their derivation. As there exist a great number of different possible ways to describe information, these measures are presented in a coherent manner. Some examples of the information measures examined are: Shannon information, applied in coding theory; Akaike information criterion, used in system identification to determine auto-regressive models and in neural networks to identify the number of neu-rons; and Cramer-Rao bound or Fisher information, describing the minimal variances achieved by unbiased estimators. This softcover edition addresses researchers and students in electrical engineering, particularly in control and communications, physics, and applied mathematics.


Regression Shannon Transformation coding theory communication electrical engineering information information theory thermodynamics

Authors and affiliations

  • Christoph Arndt
    • 1
  1. 1.Zentrum für Sensorsysteme Projektbereich IIUniversität SiegenSiegenGermany

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2001
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Springer Book Archive
  • Print ISBN 978-3-540-40855-0
  • Online ISBN 978-3-642-56669-1
  • Buy this book on publisher's site
Industry Sectors
Materials & Steel
Finance, Business & Banking
IT & Software
Energy, Utilities & Environment
Oil, Gas & Geosciences