Information Theory for Systems Engineers

  • L. P. Hyvärinen

Part of the Lecture Notes in Operations Research and Mathematical Economics book series (LNE, volume 5)

Table of contents

  1. Front Matter
    Pages N2-VII
  2. Introduction

    1. L. P. Hyvärinen
      Pages 1-11
  3. Discrete Information Systems

    1. L. P. Hyvärinen
      Pages 12-24
    2. L. P. Hyvärinen
      Pages 25-50
    3. L. P. Hyvärinen
      Pages 51-71
    4. L. P. Hyvärinen
      Pages 72-87
    5. L. P. Hyvärinen
      Pages 88-104
  4. Continuous Information Systems

    1. L. P. Hyvärinen
      Pages 105-123
    2. L. P. Hyvärinen
      Pages 124-144
    3. L. P. Hyvärinen
      Pages 145-163
  5. Back Matter
    Pages 164-209

About this book


This book is based on lectures given by the author at the IBM European Systems Research Institute (ESRI) in Geneva. Information Theory on the syntactic level, as introduced by Claude Shannon in 1949, has many limitations when applied to information processing by computers. But in spite of some obvious shortcomings, the underlyin~ principles are of fundamental importance for systems engineers in understanding the nature of the problems of handling information, its acquisition, storage, processing, and interpretation. The lectures, as presented in this book, attempt to give an exposition of the lovical foundation and basic principles, and to provide at the same time a basis for further study in more specific areas of this expan1in~ theory, such as coding, detection, pattern recognition, and filtering. Most of the problems in Appendix C are intended as extensions of the text, while calling for actjve participation by the stu1ent. Some other problems are direct applications of the theory to specific situations. Some problems require extensive numerical calculations. It is assumed in those cases that the student has access to a computer and that he is capable of writing the necessary programs. The stu1ent is assumed to have a good command of the calculus, and of the theory of probability as well as statistics. Therefore no basic mathematical concepts are discussed in this IV book. The Fourier transform and some related mathematical concepts are introduced in Appendix A.


Claude Shannon Shannon Systems coding entropy filtering foundation information information theory statistics

Authors and affiliations

  • L. P. Hyvärinen
    • 1
  1. 1.IBM European Systems Research InstituteGenevaSwitzerland

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 1968
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Springer Book Archive
  • Print ISBN 978-3-540-04254-9
  • Online ISBN 978-3-642-87092-7
  • Series Print ISSN 0075-8442
  • Buy this book on publisher's site
Industry Sectors
Chemical Manufacturing
Finance, Business & Banking
IT & Software
Consumer Packaged Goods