"Introduction to Information Theory: Symbols Signals and Noise" by John R. Pierce

This book covers encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory relates to physics, cybernetics, psychology, and art.


Beginning with the origins of the field, Dr. Pierce follows the brilliant formulations of Claude Shannon and describes such aspects of the subject as encoding and binary digits, entropy. language and meaning, efficient encoding , and the noisy channel. He then goes beyond the strict confines of the topic to explore the ways in which information theory relates to physics, cybernetics, psychology, and art. Mathematical formulas are introduced at the appropriate points for the benefit of serious students. A glossary of terms and an appendix on mathematical notation are provided to help the less mathematically sophisticated.

Contents
Preface to the Dover Edition
I. The World and Theories
II. The Origins of Information Theory
III. A Mathematical Model
IV. Encoding and Binary Digits
V. Entropy
VI. Language and Meaning
VII. Efficient Encoding
VIII. The Noisy Channel
IX. Many Dimensions
X. Information Theory and Physics
XI. Cybernetics
XII. Information Theory and Psychology
XIII. Information Theory and Art
XIV. Back to Communication Theory
Appendix: On Mathematical Notation
Glossary
Index