ML Anthology

Elements of Information Theory

Thomas M. Cover, Joy A. Thomas
Notable Works 1991
/misc/1991/cover1991misc-elements/

Abstract

Following a brief introduction and overview, early chapters cover the basic algebraic relationships of entropy, relative entropy and mutual information, AEP, entropy rates of stochastic processes and data compression, duality of data compression and the growth rate of wealth. Later chapters explore Kolmogorov complexity, channel capacity, differential entropy, the capacity of the fundamental Gaussian channel, the relationship between information theory and statistics, rate distortion and network information theories.

Notable Works Semantic Scholar

Cite

Text

Cover and Thomas. "Elements of Information Theory." Wiley, 1991.

Markdown

[Cover and Thomas. "Elements of Information Theory." Wiley, 1991.](https://mlanthology.org/misc/1991/cover1991misc-elements/)

BibTeX

@misc{cover1991misc-elements,
  title     = {{Elements of Information Theory}},
  author    = {Cover, Thomas M. and Thomas, Joy A.},
  howpublished = {Wiley},
  year      = {1991},
  url       = {https://mlanthology.org/misc/1991/cover1991misc-elements/}
}