Editing Information theory (section)

==See also==
{{Portal|Mathematics}}
{{cols|colwidth=21em}}
* [[Algorithmic probability]]
* [[Bayesian inference]]
* [[Communication theory]]
* [[Constructor theory]] – a generalization of information theory that includes quantum information
* [[Formal science]]
* [[Inductive probability]]
* [[Info-metrics]]
* [[Minimum message length]]
* [[Minimum description length]]
* [[Philosophy of information]]
{{colend}}

===Applications===
{{cols}}
* [[Active networking]]
* [[Cryptanalysis]]
* [[Cryptography]]
* [[Cybernetics]]
* [[Entropy in thermodynamics and information theory]]
* [[Gambling]]
* [[Intelligence (information gathering)]]
* [[reflection seismology|Seismic exploration]]
{{colend}}

===History===
* [[Ralph Hartley|Hartley, R.V.L.]]
* [[History of information theory]]
* [[Claude Elwood Shannon|Shannon, C.E.]]
* [[Timeline of information theory]]
* [[Hubert Yockey|Yockey, H.P.]]
* [[Andrey Kolmogorov]]

===Theory===
{{div col|colwidth=16em}}
* [[Coding theory]]
* [[Detection theory]]
* [[Estimation theory]]
* [[Fisher information]]
* [[Information algebra]]
* [[Information asymmetry]]
* [[Information field theory]]
* [[Information geometry]]
* [[Information theory and measure theory]]
* [[Kolmogorov complexity]]
* [[List of unsolved problems in information theory]]
* [[Logic of information]]
* [[Network coding]]
* [[Philosophy of information]]
* [[Quantum information science]]
* [[Source coding]]
{{div col end}}

===Concepts===
{{div col|colwidth=16em}}
* [[Ban (unit)]]
* [[Channel capacity]]
* [[Communication channel]]
* [[Communication source]]
* [[Conditional entropy]]
* [[Covert channel]]
* [[Data compression]]
* Decoder
* [[Differential entropy]]
* [[Fungible information]]
* [[Information fluctuation complexity]]
* [[Information entropy]]
* [[Joint entropy]]
* [[Kullback–Leibler divergence]]
* [[Mutual information]]
* [[Pointwise mutual information]] (PMI)
* [[Receiver (information theory)]]
* [[Redundancy (information theory)|Redundancy]]
* [[Rényi entropy]]
* [[Self-information]]
* [[Unicity distance]]
* [[Variety (cybernetics)|Variety]]
* [[Hamming distance]]
* [[Perplexity]]

{{div col end}}