Editing Entropy (information theory) (section)

==See also==
{{Portal|Mathematics}}
{{colbegin}}
*[[Approximate entropy]] (ApEn)
*[[Entropy (thermodynamics)]]
*[[Cross entropy]] – is a measure of the average number of bits needed to identify an event from a set of possibilities between two probability distributions
*[[Entropy (arrow of time)]]
*[[Entropy encoding]] – a coding scheme that assigns codes to symbols so as to match code lengths with the probabilities of the symbols.
*[[Entropy estimation]]
*[[Entropy power inequality]]
*[[Fisher information]]
*[[Graph entropy]]
*[[Hamming distance]]
*[[History of entropy]]
*[[History of information theory]]
*[[Information fluctuation complexity]]
*[[Information geometry]]
*[[Kolmogorov–Sinai entropy]] in [[dynamical system]]s
*[[Levenshtein distance]]
*[[Mutual information]]
*[[Perplexity]]
*[[Qualitative variation]] – other measures of [[statistical dispersion]] for [[nominal distributions]]
*[[Quantum relative entropy]] – a measure of distinguishability between two quantum states.
*[[Rényi entropy]] – a generalization of Shannon entropy; it is one of a family of functionals for quantifying the diversity, uncertainty or randomness of a system.
*[[Randomness]]
*[[Sample entropy]] (SampEn)
*[[Shannon index]]
*[[Theil index]]
*[[Typoglycemia]]
{{colend}}