Shannon entropy

English

Etymology

Named after Claude Shannon, the "father of information theory".

Noun

Shannon entropy (countable and uncountable, plural Shannon entropies)

1. information entropy

Related terms

• joint entropy
• conditional entropy

See also

• mutual information