Entropy of Products, Subadditivity over Two Marginals, and Convexity of the Entropy
lemmaAnalysisProbabilitylem:entropy-product-marginals-euclidean-2026aThe entropy of a product of two measures with finite entropy is the sum of their entropies; a measure on a concatenated space with finite entropy and finite second moment has marginals of finite entropy whose entropies add up to at most its own; and the entropy is convex under finite mixtures.
In the setting of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation, let . The entropy and the set of measures in with finite entropy are those of that definition, in each dimension used below; and are those of Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs.
1. (Products)¶ For and , and .
2. (Subadditivity)¶ For , the marginals and belong to and , and
3. (Convexity)¶ Let , let , and let be nonnegative with . The function on is a probability measure , it belongs to , and .
Loading…
Prerequisites
No prerequisites tracked.
Dependents
No dependents yet.
Dependent proofs
No dependent proofs yet.
No relations recorded yet.