If a bimeasurable bijection T carries the reference measure to a measure with a positive density g, then T carries a density f of a measure to the density (f∘T^{-1})g, and the relative entropy changes by the integral of log g∘T.
In the settings of The Real Numbers: Standing Notation and Background and Measure Spaces and the Lebesgue Integral: Standing Notation, the measure space of the latter being instantiated at each use by the measure space named, let be a measurable space and let and be probability measures on it. Densities with respect to are those of The Radon-Nikodym Theorem for a Finite Measure and a Sigma-Finite Measure, and Uniqueness of Densities; finite relative entropy with respect to and are those of that definition; is the natural logarithm. Let be a bijection such that and its inverse map are measurable with respect to ; for the preimage of under is then the image of under , and both are written . For a probability measure on let be the image measure of claim 1 of that lemma. Let be measurable with for every , and suppose that is a density of with respect to .
1. (Density of the image) If is a density of with respect to , then is a density of with respect to .
2. (Relative entropy of the image) Suppose that has finite relative entropy with respect to and that the function is integrable with respect to . Then has finite relative entropy with respect to , and
Loading…
No relations recorded yet.