The Score of a Measure with a Positive Continuously Differentiable Density
lemmaAnalysisProbabilitylem:score-density-2026aIf mu has a positive density m with respect to Lebesgue measure and the vector field grad(m)/m is square-integrable against mu, then integration by parts shows that this field represents minus the integral of the Laplacian on gradients of test functions, so mu has finite Fisher information, its score is the projection of grad(m)/m onto the tangent space, and its Fisher information is at most the classical integral of |grad m|^2/m, with equality when grad(m)/m lies in the tangent space.
In the setting of Square-Integrable Vector Fields Against a Probability Measure on Euclidean Space, and Test Functions: Standing Notation, let be Lebesgue measure on , let be of class on (in the sense of Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation §derivatives; is open by claim 1 of Euclidean Space is Open in Itself, and Maps are Continuous) with for every , with gradient map . The function and its partial derivatives are continuous (Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation §derivatives), hence Borel; so is the map given by , whose components are continuous by claim 2 of Continuity of the Reciprocal of a Nonvanishing Real-Valued Function on a Metric Space and claim 5 of Continuity of Sums and Products of Real-Valued Functions on a Metric Space; and so is , by Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs. Let be the measure with density with respect to , that is,
and assume that . Let be the tangent space at , a closed linear subspace of by Basic Properties of the Tangent Space: Closed Subspace, the Identity Map Belongs to It, Second-Moment Limits, and Representation of Bounded Functionals on Gradients §closed, with the orthogonal projection onto it, and let finite Fisher information, the score and the Fisher information be as defined there.
1. (Integration by parts against the density)¶ The class of belongs to , and
2. (Finite Fisher information and the score as a projection)¶ The measure has finite Fisher information, , and
3. (Equality)¶ If , then and .
Loading…
Prerequisites
No prerequisites tracked.
Dependents
No dependents yet.
Dependent proofs
No dependent proofs yet.
No relations recorded yet.