TheoremBase

The Noise Score Field of a Measure of Finite Weighted Fisher Information: Existence, Norm, Pairing with Noise Gradients, Head Approximation and Tangency

A measure with a relative score of finite weighted Fisher information carries a unique square-integrable noise field whose coordinates are the weighted score components; its squared norm is the weighted Fisher information, its pairing with a noise gradient is the Ornstein-Uhlenbeck functional, the lifted scores of the rescaled heads converge to it, and it lies in the noise tangent space.

Statement

In the setting of A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation, let μ∈P2(X)\mu\in\mathcal{P}_{2}(X), the set of The Second Moment of a Borel Probability Measure on a Hilbert Space and the Probability Measures with Finite Second Moment §space, have a relative score (ζk)k∈N(\zeta_{k})_{k\in\mathbb{N}} with respect to γc\gamma_{c} and finite Fisher information relative to γc\gamma_{c} with weights aa. The coordinate of an element of L2(μ;Xa)L^{2}(\mu;X^{a}) along fkf_{k} is that of The Space of Square-Integrable Hilbert-Valued Maps is a Real Hilbert Space: Coordinates and Synthesis §coordinates; ⟨⋅,⋅⟩μ\langle\cdot,\cdot\rangle_{\mu} and ∥⋅∥μ\lVert\cdot\rVert_{\mu} are the inner product and norm of L2(μ;Xa)L^{2}(\mu;X^{a}); ∇a\nabla_{a} is the noise gradient and TμaT^{a}_{\mu} the noise tangent space at μ\mu.

1. (The noise score field) There is exactly one Zμa∈L2(μ;Xa)Z^{a}_{\mu}\in L^{2}(\mu;X^{a}) whose coordinate along fkf_{k} is ak1/2ζka_{k}^{1/2}\zeta_{k} for every k∈Nk\in\mathbb{N}, and ∥Zμa∥μ2=Ia(μ ∣ γc)\lVert Z^{a}_{\mu}\rVert_{\mu}^{2}=\mathcal{I}_{a}(\mu\,|\,\gamma_{c}).

2. (Pairing with noise gradients) Let n∈Nn\in\mathbb{N} and let g∈Cb1(Rn)g\in C^{1}_{b}(\mathbb{R}^{n}), the set of Bounded Continuously Differentiable Functions with Bounded Partial Derivatives on Euclidean Space §bounded with q=nq=n, with partial derivatives ∂kg\partial_{k}g as in Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation §derivatives, so that g∘png\circ p_{n} is a bounded C1C^{1} cylindrical function and, for k∈[n]k\in[n], (∂kg)∘pn(\partial_{k}g)\circ p_{n} is its kk-th partial derivative by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial, whose class lies in L2(μ)L^{2}(\mu) by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §square-integrable. Then

⟨Zμa,∇a(g∘pn)⟩μ=∑k=1nak ⟨ζk,(∂kg)∘pn⟩L2(μ).\langle Z^{a}_{\mu},\nabla_{a}(g\circ p_{n})\rangle_{\mu}=\sum_{k=1}^{n}a_{k}\,\langle\zeta_{k},(\partial_{k}g)\circ p_{n}\rangle_{L^{2}(\mu)} .

3. (Pairing with the Ornstein-Uhlenbeck functional) Let n∈Nn\in\mathbb{N} and let g∈Cb2(Rn)g\in C^{2}_{b}(\mathbb{R}^{n}), the set of Bounded Twice Continuously Differentiable Functions with Bounded First and Second Partial Derivatives on Euclidean Space §bounded with q=nq=n; then g∈Cb1(Rn)g\in C^{1}_{b}(\mathbb{R}^{n}), a function of class C2C^{2} being of class C1C^{1} by clause 2 of C^k Maps on a Euclidean Open Set. With Lμa(g)L^{a}_{\mu}(g) the noise Ornstein-Uhlenbeck functional of μ\mu at gg,

⟨Zμa,∇a(g∘pn)⟩μ=Lμa(g).\langle Z^{a}_{\mu},\nabla_{a}(g\circ p_{n})\rangle_{\mu}=L^{a}_{\mu}(g).

4. (Head approximation) For n∈Nn\in\mathbb{N}, μ~n\tilde{\mu}_{n} has finite Fisher information relative to γ~n\tilde{\gamma}_{n} by The Relative Score of the Rescaled Head: Projections of the Score, the Ornstein-Uhlenbeck Functional of the Head, and the Converse under Bounded Head Fisher Information §head-score, so its relative score ζμ~nc~(n)\zeta^{\tilde{c}^{(n)}}_{\tilde{\mu}_{n}} lies in L2(μ~n;Rn)L^{2}(\tilde{\mu}_{n};\mathbb{R}^{n}) and has the lift Λnζμ~nc~(n)∈L2(μ;Xa)\Lambda_{n}\zeta^{\tilde{c}^{(n)}}_{\tilde{\mu}_{n}}\in L^{2}(\mu;X^{a}) of Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §lift. Then

∥Zμa−Λnζμ~nc~(n)∥μ2=Ia(μ ∣ γc)−I(μ~n ∣ γ~n),\bigl\lVert Z^{a}_{\mu}-\Lambda_{n}\zeta^{\tilde{c}^{(n)}}_{\tilde{\mu}_{n}}\bigr\rVert_{\mu}^{2}=\mathcal{I}_{a}(\mu\,|\,\gamma_{c})-\mathcal{I}(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n}),

and this tends to 00 as n→∞n\to\infty.

5. (Tangency) Zμa∈TμaZ^{a}_{\mu}\in T^{a}_{\mu}.

Proofs

Log in to submit a proof.

Loading...

Citations

Loading…

Dependencies

Loading…

Related

0 relations

Curated associations between results. These are editable and subjective — they do not replace the dependency graph, which is derived from the references in the text.

No relations recorded yet.

Comments

Log in to comment.

Loading…