TheoremBase

The Standard Normal Distribution Has Finite Fisher Information, Score Minus the Identity, and Fisher Information One

The standard normal distribution on the real line is the measure with density exp(-x^2/2)/c with respect to Lebesgue measure, a positive continuously differentiable density whose derivative is -x times the density; it has second moment one, finite Fisher information, score equal to minus the identity map and Fisher information equal to one.

Statement

In the setting of Square-Integrable Vector Fields Against a Probability Measure on Euclidean Space, and Test Functions: Standing Notation, in dimension d=1d=1, with the real line identified with R1\mathbb{R}^{1} as in One-Dimensional Test Functions: Scalars, Derivatives, and the Difference Quotient of the Derivative, whose reading of differentiability, of f′f' and of continuity, and whose identification of ∥x∥2\lVert x\rVert^{2} with x2x^{2}, are in force. Let λ\lambda be Lebesgue measure λ1\lambda_{1} on B(R)\mathcal{B}(\mathbb{R}), which is the Lebesgue measure of the real line by Lebesgue Measure on Rn\mathbb{R}^n. Let N∈P(R)N\in\mathcal{P}(\mathbb{R}) be the standard normal distribution, with the function g(x)=exp⁡(−x2/2)g(x)=\exp(-x^{2}/2) and the positive real number c=∫Rg dλc=\int_{\mathbb{R}}g\,d\lambda as there, and define φ:R→R\varphi:\mathbb{R}\to\mathbb{R} by φ(x)=c−1g(x)\varphi(x)=c^{-1}g(x). Class C1C^{1} on R=R1\mathbb{R}=\mathbb{R}^{1} and the partial derivative ∂1\partial_{1} are those of Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation (ii), R1\mathbb{R}^{1} being open by claim 1 of Euclidean Space Is Open in Itself. Let M2(N)M_{2}(N) be the second moment of NN, let id\mathrm{id} be the identity map of R\mathbb{R}, and, NN having finite second moment by claim 2, let finite Fisher information, the set P2I(R)\mathcal{P}_{2}^{\mathcal{I}}(\mathbb{R}), the score ξN\xi_{N} and the Fisher information I(N)\mathcal{I}(N) be as defined there.

1. (Density) The function φ\varphi is of class C1C^{1} on R\mathbb{R}, hence continuous and Borel, it is differentiable at every point of R\mathbb{R}, and for every x∈Rx\in\mathbb{R}

φ(x)>0,φ′(x)=∂1φ(x)=−x φ(x);\varphi(x)>0,\qquad \varphi'(x)=\partial_{1}\varphi(x)=-x\,\varphi(x);

and NN is the measure with density φ\varphi with respect to λ\lambda, that is, N(B)=∫R1B φ dλN(B)=\int_{\mathbb{R}}\mathbf{1}_{B}\,\varphi\,d\lambda for every B∈B(R)B\in\mathcal{B}(\mathbb{R}).

2. (Second moment) M2(N)=∫Rx2 N(dx)=1M_{2}(N)=\int_{\mathbb{R}}x^{2}\,N(dx)=1; in particular N∈P2(R)N\in\mathcal{P}_{2}(\mathbb{R}).

3. (Score) N∈P2I(R)N\in\mathcal{P}_{2}^{\mathcal{I}}(\mathbb{R}), the score of NN is ξN=−id\xi_{N}=-\mathrm{id}, and I(N)=1\mathcal{I}(N)=1.

Proofs

Log in to submit a proof.

Loading...

Citations

Loading…

Dependencies

Loading…

Related

0 relations

Curated associations between results. These are editable and subjective — they do not replace the dependency graph, which is derived from the references in the text.

No relations recorded yet.

Comments

Log in to comment.

Loading…