TheoremBase

The marginal and the coordinate fields come from the bound of a projection by the norm and the change-of-variables formula. The composition isometry is the published composition clause for the lifted score, applied on the plan read as a probability space with the first projection as the random vector. The pairing is then an inner product of two such fields. The shift is a push-forward by a Borel pairing; its marginal, its independence of the representative and the two integral formulas follow from change of variables and the expansion of a squared norm.

Proof

Each result cited is universally quantified over the data in its own statement. Throughout, (Rd+d,B(Rd+d),π)(\mathbb{R}^{d+d},\mathcal{B}(\mathbb{R}^{d+d}),\pi) is a probability space, π\pi being a probability measure on B(Rd+d)\mathcal{B}(\mathbb{R}^{d+d}) by Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iii), and L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}) and L2(ν;Rd)L^{2}(\nu;\mathbb{R}^{d}) are the spaces of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (ii) formed over it and over (Rd,B(Rd),ν)(\mathbb{R}^{d},\mathcal{B}(\mathbb{R}^{d}),\nu).

Claim 1. The projections pr1\mathrm{pr}_{1} and pr2\mathrm{pr}_{2} are Borel and satisfy ∥pri(z)∥≤∥z∥\lVert\mathrm{pr}_{i}(z)\rVert\le\lVert z\rVert for every z∈Rd+dz\in\mathbb{R}^{d+d}, by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i). Both sides being nonnegative, claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field gives ∥pri(z)∥2≤∥z∥2\lVert\mathrm{pr}_{i}(z)\rVert^{2}\le\lVert z\rVert^{2}, so the monotonicity of the integral of nonnegative functions, claim 1 of Linearity and Monotonicity of the Lebesgue Integral, and the Integrability Criterion, gives

∫Rd+d∥pri(z)∥2 π(dz)≤∫Rd+d∥z∥2 π(dz)=M2(π)<∞,\int_{\mathbb{R}^{d+d}}\lVert\mathrm{pr}_{i}(z)\rVert^{2}\,\pi(dz)\le\int_{\mathbb{R}^{d+d}}\lVert z\rVert^{2}\,\pi(dz)=M_{2}(\pi)<\infty ,

the last inequality because π∈P2(Rd+d)\pi\in\mathcal{P}_{2}(\mathbb{R}^{d+d}) by Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (iv). Hence, by the description of L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}) in Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (ii), the classes of pr1\mathrm{pr}_{1} and pr2\mathrm{pr}_{2} belong to it, and their squared norms are the two integrals just bounded, since the nonnegative square root of a nonnegative real number squares back to it by Existence and Uniqueness of the Nonnegative Square Root. The second of them is ∫∥p∥2 π(dz)\int\lVert p\rVert^{2}\,\pi(dz) in the notation of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (iv), and it is finite.

By Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (iii) the first marginal ν=(pr1)#π\nu=(\mathrm{pr}_{1})_{\#}\pi belongs to P(Rd)\mathcal{P}(\mathbb{R}^{d}), and the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iv), applied to the nonnegative Borel function y↦∥y∥2y\mapsto\lVert y\rVert^{2} of Probability Measures on Euclidean Space and Random Vectors: Standing Notation (v), gives

∥pr1∥π2=∫Rd+d∥pr1(z)∥2 π(dz)=∫Rd∥y∥2 ν(dy)=M2(ν),\lVert\mathrm{pr}_{1}\rVert_{\pi}^{2}=\int_{\mathbb{R}^{d+d}}\lVert\mathrm{pr}_{1}(z)\rVert^{2}\,\pi(dz)=\int_{\mathbb{R}^{d}}\lVert y\rVert^{2}\,\nu(dy)=M_{2}(\nu),

which is therefore finite, so ν∈P2(Rd)\nu\in\mathcal{P}_{2}(\mathbb{R}^{d}) by The Second Moment of a Probability Measure on Euclidean Space and the Probability Measures with Finite Second Moment (ii). This proves claim 1.

Claim 2. By the definition of a random vector the Borel map pr1\mathrm{pr}_{1} is a random vector in Rd\mathbb{R}^{d} on the probability space (Rd+d,B(Rd+d),π)(\mathbb{R}^{d+d},\mathcal{B}(\mathbb{R}^{d+d}),\pi), and it is square-integrable by claim 1; its law is the push-forward (pr1)#π=ν(\mathrm{pr}_{1})_{\#}\pi=\nu. Claim 1 of Composition of a Square-Integrable Vector Field with a Random Vector, and the Lifted Score: Isometry, Norm, Weak Identity and Second-Moment Identity, applied with this probability space in place of (Ω,F,P)(\Omega,\mathcal{F},P) and with pr1\mathrm{pr}_{1} in place of the random vector XX there, so that the space written L2(Ω;Rd)L^{2}(\Omega;\mathbb{R}^{d}) there is L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}) here and the space written L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}) there is L2(ν;Rd)L^{2}(\nu;\mathbb{R}^{d}) here, is exactly claim 2, including the assertion id∘pr1=pr1\mathrm{id}\circ\mathrm{pr}_{1}=\mathrm{pr}_{1}. That a representative of η∘pr1\eta\circ\mathrm{pr}_{1} is Borel follows from that claim, a square-integrable random vector on this probability space being by definition a Borel map Rd+d→Rd\mathbb{R}^{d+d}\to\mathbb{R}^{d}.

Claim 3. Let η∈L2(ν;Rd)\eta\in L^{2}(\nu;\mathbb{R}^{d}) and fix representatives. The function z↦η(x)⋅pz\mapsto\eta(x)\cdot p is the function z↦(η∘pr1)(z)⋅pr2(z)z\mapsto(\eta\circ\mathrm{pr}_{1})(z)\cdot\mathrm{pr}_{2}(z), Borel by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (iv) applied to the two Borel maps η∘pr1\eta\circ\mathrm{pr}_{1} and pr2\mathrm{pr}_{2}. By The Space of Square-Integrable Random Vectors (iii), read on this probability space as in Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (ii), this function is integrable with respect to π\pi and

∫η(x)⋅p π(dz)=⟨η∘pr1,pr2⟩π,\int\eta(x)\cdot p\,\pi(dz)=\langle\eta\circ\mathrm{pr}_{1},\mathrm{pr}_{2}\rangle_{\pi},

a real number depending only on the two classes. The Cauchy-Schwarz inequality The Cauchy–Schwarz Inequality in a Real Inner Product Space in the real inner product space L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}), together with claim 2 and claim 1, gives

∣∫η(x)⋅p π(dz)∣≤∥η∘pr1∥π ∥pr2∥π=∥η∥ν∫∥p∥2 π(dz),\Bigl|\int\eta(x)\cdot p\,\pi(dz)\Bigr|\le\lVert\eta\circ\mathrm{pr}_{1}\rVert_{\pi}\,\lVert\mathrm{pr}_{2}\rVert_{\pi}=\lVert\eta\rVert_{\nu}\sqrt{\int\lVert p\rVert^{2}\,\pi(dz)},

the last norm being the nonnegative square root of ∫∥p∥2 π(dz)\int\lVert p\rVert^{2}\,\pi(dz) by Existence and Uniqueness of the Nonnegative Square Root. This proves claim 3.

Claim 4. Write θ=pr2+t (η∘pr1)\theta=\mathrm{pr}_{2}+t\,(\eta\circ\mathrm{pr}_{1}) for the pointwise sum, so that Θtη=(pr1,θ)\Theta^{\eta}_{t}=(\mathrm{pr}_{1},\theta). Each component of θ\theta is a sum of a Borel real-valued function and a real multiple of one, hence Borel by claim 2 of Arithmetic of Measurable Real- and [0,∞]-Valued Maps, so θ\theta is Borel by claim 2 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets, and Θtη\Theta^{\eta}_{t} is Borel by Probability Measures on Euclidean Space and Random Vectors: Standing Notation (v). By The Space of Square-Integrable Random Vectors (ii) the class of θ\theta is the element pr2+t (η∘pr1)\mathrm{pr}_{2}+t\,(\eta\circ\mathrm{pr}_{1}) of L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}).

By Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iv) the push-forward (Θtη)#π(\Theta^{\eta}_{t})_{\#}\pi belongs to P(Rd+d)\mathcal{P}(\mathbb{R}^{d+d}), and by the change-of-variables formula there, applied to the nonnegative Borel function z↦∥z∥2z\mapsto\lVert z\rVert^{2}, together with claim 3 of Concatenation Identifies a Product of Euclidean Spaces with a Euclidean Space, which gives ∥Θtη(z)∥2=∥pr1(z)∥2+∥θ(z)∥2\lVert\Theta^{\eta}_{t}(z)\rVert^{2}=\lVert\mathrm{pr}_{1}(z)\rVert^{2}+\lVert\theta(z)\rVert^{2}, and with the additivity of the integral of nonnegative functions in claim 1 of Linearity and Monotonicity of the Lebesgue Integral, and the Integrability Criterion,

M2((Θtη)#π)=∫Rd+d∥Θtη(z)∥2 π(dz)=∥pr1∥π2+∥θ∥π2<∞,M_{2}\bigl((\Theta^{\eta}_{t})_{\#}\pi\bigr)=\int_{\mathbb{R}^{d+d}}\lVert\Theta^{\eta}_{t}(z)\rVert^{2}\,\pi(dz)=\lVert\mathrm{pr}_{1}\rVert_{\pi}^{2}+\lVert\theta\rVert_{\pi}^{2}<\infty ,

so (Θtη)#π(\Theta^{\eta}_{t})_{\#}\pi belongs to P2(Rd+d)\mathcal{P}_{2}(\mathbb{R}^{d+d}) by The Second Moment of a Probability Measure on Euclidean Space and the Probability Measures with Finite Second Moment (ii), that is, it is a plan in the sense of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation (iv). Its first marginal is ν\nu: by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i) one has pr1∘Θtη=pr1\mathrm{pr}_{1}\circ\Theta^{\eta}_{t}=\mathrm{pr}_{1}, and for B∈B(Rd)B\in\mathcal{B}(\mathbb{R}^{d}),

((pr1)#(Θtη)#π)(B)=π((Θtη)−1(pr1−1(B)))=π((pr1∘Θtη)−1(B))=π(pr1−1(B))=ν(B),\bigl((\mathrm{pr}_{1})_{\#}(\Theta^{\eta}_{t})_{\#}\pi\bigr)(B)=\pi\bigl((\Theta^{\eta}_{t})^{-1}(\mathrm{pr}_{1}^{-1}(B))\bigr)=\pi\bigl((\mathrm{pr}_{1}\circ\Theta^{\eta}_{t})^{-1}(B)\bigr)=\pi\bigl(\mathrm{pr}_{1}^{-1}(B)\bigr)=\nu(B),

by the description of the push-forward in Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iv) and the identity (S∘T)−1(B)=T−1(S−1(B))(S\circ T)^{-1}(B)=T^{-1}(S^{-1}(B)) for preimages.

Let η~\tilde{\eta} be a second representative of the same class. By claim 2 the maps η∘pr1\eta\circ\mathrm{pr}_{1} and η~∘pr1\tilde{\eta}\circ\mathrm{pr}_{1} represent the same class of L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}), that is, the set SS on which they agree satisfies π(S)=1\pi(S)=1; the set SS belongs to B(Rd+d)\mathcal{B}(\mathbb{R}^{d+d}), being the preimage of the Borel set {0Rd}\{0_{\mathbb{R}^{d}}\} of Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (v) under the difference of the two maps, which is Borel because each of its components is a difference of Borel real-valued functions by claim 2 of Arithmetic of Measurable Real- and [0,∞]-Valued Maps and claim 2 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets. Hence its complement NN satisfies π(N)=π(Rd+d)−π(S)=0\pi(N)=\pi(\mathbb{R}^{d+d})-\pi(S)=0 by claim 3 of Basic Properties of a Measure, and Θtη\Theta^{\eta}_{t} and Θtη~\Theta^{\tilde{\eta}}_{t} agree on SS.

Let B∈B(Rd+d)B\in\mathcal{B}(\mathbb{R}^{d+d}) and put A=(Θtη)−1(B)A=(\Theta^{\eta}_{t})^{-1}(B). Since A∩N⊆NA\cap N\subseteq N, the monotonicity of a measure in claim 2 of Basic Properties of a Measure gives π(A∩N)=0\pi(A\cap N)=0, the values of a measure being nonnegative; since A∩N⊆AA\cap N\subseteq A and π\pi is finite, claim 3 of Basic Properties of a Measure gives π(A∖N)=π(A)−π(A∩N)=π(A)\pi(A\setminus N)=\pi(A)-\pi(A\cap N)=\pi(A), where A∖N=A∖(A∩N)A\setminus N=A\setminus(A\cap N). On A∖NA\setminus N the two maps agree, so A∖N⊆(Θtη~)−1(B)A\setminus N\subseteq(\Theta^{\tilde{\eta}}_{t})^{-1}(B), and monotonicity gives π(A)≤π((Θtη~)−1(B))\pi(A)\le\pi((\Theta^{\tilde{\eta}}_{t})^{-1}(B)); by symmetry the two are equal, so the two push-forwards agree.

For t=0t=0 one has 0 (η∘pr1)=00\,(\eta\circ\mathrm{pr}_{1})=\mathbf{0} and θ=pr2\theta=\mathrm{pr}_{2}, and Θ0η(z)=ι(pr1(z),pr2(z))=z\Theta^{\eta}_{0}(z)=\iota(\mathrm{pr}_{1}(z),\mathrm{pr}_{2}(z))=z by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i), so Θ0η\Theta^{\eta}_{0} is the identity map and (Θ0η)#π=π(\Theta^{\eta}_{0})_{\#}\pi=\pi by the description of the push-forward.

Now let η′∈L2(ν;Rd)\eta'\in L^{2}(\nu;\mathbb{R}^{d}). The function g(z)=η′(x)⋅pg(z)=\eta'(x)\cdot p is Borel by claim 3, and

g(Θtη(z))=η′(pr1(z))⋅θ(z)=η′(x)⋅p+t (η′∘pr1)(z)⋅(η∘pr1)(z)g\bigl(\Theta^{\eta}_{t}(z)\bigr)=\eta'\bigl(\mathrm{pr}_{1}(z)\bigr)\cdot\theta(z)=\eta'(x)\cdot p+t\,\bigl(\eta'\circ\mathrm{pr}_{1}\bigr)(z)\cdot\bigl(\eta\circ\mathrm{pr}_{1}\bigr)(z)

by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i) and the bilinearity of the dot product recorded in Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n. Both summands are integrable with respect to π\pi, the first by claim 3 and the second by claim 3 applied on the probability space (Rd+d,B(Rd+d),π)(\mathbb{R}^{d+d},\mathcal{B}(\mathbb{R}^{d+d}),\pi) to the two elements η′∘pr1\eta'\circ\mathrm{pr}_{1} and η∘pr1\eta\circ\mathrm{pr}_{1} of L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}), whose integral is ⟨η′∘pr1,η∘pr1⟩π\langle\eta'\circ\mathrm{pr}_{1},\eta\circ\mathrm{pr}_{1}\rangle_{\pi} by The Space of Square-Integrable Random Vectors (iii); so g∘Θtηg\circ\Theta^{\eta}_{t} is integrable and the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iv) together with the linearity of the integral in claim 2 of Linearity and Monotonicity of the Lebesgue Integral, and the Integrability Criterion gives

∫η′(x)⋅p d((Θtη)#π)=∫g∘Θtη dπ=∫η′(x)⋅p π(dz)+t ⟨η′∘pr1,η∘pr1⟩π,\int\eta'(x)\cdot p\,d\bigl((\Theta^{\eta}_{t})_{\#}\pi\bigr)=\int g\circ\Theta^{\eta}_{t}\,d\pi=\int\eta'(x)\cdot p\,\pi(dz)+t\,\langle\eta'\circ\mathrm{pr}_{1},\eta\circ\mathrm{pr}_{1}\rangle_{\pi},

and the last inner product is ⟨η′,η⟩ν\langle\eta',\eta\rangle_{\nu} by claim 2. Likewise, applying the change-of-variables formula to the nonnegative Borel function z↦∥p∥2z\mapsto\lVert p\rVert^{2} and then Elementary Identities in a Real Inner Product Space (v) in L2(π;Rd)L^{2}(\pi;\mathbb{R}^{d}),

∫∥p∥2 d((Θtη)#π)=∥θ∥π2=∥pr2∥π2+2t ⟨pr2,η∘pr1⟩π+t2∥η∘pr1∥π2,\int\lVert p\rVert^{2}\,d\bigl((\Theta^{\eta}_{t})_{\#}\pi\bigr)=\lVert\theta\rVert_{\pi}^{2}=\lVert\mathrm{pr}_{2}\rVert_{\pi}^{2}+2t\,\langle\mathrm{pr}_{2},\eta\circ\mathrm{pr}_{1}\rangle_{\pi}+t^{2}\lVert\eta\circ\mathrm{pr}_{1}\rVert_{\pi}^{2},

which is the asserted formula by claims 1, 2 and 3, the inner product being symmetric by Real Inner Product Spaces (i). This proves claim 4.

Claim 5. Fix representatives of YY and Y′Y' and write T=(Y,Y′)T=(Y,Y') for their pairing, a random vector in Rd+d\mathbb{R}^{d+d} on (Ω,F,P)(\Omega,\mathcal{F},P) by Random Vectors: Coordinates, Functions, Pairs and Almost-Sure Equality (v), with L(T)=T#P=π\mathcal{L}(T)=T_{\#}P=\pi by hypothesis and Random Vector and Its Law (iii). By Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i) one has pr1∘T=Y\mathrm{pr}_{1}\circ T=Y, so, exactly as in the computation of the first marginal in claim 4,

L(Y)=(pr1∘T)#P=(pr1)#(T#P)=(pr1)#π=ν.\mathcal{L}(Y)=(\mathrm{pr}_{1}\circ T)_{\#}P=(\mathrm{pr}_{1})_{\#}\bigl(T_{\#}P\bigr)=(\mathrm{pr}_{1})_{\#}\pi=\nu .

Let η∈L2(ν;Rd)\eta\in L^{2}(\nu;\mathbb{R}^{d}). The class η∘Y∈L2(Ω;Rd)\eta\circ Y\in L^{2}(\Omega;\mathbb{R}^{d}) is defined by Composition of a Square-Integrable Vector Field with a Random Vector, and the Lifted Score: Isometry, Norm, Weak Identity and Second-Moment Identity (i), applicable because L(Y)=ν\mathcal{L}(Y)=\nu, and a representative of it is η∘Y\eta\circ Y. The function g(z)=η(x)⋅pg(z)=\eta(x)\cdot p of claim 3 satisfies g∘T=(η∘Y)⋅Y′g\circ T=(\eta\circ Y)\cdot Y' by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets (i), and this function is integrable with respect to PP by The Space of Square-Integrable Random Vectors (iii), so the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation (iv) gives

∫η(x)⋅p π(dz)=∫Ω(η∘Y)⋅Y′ dP=E[(η∘Y)⋅Y′]=⟨η∘Y,Y′⟩L2,\int\eta(x)\cdot p\,\pi(dz)=\int_{\Omega}(\eta\circ Y)\cdot Y'\,dP=\mathbb{E}\bigl[(\eta\circ Y)\cdot Y'\bigr]=\langle\eta\circ Y,Y'\rangle_{L^{2}},

the last equality by The Space of Square-Integrable Random Vectors (iii). Applying the same formula to the nonnegative Borel function z↦∥p∥2z\mapsto\lVert p\rVert^{2}, whose composition with TT is ∥Y′∥2\lVert Y'\rVert^{2}, gives ∫∥p∥2 π(dz)=E[∥Y′∥2]=∥Y′∥L22\int\lVert p\rVert^{2}\,\pi(dz)=\mathbb{E}[\lVert Y'\rVert^{2}]=\lVert Y'\rVert_{L^{2}}^{2}, again by The Space of Square-Integrable Random Vectors (iii). This proves claim 5.

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…