Each result cited is universally quantified over the data in its own statement, and is applied to the data named here.
Step 1. The doubled difference on the lift. Write A = D Λ A=\mathcal{D}^{\Lambda} A = D Λ and let u ^ , v ^ : A → R \hat{u},\hat{v}:A\to\mathbb{R} u ^ , v ^ : A → R be the functions with values u ^ ( X ) = u δ − ( L ( X ) ) \hat{u}(X)=u^{-}_{\delta}(\mathcal{L}(X)) u ^ ( X ) = u δ − ( L ( X )) and v ^ ( X ) = v δ + ( L ( X ) ) \hat{v}(X)=v^{+}_{\delta}(\mathcal{L}(X)) v ^ ( X ) = v δ + ( L ( X )) , defined because L ( X ) ∈ D \mathcal{L}(X)\in\mathcal{D} L ( X ) ∈ D for X ∈ A X\in A X ∈ A by Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §preimages ; let − v ^ : A → R -\hat{v}:A\to\mathbb{R} − v ^ : A → R have as value at X X X the additive inverse of v ^ ( X ) \hat{v}(X) v ^ ( X ) . Let L 2 ( Ω ; R d ) × L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d})\times L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) × L 2 ( Ω ; R d ) be the product of the real Hilbert space L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) with itself, a real Hilbert space by Properties of the Product of Two Real Inner Product Spaces §hilbert , with norm ∣ ⋅ ∣ |\cdot| ∣ ⋅ ∣ and distance d × d_{\times} d × .
Read The Doubled Difference on the Lift of a Wasserstein-Coercive Penalty Pair: Bounds, Closed Superlevel Sets and the Least Penalty with the present δ \delta δ , u u u , v v v , b b b , b ′ b' b ′ and e 0 e_{0} e 0 . Its claim 2 gives that A A A is nonempty and that
u ^ ( X ) ≤ b − δ e 0 , b ′ + δ e 0 ≤ v ^ ( X ) ( X ∈ A ) , \hat{u}(X)\le b-\delta e_{0},\qquad b'+\delta e_{0}\le\hat{v}(X)\qquad(X\in A), u ^ ( X ) ≤ b − δ e 0 , b ′ + δ e 0 ≤ v ^ ( X ) ( X ∈ A ) ,
the second because − v ^ ( X ) ≤ − b ′ − δ e 0 -\hat{v}(X)\le-b'-\delta e_{0} − v ^ ( X ) ≤ − b ′ − δ e 0 ; its claim 3 gives that u ^ \hat{u} u ^ and − v ^ -\hat{v} − v ^ have closed superlevel sets in L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) .
Let Φ 0 : A × A → R \Phi_{0}:A\times A\to\mathbb{R} Φ 0 : A × A → R have the value Φ 0 ( X , Y ) = u ^ ( X ) − v ^ ( Y ) − α 2 ∥ X − Y ∥ L 2 2 \Phi_{0}(X,Y)=\hat{u}(X)-\hat{v}(Y)-\tfrac{\alpha}{2}\lVert X-Y\rVert_{L^{2}}^{2} Φ 0 ( X , Y ) = u ^ ( X ) − v ^ ( Y ) − 2 α ∥ X − Y ∥ L 2 2 . This is the function of claim 4 of The Doubled Difference on the Lift of a Wasserstein-Coercive Penalty Pair: Bounds, Closed Superlevel Sets and the Least Penalty with the nonnegative multiplier there taken to be 0 0 0 and with q = ( X ^ , Y ^ ) q=(\hat{X},\hat{Y}) q = ( X ^ , Y ^ ) , the omitted term vanishing by claim 1 of Zero Products and Elementary Identities in a Field ; so Φ 0 \Phi_{0} Φ 0 is bounded above by b − b ′ − 2 δ e 0 b-b'-2\delta e_{0} b − b ′ − 2 δ e 0 and has closed superlevel sets in the product space.
By Existence, Penalty Bounds and Optimal Realisation at a Maximiser of the Wasserstein-Doubled Difference on the Lift §optimal-pair , applied to the maximiser ( μ ^ , ν ^ ) (\hat{\mu},\hat{\nu}) ( μ ^ , ν ^ ) and to X ^ , Y ^ \hat{X},\hat{Y} X ^ , Y ^ ,
Φ 0 ( X , Y ) ≤ u δ − ( μ ^ ) − v δ + ( ν ^ ) − α 2 ∥ X ^ − Y ^ ∥ L 2 2 ( X , Y ∈ A ) . \Phi_{0}(X,Y)\ \le\ u^{-}_{\delta}(\hat{\mu})-v^{+}_{\delta}(\hat{\nu})-\tfrac{\alpha}{2}\lVert\hat{X}-\hat{Y}\rVert_{L^{2}}^{2}\qquad(X,Y\in A). Φ 0 ( X , Y ) ≤ u δ − ( μ ^ ) − v δ + ( ν ^ ) − 2 α ∥ X ^ − Y ^ ∥ L 2 2 ( X , Y ∈ A ) .
Since ∥ X ^ − Y ^ ∥ L 2 = W 2 ( μ ^ , ν ^ ) \lVert\hat{X}-\hat{Y}\rVert_{L^{2}}=W_{2}(\hat{\mu},\hat{\nu}) ∥ X ^ − Y ^ ∥ L 2 = W 2 ( μ ^ , ν ^ ) the right-hand side is Ψ δ , α ( μ ^ , ν ^ ) = M ( δ , α ) \Psi_{\delta,\alpha}(\hat{\mu},\hat{\nu})=M(\delta,\alpha) Ψ δ , α ( μ ^ , ν ^ ) = M ( δ , α ) , and it equals Φ 0 ( X ^ , Y ^ ) \Phi_{0}(\hat{X},\hat{Y}) Φ 0 ( X ^ , Y ^ ) because L ( X ^ ) = μ ^ \mathcal{L}(\hat{X})=\hat{\mu} L ( X ^ ) = μ ^ and L ( Y ^ ) = ν ^ \mathcal{L}(\hat{Y})=\hat{\nu} L ( Y ^ ) = ν ^ . Hence the supremum of the values of Φ 0 \Phi_{0} Φ 0 is M ( δ , α ) M(\delta,\alpha) M ( δ , α ) , attained at ( X ^ , Y ^ ) (\hat{X},\hat{Y}) ( X ^ , Y ^ ) . The same identity reads ∥ X ^ − Y ^ ∥ L 2 2 = W 2 ( L ( X ^ ) , L ( Y ^ ) ) 2 \lVert\hat{X}-\hat{Y}\rVert_{L^{2}}^{2}=W_{2}(\mathcal{L}(\hat{X}),\mathcal{L}(\hat{Y}))^{2} ∥ X ^ − Y ^ ∥ L 2 2 = W 2 ( L ( X ^ ) , L ( Y ^ ) ) 2 , so ( X ^ , Y ^ ) (\hat{X},\hat{Y}) ( X ^ , Y ^ ) is optimally coupled by Optimally Coupled Pairs of Square-Integrable Random Vectors §optimal .
Step 2. A sequentially strict maximum nearby. For n ∈ N n\in\mathbb{N} n ∈ N let ϵ n \epsilon_{n} ϵ n be the quotient of 1 1 1 by n n n , so that 0 < ϵ n ≤ 1 0<\epsilon_{n}\le1 0 < ϵ n ≤ 1 , and let ϵ n 2 = ϵ n ϵ n \epsilon_{n}^{2}=\epsilon_{n}\epsilon_{n} ϵ n 2 = ϵ n ϵ n and ϵ n 3 = ϵ n ϵ n ϵ n \epsilon_{n}^{3}=\epsilon_{n}\epsilon_{n}\epsilon_{n} ϵ n 3 = ϵ n ϵ n ϵ n . The sequence whose n n n -th term is ϵ n \epsilon_{n} ϵ n converges to 0 0 0 : given positive ε ∈ R \varepsilon\in\mathbb{R} ε ∈ R , The Archimedean Property of the Real Numbers provides N ∈ N N\in\mathbb{N} N ∈ N with ε − 1 < N \varepsilon^{-1}<N ε − 1 < N , and for n ∈ N n\in\mathbb{N} n ∈ N with N ≤ n N\le n N ≤ n one has ε − 1 < n \varepsilon^{-1}<n ε − 1 < n , whence ϵ n < ε \epsilon_{n}<\varepsilon ϵ n < ε on multiplying by the positive ε ϵ n \varepsilon\epsilon_{n} ε ϵ n (claim 10 of Elementary Order Arithmetic in an Ordered Field ); and ∣ ϵ n − 0 ∣ = ϵ n |\epsilon_{n}-0|=\epsilon_{n} ∣ ϵ n − 0∣ = ϵ n by claim 1 of Properties of the Absolute Value in an Ordered Field .
Fix n ∈ N n\in\mathbb{N} n ∈ N and apply A Perturbed Maximum Principle of Borwein-Preiss Type in a Real Hilbert Space in the real Hilbert space L 2 ( Ω ; R d ) × L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d})\times L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) × L 2 ( Ω ; R d ) to the nonempty set A × A A\times A A × A and the function Φ 0 \Phi_{0} Φ 0 , with both of the positive parameters written μ \mu μ and λ \lambda λ there taken equal to ϵ n \epsilon_{n} ϵ n and with x 0 = ( X ^ , Y ^ ) x_{0}=(\hat{X},\hat{Y}) x 0 = ( X ^ , Y ^ ) ; the hypothesis on x 0 x_{0} x 0 holds because Φ 0 \Phi_{0} Φ 0 attains its supremum there and 0 < ϵ n ϵ n 2 0<\epsilon_{n}\epsilon_{n}^{2} 0 < ϵ n ϵ n 2 . We obtain q ˉ n \bar{q}_{n} q ˉ n in the product space and ( X ˉ n , Y ˉ n ) ∈ A × A (\bar{X}_{n},\bar{Y}_{n})\in A\times A ( X ˉ n , Y ˉ n ) ∈ A × A such that, writing Ψ n : A × A → R \Psi_{n}:A\times A\to\mathbb{R} Ψ n : A × A → R for the function with value Φ 0 ( X , Y ) − ϵ n ∣ ( X , Y ) − q ˉ n ∣ 2 \Phi_{0}(X,Y)-\epsilon_{n}\,|(X,Y)-\bar{q}_{n}|^{2} Φ 0 ( X , Y ) − ϵ n ∣ ( X , Y ) − q ˉ n ∣ 2 ,
∣ q ˉ n − ( X ^ , Y ^ ) ∣ ≤ 4 ϵ n , ∣ ( X ˉ n , Y ˉ n ) − ( X ^ , Y ^ ) ∣ ≤ 4 ϵ n , ∣ ( X ˉ n , Y ˉ n ) − q ˉ n ∣ ≤ 8 ϵ n \bigl|\bar{q}_{n}-(\hat{X},\hat{Y})\bigr|\le4\epsilon_{n},\qquad\bigl|(\bar{X}_{n},\bar{Y}_{n})-(\hat{X},\hat{Y})\bigr|\le4\epsilon_{n},\qquad\bigl|(\bar{X}_{n},\bar{Y}_{n})-\bar{q}_{n}\bigr|\le8\epsilon_{n} q ˉ n − ( X ^ , Y ^ ) ≤ 4 ϵ n , ( X ˉ n , Y ˉ n ) − ( X ^ , Y ^ ) ≤ 4 ϵ n , ( X ˉ n , Y ˉ n ) − q ˉ n ≤ 8 ϵ n
by its clause 1, that Ψ n \Psi_{n} Ψ n attains a sequentially strict maximum on A × A A\times A A × A at ( X ˉ n , Y ˉ n ) (\bar{X}_{n},\bar{Y}_{n}) ( X ˉ n , Y ˉ n ) by its clause 2, and that
M ( δ , α ) ≤ Φ 0 ( X ˉ n , Y ˉ n ) + 2 ϵ n 3 M(\delta,\alpha)\ \le\ \Phi_{0}(\bar{X}_{n},\bar{Y}_{n})+2\epsilon_{n}^{3} M ( δ , α ) ≤ Φ 0 ( X ˉ n , Y ˉ n ) + 2 ϵ n 3
by its clause 3 together with Step 1.
Write q ˉ n = ( q n 1 , q n 2 ) \bar{q}_{n}=(q^{1}_{n},q^{2}_{n}) q ˉ n = ( q n 1 , q n 2 ) . By Properties of the Product of Two Real Inner Product Spaces §inner-product-space differences in the product space are formed coordinatewise, and by Properties of the Product of Two Real Inner Product Spaces §norm
∣ ( X , Y ) − q ˉ n ∣ 2 = ∥ X − q n 1 ∥ L 2 2 + ∥ Y − q n 2 ∥ L 2 2 , \bigl|(X,Y)-\bar{q}_{n}\bigr|^{2}=\lVert X-q^{1}_{n}\rVert_{L^{2}}^{2}+\lVert Y-q^{2}_{n}\rVert_{L^{2}}^{2}, ( X , Y ) − q ˉ n 2 = ∥ X − q n 1 ∥ L 2 2 + ∥ Y − q n 2 ∥ L 2 2 ,
and each coordinate norm is at most the norm of the pair, so that
∥ X ˉ n − X ^ ∥ L 2 ≤ 4 ϵ n , ∥ Y ˉ n − Y ^ ∥ L 2 ≤ 4 ϵ n , ∥ X ˉ n − q n 1 ∥ L 2 ≤ 8 ϵ n , ∥ Y ˉ n − q n 2 ∥ L 2 ≤ 8 ϵ n . \lVert\bar{X}_{n}-\hat{X}\rVert_{L^{2}}\le4\epsilon_{n},\quad\lVert\bar{Y}_{n}-\hat{Y}\rVert_{L^{2}}\le4\epsilon_{n},\quad\lVert\bar{X}_{n}-q^{1}_{n}\rVert_{L^{2}}\le8\epsilon_{n},\quad\lVert\bar{Y}_{n}-q^{2}_{n}\rVert_{L^{2}}\le8\epsilon_{n}. ∥ X ˉ n − X ^ ∥ L 2 ≤ 4 ϵ n , ∥ Y ˉ n − Y ^ ∥ L 2 ≤ 4 ϵ n , ∥ X ˉ n − q n 1 ∥ L 2 ≤ 8 ϵ n , ∥ Y ˉ n − q n 2 ∥ L 2 ≤ 8 ϵ n .
For i ∈ [ 2 ] i\in[2] i ∈ [ 2 ] let g n i : L 2 ( Ω ; R d ) → R g^{i}_{n}:L^{2}(\Omega;\mathbb{R}^{d})\to\mathbb{R} g n i : L 2 ( Ω ; R d ) → R have the value ϵ n ∥ Z − q n i ∥ L 2 2 \epsilon_{n}\lVert Z-q^{i}_{n}\rVert_{L^{2}}^{2} ϵ n ∥ Z − q n i ∥ L 2 2 at Z Z Z . By claim 3 of Affine and Quadratic Functions on a Real Hilbert Space are of Class C 2 C^2 C 2 , read with the multiplier 2 ϵ n 2\epsilon_{n} 2 ϵ n and the point q n i q^{i}_{n} q n i , the function g n i g^{i}_{n} g n i is of class C 2 C^{2} C 2 on L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) , hence continuous there by Basic Properties of Differentiability on an Open Subset of a Real Inner Product Space §continuous . Let u n , v n : A → R u_{n},v_{n}:A\to\mathbb{R} u n , v n : A → R have values u n ( X ) = u ^ ( X ) − g n 1 ( X ) u_{n}(X)=\hat{u}(X)-g^{1}_{n}(X) u n ( X ) = u ^ ( X ) − g n 1 ( X ) and v n ( Y ) = v ^ ( Y ) + g n 2 ( Y ) v_{n}(Y)=\hat{v}(Y)+g^{2}_{n}(Y) v n ( Y ) = v ^ ( Y ) + g n 2 ( Y ) , so that Ψ n ( X , Y ) = u n ( X ) − v n ( Y ) − α 2 ∥ X − Y ∥ L 2 2 \Psi_{n}(X,Y)=u_{n}(X)-v_{n}(Y)-\tfrac{\alpha}{2}\lVert X-Y\rVert_{L^{2}}^{2} Ψ n ( X , Y ) = u n ( X ) − v n ( Y ) − 2 α ∥ X − Y ∥ L 2 2 . The values of g n 1 g^{1}_{n} g n 1 and g n 2 g^{2}_{n} g n 2 are nonnegative, so u n ( X ) ≤ b − δ e 0 u_{n}(X)\le b-\delta e_{0} u n ( X ) ≤ b − δ e 0 and − v n ( Y ) ≤ − b ′ − δ e 0 -v_{n}(Y)\le-b'-\delta e_{0} − v n ( Y ) ≤ − b ′ − δ e 0 ; and by Functions with Closed Superlevel Sets: Sequential Characterisation, Semicontinuity, Perturbation and Limits §perturbation , applied to u ^ \hat{u} u ^ with g n 1 g^{1}_{n} g n 1 and to − v ^ -\hat{v} − v ^ with g n 2 g^{2}_{n} g n 2 , both u n u_{n} u n and − v n -v_{n} − v n have closed superlevel sets in L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) .
Step 3. Lions' lemma and the compression. Let γ = ( c e 1 , … , c e d ) \gamma=(c_{e_{1}},\dots,c_{e_{d}}) γ = ( c e 1 , … , c e d ) be the constant tuple , orthonormal by that clause, and let N N N be the tail form it determines. By The Constant Tuple on L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) : Coordinates, Projection, Tail Form, and Translation-Closed Preimages §penalty-domain the set A A A is translation-closed along γ \gamma γ . Apply Lions' Lemma on a Hilbert Space over a Translation-Closed Set: Test Data and Form Bounds at a Sequentially Strict Maximum of a Quadratically Penalised Difference , read with L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) in place of the space written H H H there, with d d d in place of the dimension written m m m , with γ \gamma γ in place of the tuple written e e e , with the set A A A , with u n u_{n} u n and v n v_{n} v n in place of the functions written u u u and v v v , and with the present α \alpha α ; its hypotheses were verified in Step 2. Writing p n = α ( X ˉ n − Y ˉ n ) p_{n}=\alpha(\bar{X}_{n}-\bar{Y}_{n}) p n = α ( X ˉ n − Y ˉ n ) and S y m \mathrm{Sym} Sym for the set of bounded symmetric bilinear forms on L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) , it yields A n , B n ∈ S y m \mathbb{A}_{n},\mathbb{B}_{n}\in\mathrm{Sym} A n , B n ∈ Sym such that, by its clause 1, the quadruple ( X ˉ n , u n ( X ˉ n ) , p n , A n + 2 α N ) (\bar{X}_{n},u_{n}(\bar{X}_{n}),p_{n},\mathbb{A}_{n}+2\alpha N) ( X ˉ n , u n ( X ˉ n ) , p n , A n + 2 α N ) is approximable by test data from above for u n u_{n} u n on A A A and the quadruple ( Y ˉ n , v n ( Y ˉ n ) , p n , B n − 2 α N ) (\bar{Y}_{n},v_{n}(\bar{Y}_{n}),p_{n},\mathbb{B}_{n}-2\alpha N) ( Y ˉ n , v n ( Y ˉ n ) , p n , B n − 2 α N ) is approximable by test data from below for v n v_{n} v n on A A A , while by its clauses 2, 3 and 4 the forms A n \mathbb{A}_{n} A n and B n \mathbb{B}_{n} B n satisfy A n ⪯ B n \mathbb{A}_{n}\preceq\mathbb{B}_{n} A n ⪯ B n , ∥ A n ∥ ≤ 6 α \lVert\mathbb{A}_{n}\rVert\le6\alpha ∥ A n ∥ ≤ 6 α , ∥ B n ∥ ≤ 6 α \lVert\mathbb{B}_{n}\rVert\le6\alpha ∥ B n ∥ ≤ 6 α and
− 3 α ( ∥ Z ∥ L 2 2 + ∥ W ∥ L 2 2 ) ≤ A n ( Z , Z ) − B n ( W , W ) ≤ 3 α ∥ Z − W ∥ L 2 2 -3\alpha\bigl(\lVert Z\rVert_{L^{2}}^{2}+\lVert W\rVert_{L^{2}}^{2}\bigr)\ \le\ \mathbb{A}_{n}(Z,Z)-\mathbb{B}_{n}(W,W)\ \le\ 3\alpha\lVert Z-W\rVert_{L^{2}}^{2} − 3 α ( ∥ Z ∥ L 2 2 + ∥ W ∥ L 2 2 ) ≤ A n ( Z , Z ) − B n ( W , W ) ≤ 3 α ∥ Z − W ∥ L 2 2
for all Z , W ∈ L 2 ( Ω ; R d ) Z,W\in L^{2}(\Omega;\mathbb{R}^{d}) Z , W ∈ L 2 ( Ω ; R d ) .
Write b ♭ b^{\flat} b ♭ for the compression along γ \gamma γ of b ∈ S y m b\in\mathrm{Sym} b ∈ Sym . By the displayed bounds and Lifted Test Data from Second-Order Data on the Space of Square-Integrable Random Vectors: Compression along the Constant Tuple §admitted the pair ( A n ♭ , B n ♭ ) (\mathbb{A}_{n}^{\flat},\mathbb{B}_{n}^{\flat}) ( A n ♭ , B n ♭ ) is admitted at α \alpha α ; in particular ∥ A n ♭ ∥ ≤ 6 α \lVert\mathbb{A}_{n}^{\flat}\rVert\le6\alpha ∥ A n ♭ ∥ ≤ 6 α and ∥ B n ♭ ∥ ≤ 6 α \lVert\mathbb{B}_{n}^{\flat}\rVert\le6\alpha ∥ B n ♭ ∥ ≤ 6 α , these bounds being part of what that clause asserts.
Since u n = u ^ − g n 1 u_{n}=\hat{u}-g^{1}_{n} u n = u ^ − g n 1 and v n = v ^ + g n 2 v_{n}=\hat{v}+g^{2}_{n} v n = v ^ + g n 2 , parts (a) and (b) of claim 3 of Lifted Test Data from Second-Order Data on the Space of Square-Integrable Random Vectors: Compression along the Constant Tuple , read with the multiplier ϵ n \epsilon_{n} ϵ n and the points q n 1 q^{1}_{n} q n 1 and q n 2 q^{2}_{n} q n 2 , convert the two quadruples above into: the quadruple
( X ˉ n , u ^ ( X ˉ n ) , p n u , A n + 2 α N + 2 ϵ n I ) , p n u = p n + 2 ϵ n ( X ˉ n − q n 1 ) , \bigl(\bar{X}_{n},\ \hat{u}(\bar{X}_{n}),\ p^{u}_{n},\ \mathbb{A}_{n}+2\alpha N+2\epsilon_{n}I\bigr),\qquad p^{u}_{n}=p_{n}+2\epsilon_{n}(\bar{X}_{n}-q^{1}_{n}), ( X ˉ n , u ^ ( X ˉ n ) , p n u , A n + 2 α N + 2 ϵ n I ) , p n u = p n + 2 ϵ n ( X ˉ n − q n 1 ) ,
is approximable by test data from above for u ^ \hat{u} u ^ on A A A , and the quadruple
( Y ˉ n , v ^ ( Y ˉ n ) , p n v , B n − 2 α N − 2 ϵ n I ) , p n v = p n − 2 ϵ n ( Y ˉ n − q n 2 ) , \bigl(\bar{Y}_{n},\ \hat{v}(\bar{Y}_{n}),\ p^{v}_{n},\ \mathbb{B}_{n}-2\alpha N-2\epsilon_{n}I\bigr),\qquad p^{v}_{n}=p_{n}-2\epsilon_{n}(\bar{Y}_{n}-q^{2}_{n}), ( Y ˉ n , v ^ ( Y ˉ n ) , p n v , B n − 2 α N − 2 ϵ n I ) , p n v = p n − 2 ϵ n ( Y ˉ n − q n 2 ) ,
is approximable by test data from below for v ^ \hat{v} v ^ on A A A , where I I I is the identity form of S y m \mathrm{Sym} Sym . By Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple §algebra and Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple §tail ,
( A n + 2 α N + 2 ϵ n I ) ♭ = A n ♭ + 2 ϵ n I d , ( B n − 2 α N − 2 ϵ n I ) ♭ = B n ♭ − 2 ϵ n I d . \bigl(\mathbb{A}_{n}+2\alpha N+2\epsilon_{n}I\bigr)^{\flat}=\mathbb{A}_{n}^{\flat}+2\epsilon_{n}I_{d},\qquad\bigl(\mathbb{B}_{n}-2\alpha N-2\epsilon_{n}I\bigr)^{\flat}=\mathbb{B}_{n}^{\flat}-2\epsilon_{n}I_{d}. ( A n + 2 α N + 2 ϵ n I ) ♭ = A n ♭ + 2 ϵ n I d , ( B n − 2 α N − 2 ϵ n I ) ♭ = B n ♭ − 2 ϵ n I d .
Apply claim 2 of Lifted Test Data from Second-Order Data on the Space of Square-Integrable Random Vectors: Compression along the Constant Tuple to each of these two quadruples, with ϵ n \epsilon_{n} ϵ n in the role of the positive number written ε \varepsilon ε there. There are X n , Y n ∈ A X_{n},Y_{n}\in A X n , Y n ∈ A and lifted test functions Φ n \Phi_{n} Φ n and Ξ n \Xi_{n} Ξ n such that u ^ − Φ n \hat{u}-\Phi_{n} u ^ − Φ n has a local maximum at X n X_{n} X n relative to A A A , v ^ − Ξ n \hat{v}-\Xi_{n} v ^ − Ξ n has a local minimum at Y n Y_{n} Y n relative to A A A , and
∥ X n − X ˉ n ∥ L 2 < ϵ n , ∣ u ^ ( X n ) − u ^ ( X ˉ n ) ∣ < ϵ n , ∥ D Φ n ( X n ) − p n u ∥ L 2 < ϵ n , ∥ H Φ n ( X n ) − A n ♭ − 2 ϵ n I d ∥ < ϵ n , \lVert X_{n}-\bar{X}_{n}\rVert_{L^{2}}<\epsilon_{n},\quad\bigl|\hat{u}(X_{n})-\hat{u}(\bar{X}_{n})\bigr|<\epsilon_{n},\quad\lVert D\Phi_{n}(X_{n})-p^{u}_{n}\rVert_{L^{2}}<\epsilon_{n},\quad\bigl\lVert H_{\Phi_{n}}(X_{n})-\mathbb{A}_{n}^{\flat}-2\epsilon_{n}I_{d}\bigr\rVert<\epsilon_{n}, ∥ X n − X ˉ n ∥ L 2 < ϵ n , u ^ ( X n ) − u ^ ( X ˉ n ) < ϵ n , ∥ D Φ n ( X n ) − p n u ∥ L 2 < ϵ n , H Φ n ( X n ) − A n ♭ − 2 ϵ n I d < ϵ n ,
∥ Y n − Y ˉ n ∥ L 2 < ϵ n , ∣ v ^ ( Y n ) − v ^ ( Y ˉ n ) ∣ < ϵ n , ∥ D Ξ n ( Y n ) − p n v ∥ L 2 < ϵ n , ∥ H Ξ n ( Y n ) − B n ♭ + 2 ϵ n I d ∥ < ϵ n . \lVert Y_{n}-\bar{Y}_{n}\rVert_{L^{2}}<\epsilon_{n},\quad\bigl|\hat{v}(Y_{n})-\hat{v}(\bar{Y}_{n})\bigr|<\epsilon_{n},\quad\lVert D\Xi_{n}(Y_{n})-p^{v}_{n}\rVert_{L^{2}}<\epsilon_{n},\quad\bigl\lVert H_{\Xi_{n}}(Y_{n})-\mathbb{B}_{n}^{\flat}+2\epsilon_{n}I_{d}\bigr\rVert<\epsilon_{n}. ∥ Y n − Y ˉ n ∥ L 2 < ϵ n , v ^ ( Y n ) − v ^ ( Y ˉ n ) < ϵ n , ∥ D Ξ n ( Y n ) − p n v ∥ L 2 < ϵ n , H Ξ n ( Y n ) − B n ♭ + 2 ϵ n I d < ϵ n .
Step 4. The viscosity inequalities. The function on D Λ \mathcal{D}^{\Lambda} D Λ with value u δ − ( L ( X ) ) − Φ n ( X ) u^{-}_{\delta}(\mathcal{L}(X))-\Phi_{n}(X) u δ − ( L ( X )) − Φ n ( X ) at X X X is u ^ − Φ n \hat{u}-\Phi_{n} u ^ − Φ n , which has a local maximum at X n ∈ D Λ X_{n}\in\mathcal{D}^{\Lambda} X n ∈ D Λ relative to D Λ \mathcal{D}^{\Lambda} D Λ ; so Viscosity Subsolution, Supersolution and Solution on the Lift of the Wasserstein Space §subsolution , applied with Φ n \Phi_{n} Φ n , with X n X_{n} X n and with ϵ n \epsilon_{n} ϵ n in the role of the positive number written ε \varepsilon ε there, provides Z n ∈ D Σ Λ Z_{n}\in\mathcal{D}_{\Sigma}^{\Lambda} Z n ∈ D Σ Λ , V n ∈ L 2 ( Ω ; R d ) V_{n}\in L^{2}(\Omega;\mathbb{R}^{d}) V n ∈ L 2 ( Ω ; R d ) , s n ∈ R s_{n}\in\mathbb{R} s n ∈ R and X n ∈ S ( d ) \mathbb{X}_{n}\in\mathcal{S}(d) X n ∈ S ( d ) with
∥ Z n − X n ∥ L 2 < ϵ n , ∣ u δ − ( L ( Z n ) ) − u ^ ( X n ) ∣ < ϵ n , ∣ s n − u ^ ( X n ) ∣ < ϵ n , \lVert Z_{n}-X_{n}\rVert_{L^{2}}<\epsilon_{n},\quad\bigl|u^{-}_{\delta}(\mathcal{L}(Z_{n}))-\hat{u}(X_{n})\bigr|<\epsilon_{n},\quad\bigl|s_{n}-\hat{u}(X_{n})\bigr|<\epsilon_{n}, ∥ Z n − X n ∥ L 2 < ϵ n , u δ − ( L ( Z n )) − u ^ ( X n ) < ϵ n , s n − u ^ ( X n ) < ϵ n ,
∥ V n − D Φ n ( X n ) ∥ L 2 < ϵ n , ∥ X n − H Φ n ( X n ) ∥ < ϵ n , F δ − ( Z n , s n , V n , X n ) ≤ ϵ n . \lVert V_{n}-D\Phi_{n}(X_{n})\rVert_{L^{2}}<\epsilon_{n},\quad\bigl\lVert\mathbb{X}_{n}-H_{\Phi_{n}}(X_{n})\bigr\rVert<\epsilon_{n},\quad F^{-}_{\delta}(Z_{n},s_{n},V_{n},\mathbb{X}_{n})\le\epsilon_{n}. ∥ V n − D Φ n ( X n ) ∥ L 2 < ϵ n , X n − H Φ n ( X n ) < ϵ n , F δ − ( Z n , s n , V n , X n ) ≤ ϵ n .
Dually Viscosity Subsolution, Supersolution and Solution on the Lift of the Wasserstein Space §supersolution , applied with Ξ n \Xi_{n} Ξ n , with Y n Y_{n} Y n and with ϵ n \epsilon_{n} ϵ n , provides W n ∈ D Σ Λ W_{n}\in\mathcal{D}_{\Sigma}^{\Lambda} W n ∈ D Σ Λ , V n ′ ∈ L 2 ( Ω ; R d ) V'_{n}\in L^{2}(\Omega;\mathbb{R}^{d}) V n ′ ∈ L 2 ( Ω ; R d ) , t n ∈ R t_{n}\in\mathbb{R} t n ∈ R and Y n ∈ S ( d ) \mathbb{Y}_{n}\in\mathcal{S}(d) Y n ∈ S ( d ) with the five corresponding inequalities, in which v δ + v^{+}_{\delta} v δ + , v ^ \hat{v} v ^ , Y n Y_{n} Y n , Ξ n \Xi_{n} Ξ n replace u δ − u^{-}_{\delta} u δ − , u ^ \hat{u} u ^ , X n X_{n} X n , Φ n \Phi_{n} Φ n , together with − ϵ n ≤ F δ + ( W n , t n , V n ′ , Y n ) -\epsilon_{n}\le F^{+}_{\delta}(W_{n},t_{n},V'_{n},\mathbb{Y}_{n}) − ϵ n ≤ F δ + ( W n , t n , V n ′ , Y n ) .
Step 5. The limits. Put V ∗ = α ( X ^ − Y ^ ) V_{*}=\alpha(\hat{X}-\hat{Y}) V ∗ = α ( X ^ − Y ^ ) . Using the triangle inequality of The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §triangle and the estimates of Steps 2, 3 and 4,
∥ Z n − X ^ ∥ L 2 ≤ 6 ϵ n , ∥ W n − Y ^ ∥ L 2 ≤ 6 ϵ n , \lVert Z_{n}-\hat{X}\rVert_{L^{2}}\le6\epsilon_{n},\qquad\lVert W_{n}-\hat{Y}\rVert_{L^{2}}\le6\epsilon_{n}, ∥ Z n − X ^ ∥ L 2 ≤ 6 ϵ n , ∥ W n − Y ^ ∥ L 2 ≤ 6 ϵ n ,
∥ p n − V ∗ ∥ L 2 ≤ 8 α ϵ n , ∥ p n u − p n ∥ L 2 ≤ 16 ϵ n 2 , ∥ p n v − p n ∥ L 2 ≤ 16 ϵ n 2 , \lVert p_{n}-V_{*}\rVert_{L^{2}}\le8\alpha\epsilon_{n},\qquad\lVert p^{u}_{n}-p_{n}\rVert_{L^{2}}\le16\epsilon_{n}^{2},\qquad\lVert p^{v}_{n}-p_{n}\rVert_{L^{2}}\le16\epsilon_{n}^{2}, ∥ p n − V ∗ ∥ L 2 ≤ 8 α ϵ n , ∥ p n u − p n ∥ L 2 ≤ 16 ϵ n 2 , ∥ p n v − p n ∥ L 2 ≤ 16 ϵ n 2 ,
the second line by The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §metric and the bounds on ∥ X ˉ n − X ^ ∥ L 2 \lVert\bar{X}_{n}-\hat{X}\rVert_{L^{2}} ∥ X ˉ n − X ^ ∥ L 2 , ∥ Y ˉ n − Y ^ ∥ L 2 \lVert\bar{Y}_{n}-\hat{Y}\rVert_{L^{2}} ∥ Y ˉ n − Y ^ ∥ L 2 , ∥ X ˉ n − q n 1 ∥ L 2 \lVert\bar{X}_{n}-q^{1}_{n}\rVert_{L^{2}} ∥ X ˉ n − q n 1 ∥ L 2 and ∥ Y ˉ n − q n 2 ∥ L 2 \lVert\bar{Y}_{n}-q^{2}_{n}\rVert_{L^{2}} ∥ Y ˉ n − q n 2 ∥ L 2 ; hence
∥ V n − V ∗ ∥ L 2 ≤ 2 ϵ n + 16 ϵ n 2 + 8 α ϵ n , ∥ V n ′ − V ∗ ∥ L 2 ≤ 2 ϵ n + 16 ϵ n 2 + 8 α ϵ n . \lVert V_{n}-V_{*}\rVert_{L^{2}}\le2\epsilon_{n}+16\epsilon_{n}^{2}+8\alpha\epsilon_{n},\qquad\lVert V'_{n}-V_{*}\rVert_{L^{2}}\le2\epsilon_{n}+16\epsilon_{n}^{2}+8\alpha\epsilon_{n}. ∥ V n − V ∗ ∥ L 2 ≤ 2 ϵ n + 16 ϵ n 2 + 8 α ϵ n , ∥ V n ′ − V ∗ ∥ L 2 ≤ 2 ϵ n + 16 ϵ n 2 + 8 α ϵ n .
Also ∥ I d ∥ ≤ 1 \lVert I_{d}\rVert\le1 ∥ I d ∥ ≤ 1 : by Norm of a Symmetric Real Matrix the norm is the supremum of the numbers ∣ ξ ⋅ ( I d ξ ) ∣ |\xi\cdot(I_{d}\xi)| ∣ ξ ⋅ ( I d ξ ) ∣ over ∥ ξ ∥ ≤ 1 \lVert\xi\rVert\le1 ∥ ξ ∥ ≤ 1 , and ξ ⋅ ( I d ξ ) = ξ ⋅ ξ = ∥ ξ ∥ 2 ≤ 1 \xi\cdot(I_{d}\xi)=\xi\cdot\xi=\lVert\xi\rVert^{2}\le1 ξ ⋅ ( I d ξ ) = ξ ⋅ ξ = ∥ ξ ∥ 2 ≤ 1 by claim 2 of Linearity of the Matrix-Vector Product and the Quadratic Form as a Double Sum and claim 1 of Elementary Properties of the Euclidean Norm on R n \mathbb{R}^n R n . Therefore
∥ X n − A n ♭ ∥ ≤ 2 ϵ n + 2 ϵ n ∥ I d ∥ ≤ 4 ϵ n , ∥ Y n − B n ♭ ∥ ≤ 4 ϵ n . \lVert\mathbb{X}_{n}-\mathbb{A}_{n}^{\flat}\rVert\le2\epsilon_{n}+2\epsilon_{n}\lVert I_{d}\rVert\le4\epsilon_{n},\qquad\lVert\mathbb{Y}_{n}-\mathbb{B}_{n}^{\flat}\rVert\le4\epsilon_{n}. ∥ X n − A n ♭ ∥ ≤ 2 ϵ n + 2 ϵ n ∥ I d ∥ ≤ 4 ϵ n , ∥ Y n − B n ♭ ∥ ≤ 4 ϵ n .
Since the sequence whose n n n -th term is ϵ n \epsilon_{n} ϵ n converges to 0 0 0 , each right-hand side above converges to 0 0 0 by Arithmetic of Limits of Real Sequences , and therefore, directly from the definition of convergence , the sequences whose n n n -th terms are Z n Z_{n} Z n , W n W_{n} W n , V n V_{n} V n and V n ′ V'_{n} V n ′ converge in L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) to X ^ \hat{X} X ^ , Y ^ \hat{Y} Y ^ , V ∗ V_{*} V ∗ and V ∗ V_{*} V ∗ .
Next, the value bounds. Since α 2 ∥ X ˉ n − Y ˉ n ∥ L 2 2 \tfrac{\alpha}{2}\lVert\bar{X}_{n}-\bar{Y}_{n}\rVert_{L^{2}}^{2} 2 α ∥ X ˉ n − Y ˉ n ∥ L 2 2 is nonnegative, Step 2 gives M ( δ , α ) − 2 ϵ n 3 ≤ u ^ ( X ˉ n ) − v ^ ( Y ˉ n ) M(\delta,\alpha)-2\epsilon_{n}^{3}\le\hat{u}(\bar{X}_{n})-\hat{v}(\bar{Y}_{n}) M ( δ , α ) − 2 ϵ n 3 ≤ u ^ ( X ˉ n ) − v ^ ( Y ˉ n ) . Combining this with the bounds of Step 1 and with 0 ≤ M ( δ , α ) 0\le M(\delta,\alpha) 0 ≤ M ( δ , α ) ,
b ′ + δ e 0 − 2 ϵ n 3 ≤ u ^ ( X ˉ n ) ≤ b − δ e 0 , b ′ + δ e 0 ≤ v ^ ( Y ˉ n ) ≤ b − δ e 0 + 2 ϵ n 3 . b'+\delta e_{0}-2\epsilon_{n}^{3}\ \le\ \hat{u}(\bar{X}_{n})\ \le\ b-\delta e_{0},\qquad b'+\delta e_{0}\ \le\ \hat{v}(\bar{Y}_{n})\ \le\ b-\delta e_{0}+2\epsilon_{n}^{3}. b ′ + δ e 0 − 2 ϵ n 3 ≤ u ^ ( X ˉ n ) ≤ b − δ e 0 , b ′ + δ e 0 ≤ v ^ ( Y ˉ n ) ≤ b − δ e 0 + 2 ϵ n 3 .
From ∣ s n − u ^ ( X n ) ∣ < ϵ n |s_{n}-\hat{u}(X_{n})|<\epsilon_{n} ∣ s n − u ^ ( X n ) ∣ < ϵ n and ∣ u ^ ( X n ) − u ^ ( X ˉ n ) ∣ < ϵ n |\hat{u}(X_{n})-\hat{u}(\bar{X}_{n})|<\epsilon_{n} ∣ u ^ ( X n ) − u ^ ( X ˉ n ) ∣ < ϵ n we get ∣ s n − u ^ ( X ˉ n ) ∣ < 2 ϵ n |s_{n}-\hat{u}(\bar{X}_{n})|<2\epsilon_{n} ∣ s n − u ^ ( X ˉ n ) ∣ < 2 ϵ n , and likewise ∣ t n − v ^ ( Y ˉ n ) ∣ < 2 ϵ n |t_{n}-\hat{v}(\bar{Y}_{n})|<2\epsilon_{n} ∣ t n − v ^ ( Y ˉ n ) ∣ < 2 ϵ n ; hence
b ′ + δ e 0 − 2 ϵ n 3 − 2 ϵ n ≤ s n ≤ b − δ e 0 + 2 ϵ n , b ′ + δ e 0 − 2 ϵ n ≤ t n ≤ b − δ e 0 + 2 ϵ n 3 + 2 ϵ n , b'+\delta e_{0}-2\epsilon_{n}^{3}-2\epsilon_{n}\le s_{n}\le b-\delta e_{0}+2\epsilon_{n},\qquad b'+\delta e_{0}-2\epsilon_{n}\le t_{n}\le b-\delta e_{0}+2\epsilon_{n}^{3}+2\epsilon_{n}, b ′ + δ e 0 − 2 ϵ n 3 − 2 ϵ n ≤ s n ≤ b − δ e 0 + 2 ϵ n , b ′ + δ e 0 − 2 ϵ n ≤ t n ≤ b − δ e 0 + 2 ϵ n 3 + 2 ϵ n ,
M ( δ , α ) − 2 ϵ n 3 − 4 ϵ n ≤ s n − t n . M(\delta,\alpha)-2\epsilon_{n}^{3}-4\epsilon_{n}\ \le\ s_{n}-t_{n}. M ( δ , α ) − 2 ϵ n 3 − 4 ϵ n ≤ s n − t n .
As 0 < ϵ n ≤ 1 0<\epsilon_{n}\le1 0 < ϵ n ≤ 1 and 0 < δ < 1 0<\delta<1 0 < δ < 1 , the sequences whose n n n -th terms are s n s_{n} s n and t n t_{n} t n are bounded , a bound for both being ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ + 4 |b|+|b'|+|e_{0}|+4 ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ + 4 .
By Lifted Test Data from Second-Order Data on the Space of Square-Integrable Random Vectors: Compression along the Constant Tuple §limits-compactness there are a strictly increasing φ 1 : N → N \varphi_{1}:\mathbb{N}\to\mathbb{N} φ 1 : N → N and X ∗ , Y ∗ ∈ S ( d ) \mathbb{X}_{*},\mathbb{Y}_{*}\in\mathcal{S}(d) X ∗ , Y ∗ ∈ S ( d ) such that the sequences whose k k k -th terms are A φ 1 ( k ) ♭ \mathbb{A}^{\flat}_{\varphi_{1}(k)} A φ 1 ( k ) ♭ and B φ 1 ( k ) ♭ \mathbb{B}^{\flat}_{\varphi_{1}(k)} B φ 1 ( k ) ♭ converge to X ∗ \mathbb{X}_{*} X ∗ and to Y ∗ \mathbb{Y}_{*} Y ∗ . Applying Bolzano-Weierstrass Theorem for Real Sequences twice, first to the sequence whose k k k -th term is s φ 1 ( k ) s_{\varphi_{1}(k)} s φ 1 ( k ) and then to the corresponding sequence of the t t t 's, and composing the index maps by claim 2 of A Subsequence of a Subsequence is a Subsequence , we obtain a strictly increasing φ : N → N \varphi:\mathbb{N}\to\mathbb{N} φ : N → N , each of whose values is a value of φ 1 \varphi_{1} φ 1 , such that the sequences whose k k k -th terms are s φ ( k ) s_{\varphi(k)} s φ ( k ) and t φ ( k ) t_{\varphi(k)} t φ ( k ) converge, to s ∗ s_{*} s ∗ and t ∗ t_{*} t ∗ say. By A Subsequence of a Convergent Sequence Has the Same Limit every convergence established above persists along φ \varphi φ ; in particular A φ ( k ) ♭ → X ∗ \mathbb{A}^{\flat}_{\varphi(k)}\to\mathbb{X}_{*} A φ ( k ) ♭ → X ∗ and B φ ( k ) ♭ → Y ∗ \mathbb{B}^{\flat}_{\varphi(k)}\to\mathbb{Y}_{*} B φ ( k ) ♭ → Y ∗ , and since ∥ X n − A n ♭ ∥ ≤ 4 ϵ n \lVert\mathbb{X}_{n}-\mathbb{A}^{\flat}_{n}\rVert\le4\epsilon_{n} ∥ X n − A n ♭ ∥ ≤ 4 ϵ n and ∥ Y n − B n ♭ ∥ ≤ 4 ϵ n \lVert\mathbb{Y}_{n}-\mathbb{B}^{\flat}_{n}\rVert\le4\epsilon_{n} ∥ Y n − B n ♭ ∥ ≤ 4 ϵ n also X φ ( k ) → X ∗ \mathbb{X}_{\varphi(k)}\to\mathbb{X}_{*} X φ ( k ) → X ∗ and Y φ ( k ) → Y ∗ \mathbb{Y}_{\varphi(k)}\to\mathbb{Y}_{*} Y φ ( k ) → Y ∗ . Each pair ( A φ ( k ) ♭ , B φ ( k ) ♭ ) (\mathbb{A}^{\flat}_{\varphi(k)},\mathbb{B}^{\flat}_{\varphi(k)}) ( A φ ( k ) ♭ , B φ ( k ) ♭ ) is admitted at α \alpha α , so ( X ∗ , Y ∗ ) (\mathbb{X}_{*},\mathbb{Y}_{*}) ( X ∗ , Y ∗ ) is admitted at α \alpha α by Lifted Test Data from Second-Order Data on the Space of Square-Integrable Random Vectors: Compression along the Constant Tuple §limits-closed .
Passing to the limit along φ \varphi φ in the three displayed inequalities for s n s_{n} s n , t n t_{n} t n and s n − t n s_{n}-t_{n} s n − t n , using Arithmetic of Limits of Real Sequences and Order Properties of Limits of Real Sequences ,
M ( δ , α ) ≤ s ∗ − t ∗ , b ′ + δ e 0 ≤ s ∗ ≤ b − δ e 0 , b ′ + δ e 0 ≤ t ∗ ≤ b − δ e 0 . M(\delta,\alpha)\le s_{*}-t_{*},\qquad b'+\delta e_{0}\le s_{*}\le b-\delta e_{0},\qquad b'+\delta e_{0}\le t_{*}\le b-\delta e_{0}. M ( δ , α ) ≤ s ∗ − t ∗ , b ′ + δ e 0 ≤ s ∗ ≤ b − δ e 0 , b ′ + δ e 0 ≤ t ∗ ≤ b − δ e 0 .
Since 0 < δ < 1 0<\delta<1 0 < δ < 1 , the last two give ∣ s ∗ ∣ ≤ ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ ≤ B |s_{*}|\le|b|+|b'|+|e_{0}|\le B ∣ s ∗ ∣ ≤ ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ ≤ B and ∣ t ∗ ∣ ≤ B |t_{*}|\le B ∣ t ∗ ∣ ≤ B .
Step 6. Shift-coercivity, closed score and shift-semicontinuity. For k ∈ N k\in\mathbb{N} k ∈ N put ξ k = ( Z φ ( k ) , s φ ( k ) , V φ ( k ) , X φ ( k ) ) \xi_{k}=(Z_{\varphi(k)},s_{\varphi(k)},V_{\varphi(k)},\mathbb{X}_{\varphi(k)}) ξ k = ( Z φ ( k ) , s φ ( k ) , V φ ( k ) , X φ ( k ) ) and η k = ( W φ ( k ) , t φ ( k ) , V φ ( k ) ′ , Y φ ( k ) ) \eta_{k}=(W_{\varphi(k)},t_{\varphi(k)},V'_{\varphi(k)},\mathbb{Y}_{\varphi(k)}) η k = ( W φ ( k ) , t φ ( k ) , V φ ( k ) ′ , Y φ ( k ) ) ; these are test data for F F F .
Each of the ten quantities occurring in the boundedness condition is bounded above independently of n n n . Indeed ∥ Z n ∥ L 2 ≤ ∥ X ^ ∥ L 2 + 6 \lVert Z_{n}\rVert_{L^{2}}\le\lVert\hat{X}\rVert_{L^{2}}+6 ∥ Z n ∥ L 2 ≤ ∥ X ^ ∥ L 2 + 6 and ∥ W n ∥ L 2 ≤ ∥ Y ^ ∥ L 2 + 6 \lVert W_{n}\rVert_{L^{2}}\le\lVert\hat{Y}\rVert_{L^{2}}+6 ∥ W n ∥ L 2 ≤ ∥ Y ^ ∥ L 2 + 6 ; ∣ s n ∣ ≤ B + 4 |s_{n}|\le B+4 ∣ s n ∣ ≤ B + 4 and ∣ t n ∣ ≤ B + 4 |t_{n}|\le B+4 ∣ t n ∣ ≤ B + 4 ; ∥ V n ∥ L 2 ≤ α ∥ X ^ − Y ^ ∥ L 2 + 8 α + 18 \lVert V_{n}\rVert_{L^{2}}\le\alpha\lVert\hat{X}-\hat{Y}\rVert_{L^{2}}+8\alpha+18 ∥ V n ∥ L 2 ≤ α ∥ X ^ − Y ^ ∥ L 2 + 8 α + 18 and the same for ∥ V n ′ ∥ L 2 \lVert V'_{n}\rVert_{L^{2}} ∥ V n ′ ∥ L 2 ; ∥ X n ∥ ≤ 6 α + 4 \lVert\mathbb{X}_{n}\rVert\le6\alpha+4 ∥ X n ∥ ≤ 6 α + 4 and ∥ Y n ∥ ≤ 6 α + 4 \lVert\mathbb{Y}_{n}\rVert\le6\alpha+4 ∥ Y n ∥ ≤ 6 α + 4 . For the penalties, Step 5 gives ∣ u ^ ( X ˉ n ) ∣ ≤ B + 2 |\hat{u}(\bar{X}_{n})|\le B+2 ∣ u ^ ( X ˉ n ) ∣ ≤ B + 2 and ∣ v ^ ( Y ˉ n ) ∣ ≤ B + 2 |\hat{v}(\bar{Y}_{n})|\le B+2 ∣ v ^ ( Y ˉ n ) ∣ ≤ B + 2 , whence ∣ u δ − ( L ( Z n ) ) ∣ ≤ B + 4 |u^{-}_{\delta}(\mathcal{L}(Z_{n}))|\le B+4 ∣ u δ − ( L ( Z n )) ∣ ≤ B + 4 and ∣ v δ + ( L ( W n ) ) ∣ ≤ B + 4 |v^{+}_{\delta}(\mathcal{L}(W_{n}))|\le B+4 ∣ v δ + ( L ( W n )) ∣ ≤ B + 4 ; since u δ − = u − δ E u^{-}_{\delta}=u-\delta\mathcal{E} u δ − = u − δ E and v δ + = v + δ E v^{+}_{\delta}=v+\delta\mathcal{E} v δ + = v + δ E on D \mathcal{D} D , with u ≤ b u\le b u ≤ b and b ′ ≤ v b'\le v b ′ ≤ v , this gives δ E ( L ( Z n ) ) ≤ b + B + 4 \delta\mathcal{E}(\mathcal{L}(Z_{n}))\le b+B+4 δ E ( L ( Z n )) ≤ b + B + 4 and δ E ( L ( W n ) ) ≤ B + 4 − b ′ \delta\mathcal{E}(\mathcal{L}(W_{n}))\le B+4-b' δ E ( L ( W n )) ≤ B + 4 − b ′ , while δ e 0 ≤ δ E ( L ( Z n ) ) \delta e_{0}\le\delta\mathcal{E}(\mathcal{L}(Z_{n})) δ e 0 ≤ δ E ( L ( Z n )) and δ e 0 ≤ δ E ( L ( W n ) ) \delta e_{0}\le\delta\mathcal{E}(\mathcal{L}(W_{n})) δ e 0 ≤ δ E ( L ( W n )) ; multiplying by the positive δ − 1 \delta^{-1} δ − 1 ,
∣ E ( L ( Z n ) ) ∣ ≤ δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) , ∣ E ( L ( W n ) ) ∣ ≤ δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) . \bigl|\mathcal{E}(\mathcal{L}(Z_{n}))\bigr|\le\delta^{-1}\bigl(|b|+|b'|+B+|e_{0}|+4\bigr),\qquad\bigl|\mathcal{E}(\mathcal{L}(W_{n}))\bigr|\le\delta^{-1}\bigl(|b|+|b'|+B+|e_{0}|+4\bigr). E ( L ( Z n )) ≤ δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) , E ( L ( W n )) ≤ δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) .
Put
R ′ = ∥ X ^ ∥ L 2 + ∥ Y ^ ∥ L 2 + 2 α ∥ X ^ − Y ^ ∥ L 2 + 28 α + 2 δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) + 2 B + 60 , R'=\lVert\hat{X}\rVert_{L^{2}}+\lVert\hat{Y}\rVert_{L^{2}}+2\alpha\lVert\hat{X}-\hat{Y}\rVert_{L^{2}}+28\alpha+2\delta^{-1}\bigl(|b|+|b'|+B+|e_{0}|+4\bigr)+2B+60, R ′ = ∥ X ^ ∥ L 2 + ∥ Y ^ ∥ L 2 + 2 α ∥ X ^ − Y ^ ∥ L 2 + 28 α + 2 δ − 1 ( ∣ b ∣ + ∣ b ′ ∣ + B + ∣ e 0 ∣ + 4 ) + 2 B + 60 ,
a sum of nonnegative terms exceeding each of the ten bounds just listed, and exceeding 2 2 2 . Every ξ k \xi_{k} ξ k and every η k \eta_{k} η k is therefore R ′ R' R ′ -bounded . Moreover F δ − ( ξ k ) − F δ + ( η k ) ≤ ϵ φ ( k ) + ϵ φ ( k ) ≤ 2 < R ′ F^{-}_{\delta}(\xi_{k})-F^{+}_{\delta}(\eta_{k})\le\epsilon_{\varphi(k)}+\epsilon_{\varphi(k)}\le2<R' F δ − ( ξ k ) − F δ + ( η k ) ≤ ϵ φ ( k ) + ϵ φ ( k ) ≤ 2 < R ′ by Step 4, so ξ k ∈ S δ , R ′ − \xi_{k}\in S^{-}_{\delta,R'} ξ k ∈ S δ , R ′ − and η k ∈ S δ , R ′ + \eta_{k}\in S^{+}_{\delta,R'} η k ∈ S δ , R ′ + by Test Data for a Second-Order Equation Operator on the Lift of the Wasserstein Space and the Admissible Sets §admissible , each of the two serving as the witness required for the other. The shift-coercivity condition provides a nonnegative score bound C C C for F F F at ( δ , R ′ ) (\delta,R') ( δ , R ′ ) , so that
∥ Σ ( L ( Z φ ( k ) ) ) ∥ L ( Z φ ( k ) ) ≤ C , ∥ Σ ( L ( W φ ( k ) ) ) ∥ L ( W φ ( k ) ) ≤ C ( k ∈ N ) . \bigl\lVert\Sigma(\mathcal{L}(Z_{\varphi(k)}))\bigr\rVert_{\mathcal{L}(Z_{\varphi(k)})}\le C,\qquad\bigl\lVert\Sigma(\mathcal{L}(W_{\varphi(k)}))\bigr\rVert_{\mathcal{L}(W_{\varphi(k)})}\le C\qquad(k\in\mathbb{N}). Σ ( L ( Z φ ( k ) )) L ( Z φ ( k ) ) ≤ C , Σ ( L ( W φ ( k ) )) L ( W φ ( k ) ) ≤ C ( k ∈ N ) .
Apply Penalty Pairs with Closed Score §closed with the nonnegative C C C to the sequence whose k k k -th term is Z φ ( k ) Z_{\varphi(k)} Z φ ( k ) , which converges to X ^ \hat{X} X ^ : it gives L ( X ^ ) ∈ D Σ \mathcal{L}(\hat{X})\in\mathcal{D}_{\Sigma} L ( X ^ ) ∈ D Σ , that is X ^ ∈ D Σ Λ \hat{X}\in\mathcal{D}_{\Sigma}^{\Lambda} X ^ ∈ D Σ Λ , and that the sequence whose k k k -th term is Σ ( L ( Z φ ( k ) ) ) ∘ Z φ ( k ) \Sigma(\mathcal{L}(Z_{\varphi(k)}))\circ Z_{\varphi(k)} Σ ( L ( Z φ ( k ) )) ∘ Z φ ( k ) converges weakly to Σ ( L ( X ^ ) ) ∘ X ^ \Sigma(\mathcal{L}(\hat{X}))\circ\hat{X} Σ ( L ( X ^ )) ∘ X ^ . Likewise Y ^ ∈ D Σ Λ \hat{Y}\in\mathcal{D}_{\Sigma}^{\Lambda} Y ^ ∈ D Σ Λ , with the corresponding weak convergence. In particular ξ = ( X ^ , s ∗ , V ∗ , X ∗ ) \xi=(\hat{X},s_{*},V_{*},\mathbb{X}_{*}) ξ = ( X ^ , s ∗ , V ∗ , X ∗ ) and η = ( Y ^ , t ∗ , V ∗ , Y ∗ ) \eta=(\hat{Y},t_{*},V_{*},\mathbb{Y}_{*}) η = ( Y ^ , t ∗ , V ∗ , Y ∗ ) are test data for F F F .
Put R ′ ′ = R ′ + C R''=R'+C R ′′ = R ′ + C , a positive real. Every ξ k \xi_{k} ξ k and η k \eta_{k} η k is R ′ ′ R'' R ′′ -bounded and the displayed scores are at most R ′ ′ R'' R ′′ ; with the convergences of Step 5 this says that the sequence whose k k k -th term is ξ k \xi_{k} ξ k converges to ξ \xi ξ with score bounded by R ′ ′ R'' R ′′ , and likewise that the sequence of the η k \eta_{k} η k converges to η \eta η with score bounded by R ′ ′ R'' R ′′ . The operator F F F is shift-semicontinuous at ( δ , R ′ ′ ) (\delta,R'') ( δ , R ′′ ) . In the first implication of The Shift-Semicontinuity Condition for an Equation Operator on the Lift of the Wasserstein Space §level take c = 0 c=0 c = 0 : given positive ε ∈ R \varepsilon\in\mathbb{R} ε ∈ R , the convergence of the ϵ n \epsilon_{n} ϵ n to 0 0 0 and the strict increase of φ \varphi φ furnish N ∈ N N\in\mathbb{N} N ∈ N with ϵ φ ( k ) ≤ ε \epsilon_{\varphi(k)}\le\varepsilon ϵ φ ( k ) ≤ ε for k ≥ N k\ge N k ≥ N , and then F δ − ( ξ k ) ≤ ϵ φ ( k ) ≤ 0 + ε F^{-}_{\delta}(\xi_{k})\le\epsilon_{\varphi(k)}\le0+\varepsilon F δ − ( ξ k ) ≤ ϵ φ ( k ) ≤ 0 + ε ; hence F δ − ( ξ ) ≤ 0 F^{-}_{\delta}(\xi)\le0 F δ − ( ξ ) ≤ 0 . The second implication, again with c = 0 c=0 c = 0 , gives 0 ≤ F δ + ( η ) 0\le F^{+}_{\delta}(\eta) 0 ≤ F δ + ( η ) . Therefore
F δ − ( ξ ) − F δ + ( η ) ≤ 0. F^{-}_{\delta}(\xi)-F^{+}_{\delta}(\eta)\ \le\ 0 . F δ − ( ξ ) − F δ + ( η ) ≤ 0.
Step 7. Properness and the structure condition. We have X ^ , Y ^ ∈ D Σ Λ \hat{X},\hat{Y}\in\mathcal{D}_{\Sigma}^{\Lambda} X ^ , Y ^ ∈ D Σ Λ , the pair ( X ^ , Y ^ ) (\hat{X},\hat{Y}) ( X ^ , Y ^ ) is optimally coupled by Step 1, δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ ) ≤ 2 B ≤ R \delta(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|)\le2B\le R δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ ) ≤ 2 B ≤ R , and − R ≤ t ∗ ≤ R -R\le t_{*}\le R − R ≤ t ∗ ≤ R because ∣ t ∗ ∣ ≤ B ≤ R |t_{*}|\le B\le R ∣ t ∗ ∣ ≤ B ≤ R ; the pair ( X ∗ , Y ∗ ) (\mathbb{X}_{*},\mathbb{Y}_{*}) ( X ∗ , Y ∗ ) is admitted at α \alpha α , and V ∗ = α ( X ^ − Y ^ ) V_{*}=\alpha(\hat{X}-\hat{Y}) V ∗ = α ( X ^ − Y ^ ) . Clause 2 of The Second-Order Structure Condition at Optimally Coupled Pairs on the Lift of the Wasserstein Space , applied to the structure pair ( ω 1 , ω 2 ) (\omega_{1},\omega_{2}) ( ω 1 , ω 2 ) at R R R with the value slot t ∗ t_{*} t ∗ , therefore gives
− ω 1 ( α ∥ X ^ − Y ^ ∥ L 2 2 + α − 1 ) − ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) ≤ F δ − ( X ^ , t ∗ , V ∗ , X ∗ ) − F δ + ( η ) . -\omega_{1}\bigl(\alpha\lVert\hat{X}-\hat{Y}\rVert_{L^{2}}^{2}+\alpha^{-1}\bigr)-\omega_{2}\bigl(\delta(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|+1),\alpha\bigr)\ \le\ F^{-}_{\delta}(\hat{X},t_{*},V_{*},\mathbb{X}_{*})-F^{+}_{\delta}(\eta). − ω 1 ( α ∥ X ^ − Y ^ ∥ L 2 2 + α − 1 ) − ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) ≤ F δ − ( X ^ , t ∗ , V ∗ , X ∗ ) − F δ + ( η ) .
By Second-Order Equation Operators on the Lift of the Wasserstein Space and Their Delta-Shifts §shifted , F δ − ( X ^ , s , V ∗ , X ∗ ) = F ( X ^ , s + δ E ( μ ^ ) , V ∗ + δ Σ ( μ ^ ) ∘ X ^ , X ∗ ) F^{-}_{\delta}(\hat{X},s,V_{*},\mathbb{X}_{*})=F(\hat{X},s+\delta\mathcal{E}(\hat{\mu}),V_{*}+\delta\,\Sigma(\hat{\mu})\circ\hat{X},\mathbb{X}_{*}) F δ − ( X ^ , s , V ∗ , X ∗ ) = F ( X ^ , s + δ E ( μ ^ ) , V ∗ + δ Σ ( μ ^ ) ∘ X ^ , X ∗ ) for every s ∈ R s\in\mathbb{R} s ∈ R . From 0 ≤ M ( δ , α ) ≤ s ∗ − t ∗ 0\le M(\delta,\alpha)\le s_{*}-t_{*} 0 ≤ M ( δ , α ) ≤ s ∗ − t ∗ we get t ∗ ≤ s ∗ t_{*}\le s_{*} t ∗ ≤ s ∗ , and ∣ s ∗ + δ E ( μ ^ ) ∣ ≤ B + B = 2 B ≤ R |s_{*}+\delta\mathcal{E}(\hat{\mu})|\le B+B=2B\le R ∣ s ∗ + δ E ( μ ^ ) ∣ ≤ B + B = 2 B ≤ R , likewise with t ∗ t_{*} t ∗ in place of s ∗ s_{*} s ∗ . Hence Locally Strictly Proper Second-Order Equation Operator on the Lift of the Wasserstein Space §constant , applied to the properness constant λ \lambda λ at R R R with the two value slots t ∗ + δ E ( μ ^ ) ≤ s ∗ + δ E ( μ ^ ) t_{*}+\delta\mathcal{E}(\hat{\mu})\le s_{*}+\delta\mathcal{E}(\hat{\mu}) t ∗ + δ E ( μ ^ ) ≤ s ∗ + δ E ( μ ^ ) ,
λ ( s ∗ − t ∗ ) ≤ F δ − ( ξ ) − F δ − ( X ^ , t ∗ , V ∗ , X ∗ ) . \lambda\,(s_{*}-t_{*})\ \le\ F^{-}_{\delta}(\xi)-F^{-}_{\delta}(\hat{X},t_{*},V_{*},\mathbb{X}_{*}). λ ( s ∗ − t ∗ ) ≤ F δ − ( ξ ) − F δ − ( X ^ , t ∗ , V ∗ , X ∗ ) .
Adding the two displays and using F δ − ( ξ ) − F δ + ( η ) ≤ 0 F^{-}_{\delta}(\xi)-F^{+}_{\delta}(\eta)\le0 F δ − ( ξ ) − F δ + ( η ) ≤ 0 ,
λ ( s ∗ − t ∗ ) ≤ ω 1 ( α ∥ X ^ − Y ^ ∥ L 2 2 + α − 1 ) + ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) . \lambda\,(s_{*}-t_{*})\ \le\ \omega_{1}\bigl(\alpha\lVert\hat{X}-\hat{Y}\rVert_{L^{2}}^{2}+\alpha^{-1}\bigr)+\omega_{2}\bigl(\delta(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|+1),\alpha\bigr). λ ( s ∗ − t ∗ ) ≤ ω 1 ( α ∥ X ^ − Y ^ ∥ L 2 2 + α − 1 ) + ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) .
Finally M ( δ , α ) ≤ s ∗ − t ∗ M(\delta,\alpha)\le s_{*}-t_{*} M ( δ , α ) ≤ s ∗ − t ∗ and 0 < λ 0<\lambda 0 < λ give λ M ( δ , α ) ≤ λ ( s ∗ − t ∗ ) \lambda M(\delta,\alpha)\le\lambda(s_{*}-t_{*}) λ M ( δ , α ) ≤ λ ( s ∗ − t ∗ ) by claim 5 of Elementary Arithmetic in an Ordered Field , and ∥ X ^ − Y ^ ∥ L 2 2 = W 2 ( μ ^ , ν ^ ) 2 \lVert\hat{X}-\hat{Y}\rVert_{L^{2}}^{2}=W_{2}(\hat{\mu},\hat{\nu})^{2} ∥ X ^ − Y ^ ∥ L 2 2 = W 2 ( μ ^ , ν ^ ) 2 . This is the asserted estimate.