Each result cited is universally quantified over the data in its own statement.
Preliminaries. By The Constant Tuple on L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) : Coordinates, Projection, Tail Form, and Translation-Closed Preimages (ii) the tuple γ \gamma γ is orthonormal, so Coordinate Maps of a Finite Orthonormal Tuple: Forms, the Tail Form, and Quadratic Test Functions and Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple apply to it as described in the statement. By The Constant Tuple on L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) : Coordinates, Projection, Tail Form, and Translation-Closed Preimages (iii) the map Λ ♯ \Lambda^{\sharp} Λ ♯ determined by γ \gamma γ satisfies Λ ♯ a = c a \Lambda^{\sharp}a=c_{a} Λ ♯ a = c a for every a ∈ R d a\in\mathbb{R}^{d} a ∈ R d . By Translations on a Space of Square-Integrable Random Vectors: Constant Classes, Law Invariance, the Translation Derivative and the Translation Hessian (i) we have, for all a , b ∈ R d a,b\in\mathbb{R}^{d} a , b ∈ R d and every t ∈ R t\in\mathbb{R} t ∈ R ,
c a + c b = c a + b , t c a = c t a , ∥ c a ∥ L 2 = ∥ a ∥ , c_{a}+c_{b}=c_{a+b},\qquad t\,c_{a}=c_{ta},\qquad\lVert c_{a}\rVert_{L^{2}}=\lVert a\rVert, c a + c b = c a + b , t c a = c t a , ∥ c a ∥ L 2 = ∥ a ∥ ,
and for each Z ∈ L 2 ( Ω ; R d ) Z\in L^{2}(\Omega;\mathbb{R}^{d}) Z ∈ L 2 ( Ω ; R d ) the map J Z : R d → L 2 ( Ω ; R d ) J_{Z}:\mathbb{R}^{d}\to L^{2}(\Omega;\mathbb{R}^{d}) J Z : R d → L 2 ( Ω ; R d ) with J Z ( a ) = Z + c a J_{Z}(a)=Z+c_{a} J Z ( a ) = Z + c a is continuous and satisfies J Z ( 0 R d ) = Z J_{Z}(0_{\mathbb{R}^{d}})=Z J Z ( 0 R d ) = Z . Taking t = − 1 t=-1 t = − 1 in the second identity and then using the first, c z − c w = c z + c − w = c z − w c_{z}-c_{w}=c_{z}+c_{-w}=c_{z-w} c z − c w = c z + c − w = c z − w for all z , w ∈ R d z,w\in\mathbb{R}^{d} z , w ∈ R d , the identity z − w = z + ( − 1 ) w z-w=z+(-1)w z − w = z + ( − 1 ) w in R d \mathbb{R}^{d} R d being that of Euclidean Space R n \mathbb{R}^n R n is a Real Vector Space ; hence ∥ c z − c w ∥ L 2 = ∥ z − w ∥ \lVert c_{z}-c_{w}\rVert_{L^{2}}=\lVert z-w\rVert ∥ c z − c w ∥ L 2 = ∥ z − w ∥ . Finally ∥ e i ∥ = 1 \lVert e_{i}\rVert=1 ∥ e i ∥ = 1 for i ∈ [ d ] i\in[d] i ∈ [ d ] by Euclidean Space and Real Matrices: Standing Notation (vi) , so ∥ c e i ∥ L 2 = 1 \lVert c_{e_{i}}\rVert_{L^{2}}=1 ∥ c e i ∥ L 2 = 1 .
Proof of clause 1. Let Φ ∈ C 2 ( L 2 ( Ω ; R d ) ) \Phi\in C^{2}(L^{2}(\Omega;\mathbb{R}^{d})) Φ ∈ C 2 ( L 2 ( Ω ; R d )) . By The Classes C 1 C^1 C 1 and C 2 C^2 C 2 on an Open Subset of a Real Inner Product Space (ii) the function Φ \Phi Φ is of class C 1 C^{1} C 1 , has a second derivative at every point, and its Hessian map is continuous into ( S y m , d S y m ) (\mathrm{Sym},d_{\mathrm{Sym}}) ( Sym , d Sym ) . The first of these is property (a) of Lifted Test Functions on the Space of Square-Integrable Random Vectors and Their Translation Hessians (i) .
Fix Z ∈ L 2 ( Ω ; R d ) Z\in L^{2}(\Omega;\mathbb{R}^{d}) Z ∈ L 2 ( Ω ; R d ) and write ϕ = ϕ Z \phi=\phi_{Z} ϕ = ϕ Z for the function ϕ ( a ) = Φ ( Z + c a ) \phi(a)=\Phi(Z+c_{a}) ϕ ( a ) = Φ ( Z + c a ) on R d \mathbb{R}^{d} R d . By Translations on a Space of Square-Integrable Random Vectors: Constant Classes, Law Invariance, the Translation Derivative and the Translation Hessian (iii) the function ϕ \phi ϕ is of class C 1 C^{1} C 1 on R d \mathbb{R}^{d} R d and
∂ i ϕ ( a ) = ⟨ D Φ ( Z + c a ) , c e i ⟩ L 2 ( a ∈ R d , i ∈ [ d ] ) . \partial_{i}\phi(a)=\bigl\langle D\Phi(Z+c_{a}),c_{e_{i}}\bigr\rangle_{L^{2}}\qquad(a\in\mathbb{R}^{d},\ i\in[d]). ∂ i ϕ ( a ) = ⟨ D Φ ( Z + c a ) , c e i ⟩ L 2 ( a ∈ R d , i ∈ [ d ]) .
The second partial derivatives. Fix i , j ∈ [ d ] i,j\in[d] i , j ∈ [ d ] and a ∈ R d a\in\mathbb{R}^{d} a ∈ R d , and write x = Z + c a x=Z+c_{a} x = Z + c a and b = D 2 Φ ( x ) ∈ S y m b=D^{2}\Phi(x)\in\mathrm{Sym} b = D 2 Φ ( x ) ∈ Sym . Let ε ∈ R \varepsilon\in\mathbb{R} ε ∈ R be positive. Since L 2 ( Ω ; R d ) L^{2}(\Omega;\mathbb{R}^{d}) L 2 ( Ω ; R d ) is open in itself and Φ \Phi Φ is differentiable at every one of its points, The Second Derivative and the Hessian on an Open Subset of a Real Inner Product Space (i) provides a positive ρ ∈ R \rho\in\mathbb{R} ρ ∈ R such that all W , Y ∈ L 2 ( Ω ; R d ) W,Y\in L^{2}(\Omega;\mathbb{R}^{d}) W , Y ∈ L 2 ( Ω ; R d ) with ∥ W ∥ L 2 < ρ \lVert W\rVert_{L^{2}}<\rho ∥ W ∥ L 2 < ρ satisfy
∣ ⟨ D Φ ( x + W ) − D Φ ( x ) , Y ⟩ L 2 − b ( W , Y ) ∣ ≤ ε ∥ W ∥ L 2 ∥ Y ∥ L 2 . \bigl|\bigl\langle D\Phi(x+W)-D\Phi(x),Y\bigr\rangle_{L^{2}}-b(W,Y)\bigr|\ \le\ \varepsilon\,\lVert W\rVert_{L^{2}}\lVert Y\rVert_{L^{2}} . ⟨ D Φ ( x + W ) − D Φ ( x ) , Y ⟩ L 2 − b ( W , Y ) ≤ ε ∥ W ∥ L 2 ∥ Y ∥ L 2 .
Let s ∈ R s\in\mathbb{R} s ∈ R satisfy 0 < ∣ s ∣ < ρ 0<|s|<\rho 0 < ∣ s ∣ < ρ and put W = c s e j W=c_{s e_{j}} W = c s e j and Y = c e i Y=c_{e_{i}} Y = c e i . Then ∥ W ∥ L 2 = ∥ s e j ∥ = ∣ s ∣ ∥ e j ∥ = ∣ s ∣ < ρ \lVert W\rVert_{L^{2}}=\lVert s e_{j}\rVert=|s|\,\lVert e_{j}\rVert=|s|<\rho ∥ W ∥ L 2 = ∥ s e j ∥ = ∣ s ∣ ∥ e j ∥ = ∣ s ∣ < ρ by claim 5 of Properties of the Euclidean Norm on R n \mathbb{R}^n R n : Square, Distance, Vanishing, Coordinate Bounds, Homogeneity, Triangle Inequalities and Expansion of a Square , and ∥ Y ∥ L 2 = 1 \lVert Y\rVert_{L^{2}}=1 ∥ Y ∥ L 2 = 1 . Moreover x + W = Z + c a + c s e j = Z + c a + s e j x+W=Z+c_{a}+c_{se_{j}}=Z+c_{a+se_{j}} x + W = Z + c a + c s e j = Z + c a + s e j , so that by the formula for ∂ i ϕ \partial_{i}\phi ∂ i ϕ displayed above and by Elementary Identities in a Real Inner Product Space (i) ,
⟨ D Φ ( x + W ) − D Φ ( x ) , c e i ⟩ L 2 = ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) . \bigl\langle D\Phi(x+W)-D\Phi(x),c_{e_{i}}\bigr\rangle_{L^{2}}=\partial_{i}\phi(a+se_{j})-\partial_{i}\phi(a). ⟨ D Φ ( x + W ) − D Φ ( x ) , c e i ⟩ L 2 = ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) .
Also W = c s e j = s c e j W=c_{se_{j}}=s\,c_{e_{j}} W = c s e j = s c e j , so b ( W , Y ) = s b ( c e j , c e i ) b(W,Y)=s\,b(c_{e_{j}},c_{e_{i}}) b ( W , Y ) = s b ( c e j , c e i ) by the homogeneity of b b b in its first argument, Bounded Symmetric Bilinear Forms on a Real Inner Product Space: Norm, Order, Identity Form and Restriction (i) . The displayed estimate therefore reads
∣ ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) − s b ( c e j , c e i ) ∣ ≤ ε ∣ s ∣ , \bigl|\partial_{i}\phi(a+se_{j})-\partial_{i}\phi(a)-s\,b(c_{e_{j}},c_{e_{i}})\bigr|\ \le\ \varepsilon\,|s| , ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) − s b ( c e j , c e i ) ≤ ε ∣ s ∣ ,
and dividing by the positive number ∣ s ∣ |s| ∣ s ∣ (claims 4 and 5 of Elementary Arithmetic in an Ordered Field ) and using claim 4 of Properties of the Absolute Value in an Ordered Field ,
∣ ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) s − b ( c e j , c e i ) ∣ ≤ ε whenever 0 < ∣ s ∣ < ρ . \left|\frac{\partial_{i}\phi(a+se_{j})-\partial_{i}\phi(a)}{s}-b(c_{e_{j}},c_{e_{i}})\right|\ \le\ \varepsilon\qquad\text{whenever }0<|s|<\rho . s ∂ i ϕ ( a + s e j ) − ∂ i ϕ ( a ) − b ( c e j , c e i ) ≤ ε whenever 0 < ∣ s ∣ < ρ .
Here ε \varepsilon ε was an arbitrary positive real number; applying what precedes to ε 2 \tfrac{\varepsilon}{2} 2 ε , which is positive and satisfies ε 2 < ε \tfrac{\varepsilon}{2}<\varepsilon 2 ε < ε by claim 8 of Elementary Order Arithmetic in an Ordered Field , we obtain for every positive ε \varepsilon ε a positive ρ \rho ρ such that the left-hand side above is strictly less than ε \varepsilon ε whenever 0 < ∣ s ∣ < ρ 0<|s|<\rho 0 < ∣ s ∣ < ρ . That is the statement that the limit defining the partial derivative of ∂ i ϕ \partial_{i}\phi ∂ i ϕ with respect to the j j j th variable at a a a exists and equals b ( c e j , c e i ) b(c_{e_{j}},c_{e_{i}}) b ( c e j , c e i ) . In the notation of clause 4 of Functions of Class Cᵏ on an Open Subset of ℝⁿ ,
∂ j ∂ i ϕ ( a ) = ( D 2 Φ ( Z + c a ) ) ( c e j , c e i ) = ( ( D 2 Φ ( Z + c a ) ) ♭ ) j i \partial_{j}\partial_{i}\phi(a)=\bigl(D^{2}\Phi(Z+c_{a})\bigr)(c_{e_{j}},c_{e_{i}})=\Bigl(\bigl(D^{2}\Phi(Z+c_{a})\bigr)^{\flat}\Bigr)_{ji} ∂ j ∂ i ϕ ( a ) = ( D 2 Φ ( Z + c a ) ) ( c e j , c e i ) = ( ( D 2 Φ ( Z + c a ) ) ♭ ) ji
by Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple (i) , the j j j th and i i i th components of γ \gamma γ being c e j c_{e_{j}} c e j and c e i c_{e_{i}} c e i .
Continuity. The map a ↦ Z + c a a\mapsto Z+c_{a} a ↦ Z + c a is continuous, being J Z J_{Z} J Z ; the Hessian map D 2 Φ D^{2}\Phi D 2 Φ is continuous into ( S y m , d S y m ) (\mathrm{Sym},d_{\mathrm{Sym}}) ( Sym , d Sym ) ; and the map S y m → R \mathrm{Sym}\to\mathbb{R} Sym → R with value c ( c e j , c e i ) c(c_{e_{j}},c_{e_{i}}) c ( c e j , c e i ) at c c c is continuous, since ∣ c ( c e j , c e i ) − c ′ ( c e j , c e i ) ∣ ≤ ∥ c − c ′ ∥ |c(c_{e_{j}},c_{e_{i}})-c'(c_{e_{j}},c_{e_{i}})|\le\lVert c-c'\rVert ∣ c ( c e j , c e i ) − c ′ ( c e j , c e i ) ∣ ≤ ∥ c − c ′ ∥ for c , c ′ ∈ S y m c,c'\in\mathrm{Sym} c , c ′ ∈ Sym by Elementary Properties of Bounded Symmetric Bilinear Forms: Norm, Quadratic Form, Order and Continuity (ix) together with ∥ c e j ∥ L 2 = ∥ c e i ∥ L 2 = 1 \lVert c_{e_{j}}\rVert_{L^{2}}=\lVert c_{e_{i}}\rVert_{L^{2}}=1 ∥ c e j ∥ L 2 = ∥ c e i ∥ L 2 = 1 . By claim 3 of Semicontinuity and Continuity Under Composition with a Continuous Map , applied twice, the composite a ↦ ∂ j ∂ i ϕ ( a ) a\mapsto\partial_{j}\partial_{i}\phi(a) a ↦ ∂ j ∂ i ϕ ( a ) is continuous at every point of R d \mathbb{R}^{d} R d .
Conclusion of clause 1. Each ∂ i ϕ \partial_{i}\phi ∂ i ϕ is continuous at every point of R d \mathbb{R}^{d} R d , because ϕ \phi ϕ is of class C 1 C^{1} C 1 (clause 1 of Functions of Class Cᵏ on an Open Subset of ℝⁿ ), and by the two paragraphs above each of its partial derivatives exists at every point and is continuous there. Hence each ∂ i ϕ \partial_{i}\phi ∂ i ϕ is of class C 1 C^{1} C 1 on R d \mathbb{R}^{d} R d , and ϕ \phi ϕ is of class C 2 C^{2} C 2 on R d \mathbb{R}^{d} R d by clauses 2 and 3 of Functions of Class Cᵏ on an Open Subset of ℝⁿ . As Z Z Z was arbitrary, Φ \Phi Φ is twice continuously differentiable along translations at every point, that is twice continuously differentiable along translations , which is property (b) of Lifted Test Functions on the Space of Square-Integrable Random Vectors and Their Translation Hessians (i) . So Φ \Phi Φ is a lifted test function.
Finally, by Lifted Test Functions on the Space of Square-Integrable Random Vectors and Their Translation Hessians (ii) and The Hessian Matrix of a Function of Class C² the entry of H Φ ( Z ) = D 2 ϕ Z ( 0 R d ) H_{\Phi}(Z)=D^{2}\phi_{Z}(0_{\mathbb{R}^{d}}) H Φ ( Z ) = D 2 ϕ Z ( 0 R d ) in row i i i and column j j j is ∂ i ∂ j ϕ ( 0 R d ) \partial_{i}\partial_{j}\phi(0_{\mathbb{R}^{d}}) ∂ i ∂ j ϕ ( 0 R d ) . Applying the computation above with the roles of i i i and j j j exchanged and with a = 0 R d a=0_{\mathbb{R}^{d}} a = 0 R d , so that Z + c 0 R d = Z Z+c_{0_{\mathbb{R}^{d}}}=Z Z + c 0 R d = Z by Translations on a Space of Square-Integrable Random Vectors: Constant Classes, Law Invariance, the Translation Derivative and the Translation Hessian (i) , this entry equals ( ( D 2 Φ ( Z ) ) ♭ ) i j \bigl((D^{2}\Phi(Z))^{\flat}\bigr)_{ij} ( ( D 2 Φ ( Z ) ) ♭ ) ij . Two real d × d d\times d d × d matrices with the same entries are equal by Real Matrices: the Set of Real m x n Matrices with Their Entrywise Operations , so H Φ ( Z ) = ( D 2 Φ ( Z ) ) ♭ H_{\Phi}(Z)=(D^{2}\Phi(Z))^{\flat} H Φ ( Z ) = ( D 2 Φ ( Z ) ) ♭ .
Proof of clause 2. Assume the quadruple is approximable by test data from above and let ε ∈ R \varepsilon\in\mathbb{R} ε ∈ R be positive. By Quadruple Approximable by Test Data on a Subset of a Real Inner Product Space (i) there are Y ∈ A Y\in A Y ∈ A and φ ∈ C 2 ( L 2 ( Ω ; R d ) ) \varphi\in C^{2}(L^{2}(\Omega;\mathbb{R}^{d})) φ ∈ C 2 ( L 2 ( Ω ; R d )) such that w − φ w-\varphi w − φ has a local maximum at Y Y Y relative to A A A and
∥ Y − X ˉ ∥ L 2 < ε , ∣ w ( Y ) − w ( X ˉ ) ∣ < ε , ∥ D φ ( Y ) − p ∥ L 2 < ε , ∥ D 2 φ ( Y ) − B ∥ < ε . \lVert Y-\bar{X}\rVert_{L^{2}}<\varepsilon,\quad\bigl|w(Y)-w(\bar{X})\bigr|<\varepsilon,\quad\lVert D\varphi(Y)-p\rVert_{L^{2}}<\varepsilon,\quad\bigl\lVert D^{2}\varphi(Y)-\mathbb{B}\bigr\rVert<\varepsilon . ∥ Y − X ˉ ∥ L 2 < ε , w ( Y ) − w ( X ˉ ) < ε , ∥ D φ ( Y ) − p ∥ L 2 < ε , D 2 φ ( Y ) − B < ε .
By clause 1 the function Φ = φ \Phi=\varphi Φ = φ is a lifted test function with H φ ( Y ) = ( D 2 φ ( Y ) ) ♭ H_{\varphi}(Y)=(D^{2}\varphi(Y))^{\flat} H φ ( Y ) = ( D 2 φ ( Y ) ) ♭ . By Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple (ii) , applied to the sum of D 2 φ ( Y ) − B D^{2}\varphi(Y)-\mathbb{B} D 2 φ ( Y ) − B and B \mathbb{B} B and to the scalar multiple of B \mathbb{B} B by − 1 -1 − 1 ,
( D 2 φ ( Y ) ) ♭ − B ♭ = ( D 2 φ ( Y ) − B ) ♭ , ∥ ( D 2 φ ( Y ) − B ) ♭ ∥ ≤ ∥ D 2 φ ( Y ) − B ∥ < ε , \bigl(D^{2}\varphi(Y)\bigr)^{\flat}-\mathbb{B}^{\flat}=\bigl(D^{2}\varphi(Y)-\mathbb{B}\bigr)^{\flat},
\qquad
\bigl\lVert\bigl(D^{2}\varphi(Y)-\mathbb{B}\bigr)^{\flat}\bigr\rVert\le\bigl\lVert D^{2}\varphi(Y)-\mathbb{B}\bigr\rVert<\varepsilon , ( D 2 φ ( Y ) ) ♭ − B ♭ = ( D 2 φ ( Y ) − B ) ♭ , ( D 2 φ ( Y ) − B ) ♭ ≤ D 2 φ ( Y ) − B < ε ,
the differences of matrices and of forms being those of Euclidean Space and Real Matrices: Standing Notation (ii) and Bounded Symmetric Bilinear Forms on a Real Inner Product Space: Norm, Order, Identity Form and Restriction (iv) . The four displayed inequalities of the clause therefore hold with Φ = φ \Phi=\varphi Φ = φ . The case from below is the same argument with Quadruple Approximable by Test Data on a Subset of a Real Inner Product Space (ii) and a local minimum in place of a local maximum.
Proof of clause 3. We prove (a); part (b) is the same argument with − g -g − g in place of g g g , with Quadruple Approximable by Test Data on a Subset of a Real Inner Product Space (ii) in place of Quadruple Approximable by Test Data on a Subset of a Real Inner Product Space (i) , and with local minima in place of local maxima.
By Affine and Quadratic Functions on a Real Hilbert Space are of Class C 2 C^2 C 2 (iii) , read with 2 μ 2\mu 2 μ in place of the number written α \alpha α there and with q q q in place of y 0 y_{0} y 0 , the function g g g , whose value at Z Z Z is 2 μ 2 ∥ Z − q ∥ L 2 2 \tfrac{2\mu}{2}\lVert Z-q\rVert_{L^{2}}^{2} 2 2 μ ∥ Z − q ∥ L 2 2 , belongs to C 2 ( L 2 ( Ω ; R d ) ) C^{2}(L^{2}(\Omega;\mathbb{R}^{d})) C 2 ( L 2 ( Ω ; R d )) with D g ( Z ) = 2 μ ( Z − q ) Dg(Z)=2\mu(Z-q) D g ( Z ) = 2 μ ( Z − q ) and D 2 g ( Z ) = 2 μ I D^{2}g(Z)=2\mu I D 2 g ( Z ) = 2 μ I for every Z Z Z .
Let ε ∈ R \varepsilon\in\mathbb{R} ε ∈ R be positive and choose a positive ε ′ ∈ R \varepsilon'\in\mathbb{R} ε ′ ∈ R with
ε ′ ≤ 1 , ε ′ ≤ ε , ( 1 + 2 ∣ μ ∣ ) ε ′ ≤ ε , ε ′ + ∣ μ ∣ ε ′ ( 2 ∥ X ˉ − q ∥ L 2 + 1 ) ≤ ε , \varepsilon'\le1,\qquad\varepsilon'\le\varepsilon,\qquad(1+2|\mu|)\,\varepsilon'\le\varepsilon,\qquad\varepsilon'+|\mu|\,\varepsilon'\bigl(2\lVert\bar{X}-q\rVert_{L^{2}}+1\bigr)\le\varepsilon , ε ′ ≤ 1 , ε ′ ≤ ε , ( 1 + 2∣ μ ∣ ) ε ′ ≤ ε , ε ′ + ∣ μ ∣ ε ′ ( 2 ∥ X ˉ − q ∥ L 2 + 1 ) ≤ ε ,
which is possible because each of the four right-hand sides is positive and each left-hand side is a nonnegative multiple of ε ′ \varepsilon' ε ′ (claim 9 of Elementary Order Arithmetic in an Ordered Field selects the least of four positive candidates). By Quadruple Approximable by Test Data on a Subset of a Real Inner Product Space (i) applied to w − g w-g w − g with ε ′ \varepsilon' ε ′ there are Y ∈ A Y\in A Y ∈ A and φ ∈ C 2 ( L 2 ( Ω ; R d ) ) \varphi\in C^{2}(L^{2}(\Omega;\mathbb{R}^{d})) φ ∈ C 2 ( L 2 ( Ω ; R d )) such that ( w − g ) − φ (w-g)-\varphi ( w − g ) − φ has a local maximum at Y Y Y relative to A A A and
∥ Y − X ˉ ∥ L 2 < ε ′ , ∣ ( w − g ) ( Y ) − ( w − g ) ( X ˉ ) ∣ < ε ′ , ∥ D φ ( Y ) − p ∥ L 2 < ε ′ , ∥ D 2 φ ( Y ) − B ∥ < ε ′ . \lVert Y-\bar{X}\rVert_{L^{2}}<\varepsilon',\quad\bigl|(w-g)(Y)-(w-g)(\bar{X})\bigr|<\varepsilon',\quad\lVert D\varphi(Y)-p\rVert_{L^{2}}<\varepsilon',\quad\bigl\lVert D^{2}\varphi(Y)-\mathbb{B}\bigr\rVert<\varepsilon' . ∥ Y − X ˉ ∥ L 2 < ε ′ , ( w − g ) ( Y ) − ( w − g ) ( X ˉ ) < ε ′ , ∥ D φ ( Y ) − p ∥ L 2 < ε ′ , D 2 φ ( Y ) − B < ε ′ .
Put ψ = φ + g \psi=\varphi+g ψ = φ + g . By Constants, Sums, Scalar Multiples and Differences of Differentiable Functions on an Open Subset of a Real Inner Product Space (ii) , ψ ∈ C 2 ( L 2 ( Ω ; R d ) ) \psi\in C^{2}(L^{2}(\Omega;\mathbb{R}^{d})) ψ ∈ C 2 ( L 2 ( Ω ; R d )) with D ψ ( Y ) = D φ ( Y ) + 2 μ ( Y − q ) D\psi(Y)=D\varphi(Y)+2\mu(Y-q) D ψ ( Y ) = D φ ( Y ) + 2 μ ( Y − q ) and D 2 ψ ( Y ) = D 2 φ ( Y ) + 2 μ I D^{2}\psi(Y)=D^{2}\varphi(Y)+2\mu I D 2 ψ ( Y ) = D 2 φ ( Y ) + 2 μ I . The value of w − ψ w-\psi w − ψ at Z ∈ A Z\in A Z ∈ A is ( w ( Z ) − g ( Z ) ) − φ ( Z ) (w(Z)-g(Z))-\varphi(Z) ( w ( Z ) − g ( Z )) − φ ( Z ) , that is the value of ( w − g ) − φ (w-g)-\varphi ( w − g ) − φ at Z Z Z ; hence w − ψ w-\psi w − ψ has a local maximum at Y Y Y relative to A A A .
It remains to bound the four quantities. First ∥ Y − X ˉ ∥ L 2 < ε ′ ≤ ε \lVert Y-\bar{X}\rVert_{L^{2}}<\varepsilon'\le\varepsilon ∥ Y − X ˉ ∥ L 2 < ε ′ ≤ ε . Secondly, write s = ∥ Y − q ∥ L 2 s=\lVert Y-q\rVert_{L^{2}} s = ∥ Y − q ∥ L 2 and t = ∥ X ˉ − q ∥ L 2 t=\lVert\bar{X}-q\rVert_{L^{2}} t = ∥ X ˉ − q ∥ L 2 . By The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity (ii) , ∣ s − t ∣ ≤ ∥ Y − X ˉ ∥ L 2 < ε ′ |s-t|\le\lVert Y-\bar{X}\rVert_{L^{2}}<\varepsilon' ∣ s − t ∣ ≤ ∥ Y − X ˉ ∥ L 2 < ε ′ , so s ≤ t + ε ′ s\le t+\varepsilon' s ≤ t + ε ′ and s + t ≤ 2 t + ε ′ ≤ 2 t + 1 s+t\le2t+\varepsilon'\le2t+1 s + t ≤ 2 t + ε ′ ≤ 2 t + 1 by claim 3 of Properties of the Absolute Value in an Ordered Field and ε ′ ≤ 1 \varepsilon'\le1 ε ′ ≤ 1 ; therefore, by claim 4 of Properties of the Absolute Value in an Ordered Field and the identity s 2 − t 2 = ( s − t ) ( s + t ) s^{2}-t^{2}=(s-t)(s+t) s 2 − t 2 = ( s − t ) ( s + t ) of claim 4 of Zero Products and Elementary Identities in a Field ,
∣ g ( Y ) − g ( X ˉ ) ∣ = ∣ μ ∣ ∣ s − t ∣ ( s + t ) ≤ ∣ μ ∣ ε ′ ( 2 t + 1 ) , \bigl|g(Y)-g(\bar{X})\bigr|=|\mu|\,|s-t|\,(s+t)\le|\mu|\,\varepsilon'\,(2t+1), g ( Y ) − g ( X ˉ ) = ∣ μ ∣ ∣ s − t ∣ ( s + t ) ≤ ∣ μ ∣ ε ′ ( 2 t + 1 ) ,
the factors ∣ s − t ∣ |s-t| ∣ s − t ∣ and s + t s+t s + t being nonnegative (claim 5 of Elementary Arithmetic in an Ordered Field ). Since w ( Z ) = ( w − g ) ( Z ) + g ( Z ) w(Z)=(w-g)(Z)+g(Z) w ( Z ) = ( w − g ) ( Z ) + g ( Z ) for Z ∈ A Z\in A Z ∈ A , claim 5 of Properties of the Absolute Value in an Ordered Field gives
∣ w ( Y ) − w ( X ˉ ) ∣ ≤ ∣ ( w − g ) ( Y ) − ( w − g ) ( X ˉ ) ∣ + ∣ g ( Y ) − g ( X ˉ ) ∣ < ε ′ + ∣ μ ∣ ε ′ ( 2 ∥ X ˉ − q ∥ L 2 + 1 ) ≤ ε . \bigl|w(Y)-w(\bar{X})\bigr|\le\bigl|(w-g)(Y)-(w-g)(\bar{X})\bigr|+\bigl|g(Y)-g(\bar{X})\bigr|<\varepsilon'+|\mu|\,\varepsilon'\,\bigl(2\lVert\bar{X}-q\rVert_{L^{2}}+1\bigr)\le\varepsilon . w ( Y ) − w ( X ˉ ) ≤ ( w − g ) ( Y ) − ( w − g ) ( X ˉ ) + g ( Y ) − g ( X ˉ ) < ε ′ + ∣ μ ∣ ε ′ ( 2 ∥ X ˉ − q ∥ L 2 + 1 ) ≤ ε .
Thirdly, D ψ ( Y ) − ( p + 2 μ ( X ˉ − q ) ) = ( D φ ( Y ) − p ) + 2 μ ( Y − X ˉ ) D\psi(Y)-\bigl(p+2\mu(\bar{X}-q)\bigr)=\bigl(D\varphi(Y)-p\bigr)+2\mu\,(Y-\bar{X}) D ψ ( Y ) − ( p + 2 μ ( X ˉ − q ) ) = ( D φ ( Y ) − p ) + 2 μ ( Y − X ˉ ) , so by The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity (i) and Elementary Identities in a Real Inner Product Space (iv) ,
∥ D ψ ( Y ) − ( p + 2 μ ( X ˉ − q ) ) ∥ L 2 ≤ ∥ D φ ( Y ) − p ∥ L 2 + 2 ∣ μ ∣ ∥ Y − X ˉ ∥ L 2 < ( 1 + 2 ∣ μ ∣ ) ε ′ ≤ ε . \bigl\lVert D\psi(Y)-\bigl(p+2\mu(\bar{X}-q)\bigr)\bigr\rVert_{L^{2}}\le\lVert D\varphi(Y)-p\rVert_{L^{2}}+2|\mu|\,\lVert Y-\bar{X}\rVert_{L^{2}}<(1+2|\mu|)\,\varepsilon'\le\varepsilon . D ψ ( Y ) − ( p + 2 μ ( X ˉ − q ) ) L 2 ≤ ∥ D φ ( Y ) − p ∥ L 2 + 2∣ μ ∣ ∥ Y − X ˉ ∥ L 2 < ( 1 + 2∣ μ ∣ ) ε ′ ≤ ε .
Fourthly, D 2 ψ ( Y ) − ( B + 2 μ I ) = D 2 φ ( Y ) − B D^{2}\psi(Y)-(\mathbb{B}+2\mu I)=D^{2}\varphi(Y)-\mathbb{B} D 2 ψ ( Y ) − ( B + 2 μ I ) = D 2 φ ( Y ) − B by Bounded Symmetric Bilinear Forms on a Real Inner Product Space: Norm, Order, Identity Form and Restriction (iv) , so its norm is less than ε ′ ≤ ε \varepsilon'\le\varepsilon ε ′ ≤ ε . Finally the value recorded by the quadruple is correct, since ( w − g ) ( X ˉ ) + g ( X ˉ ) = w ( X ˉ ) (w-g)(\bar{X})+g(\bar{X})=w(\bar{X}) ( w − g ) ( X ˉ ) + g ( X ˉ ) = w ( X ˉ ) . As ε \varepsilon ε was an arbitrary positive real number, ( X ˉ , w ( X ˉ ) , p + 2 μ ( X ˉ − q ) , B + 2 μ I ) \bigl(\bar{X},w(\bar{X}),p+2\mu(\bar{X}-q),\mathbb{B}+2\mu I\bigr) ( X ˉ , w ( X ˉ ) , p + 2 μ ( X ˉ − q ) , B + 2 μ I ) is approximable by test data from above for w w w on A A A .
Proof of clause 4. Let z , w ∈ R d z,w\in\mathbb{R}^{d} z , w ∈ R d . By Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple (i) and Λ ♯ a = c a \Lambda^{\sharp}a=c_{a} Λ ♯ a = c a ,
z ⋅ ( X ♭ z ) = X ( c z , c z ) , w ⋅ ( Y ♭ w ) = Y ( c w , c w ) . z\cdot\bigl(\mathbb{X}^{\flat}z\bigr)=\mathbb{X}(c_{z},c_{z}),\qquad w\cdot\bigl(\mathbb{Y}^{\flat}w\bigr)=\mathbb{Y}(c_{w},c_{w}). z ⋅ ( X ♭ z ) = X ( c z , c z ) , w ⋅ ( Y ♭ w ) = Y ( c w , c w ) .
Applying the hypothesis with Z = c z Z=c_{z} Z = c z and W = c w W=c_{w} W = c w and using ∥ c z ∥ L 2 = ∥ z ∥ \lVert c_{z}\rVert_{L^{2}}=\lVert z\rVert ∥ c z ∥ L 2 = ∥ z ∥ , ∥ c w ∥ L 2 = ∥ w ∥ \lVert c_{w}\rVert_{L^{2}}=\lVert w\rVert ∥ c w ∥ L 2 = ∥ w ∥ and ∥ c z − c w ∥ L 2 = ∥ z − w ∥ \lVert c_{z}-c_{w}\rVert_{L^{2}}=\lVert z-w\rVert ∥ c z − c w ∥ L 2 = ∥ z − w ∥ from the preliminaries,
− 3 α ( ∥ z ∥ 2 + ∥ w ∥ 2 ) ≤ z ⋅ ( X ♭ z ) − w ⋅ ( Y ♭ w ) ≤ 3 α ∥ z − w ∥ 2 . -3\alpha\bigl(\lVert z\rVert^{2}+\lVert w\rVert^{2}\bigr)\ \le\ z\cdot\bigl(\mathbb{X}^{\flat}z\bigr)-w\cdot\bigl(\mathbb{Y}^{\flat}w\bigr)\ \le\ 3\alpha\lVert z-w\rVert^{2}. − 3 α ( ∥ z ∥ 2 + ∥ w ∥ 2 ) ≤ z ⋅ ( X ♭ z ) − w ⋅ ( Y ♭ w ) ≤ 3 α ∥ z − w ∥ 2 .
By Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple (ii) the compression is order-preserving, so X ⪯ Y \mathbb{X}\preceq\mathbb{Y} X ⪯ Y gives X ♭ ⪯ Y ♭ \mathbb{X}^{\flat}\preceq\mathbb{Y}^{\flat} X ♭ ⪯ Y ♭ , and it does not increase the norm, so ∥ X ♭ ∥ ≤ ∥ X ∥ ≤ 6 α \lVert\mathbb{X}^{\flat}\rVert\le\lVert\mathbb{X}\rVert\le6\alpha ∥ X ♭ ∥ ≤ ∥ X ∥ ≤ 6 α and ∥ Y ♭ ∥ ≤ 6 α \lVert\mathbb{Y}^{\flat}\rVert\le6\alpha ∥ Y ♭ ∥ ≤ 6 α by claim 2 of Elementary Order Arithmetic in an Ordered Field . These are exactly the four requirements of The Second-Order Structure Condition at Optimally Coupled Pairs on the Lift of the Wasserstein Space (i) , so ( X ♭ , Y ♭ ) (\mathbb{X}^{\flat},\mathbb{Y}^{\flat}) ( X ♭ , Y ♭ ) is admitted at α \alpha α . The two identities ( X + t N ) ♭ = X ♭ (\mathbb{X}+tN)^{\flat}=\mathbb{X}^{\flat} ( X + tN ) ♭ = X ♭ and ( Y + t N ) ♭ = Y ♭ (\mathbb{Y}+tN)^{\flat}=\mathbb{Y}^{\flat} ( Y + tN ) ♭ = Y ♭ are Compression of a Bounded Symmetric Bilinear Form along an Orthonormal Tuple (iii) .
Proof of clause 5. Throughout, ∥ X n ∥ ≤ 6 α \lVert\mathbb{X}_{n}\rVert\le6\alpha ∥ X n ∥ ≤ 6 α and ∥ Y n ∥ ≤ 6 α \lVert\mathbb{Y}_{n}\rVert\le6\alpha ∥ Y n ∥ ≤ 6 α for every n n n , by The Second-Order Structure Condition at Optimally Coupled Pairs on the Lift of the Wasserstein Space (i) .
(a) By Limits and Bounded Sequences of Symmetric Real Matrices (i) , read with d d d in place of the dimension written n n n there and with R = 6 α R=6\alpha R = 6 α , there are a strictly increasing φ 1 : N → N \varphi_{1}:\mathbb{N}\to\mathbb{N} φ 1 : N → N and X ∈ S ( d ) \mathbb{X}\in\mathcal{S}(d) X ∈ S ( d ) such that the sequence whose k k k -th term is X φ 1 ( k ) \mathbb{X}_{\varphi_{1}(k)} X φ 1 ( k ) converges to X \mathbb{X} X . The sequence whose k k k -th term is Y φ 1 ( k ) \mathbb{Y}_{\varphi_{1}(k)} Y φ 1 ( k ) lies in S ( d ) \mathcal{S}(d) S ( d ) and is bounded in norm by 6 α 6\alpha 6 α , so the same clause provides a strictly increasing φ 2 : N → N \varphi_{2}:\mathbb{N}\to\mathbb{N} φ 2 : N → N and Y ∈ S ( d ) \mathbb{Y}\in\mathcal{S}(d) Y ∈ S ( d ) such that the sequence whose k k k -th term is Y φ 1 ( φ 2 ( k ) ) \mathbb{Y}_{\varphi_{1}(\varphi_{2}(k))} Y φ 1 ( φ 2 ( k )) converges to Y \mathbb{Y} Y . Put φ = φ 1 ∘ φ 2 \varphi=\varphi_{1}\circ\varphi_{2} φ = φ 1 ∘ φ 2 , which is strictly increasing and indexes a subsequence of the original sequences by A Subsequence of a Subsequence is a Subsequence ; the sequence whose k k k -th term is X φ ( k ) \mathbb{X}_{\varphi(k)} X φ ( k ) is a subsequence of a sequence converging to X \mathbb{X} X and therefore converges to X \mathbb{X} X by A Subsequence of a Convergent Sequence Has the Same Limit .
(b) Let z , w ∈ R d z,w\in\mathbb{R}^{d} z , w ∈ R d . By Limits and Bounded Sequences of Symmetric Real Matrices (ii) the sequences whose n n n -th terms are z ⋅ ( X n z ) z\cdot(\mathbb{X}_{n}z) z ⋅ ( X n z ) and w ⋅ ( Y n w ) w\cdot(\mathbb{Y}_{n}w) w ⋅ ( Y n w ) converge to z ⋅ ( X z ) z\cdot(\mathbb{X}z) z ⋅ ( X z ) and to w ⋅ ( Y w ) w\cdot(\mathbb{Y}w) w ⋅ ( Y w ) , so by Arithmetic of Limits of Real Sequences the sequence of their differences converges to z ⋅ ( X z ) − w ⋅ ( Y w ) z\cdot(\mathbb{X}z)-w\cdot(\mathbb{Y}w) z ⋅ ( X z ) − w ⋅ ( Y w ) . Every term of that sequence lies between − 3 α ( ∥ z ∥ 2 + ∥ w ∥ 2 ) -3\alpha(\lVert z\rVert^{2}+\lVert w\rVert^{2}) − 3 α (∥ z ∥ 2 + ∥ w ∥ 2 ) and 3 α ∥ z − w ∥ 2 3\alpha\lVert z-w\rVert^{2} 3 α ∥ z − w ∥ 2 , so by Order Properties of Limits of Real Sequences , applied to the constant sequences with these two values, so does its limit. Next, X n ⪯ Y n \mathbb{X}_{n}\preceq\mathbb{Y}_{n} X n ⪯ Y n for every n n n gives X ⪯ Y \mathbb{X}\preceq\mathbb{Y} X ⪯ Y by Limits and Bounded Sequences of Symmetric Real Matrices (iii) . Finally let ξ ∈ R d \xi\in\mathbb{R}^{d} ξ ∈ R d satisfy ∥ ξ ∥ ≤ 1 \lVert\xi\rVert\le1 ∥ ξ ∥ ≤ 1 . By claim 2 of Properties of the Norm of a Symmetric Real Matrix and claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field ,
∣ ξ ⋅ ( X n ξ ) ∣ ≤ ∥ X n ∥ ∥ ξ ∥ 2 ≤ 6 α ( n ∈ N ) . \bigl|\xi\cdot(\mathbb{X}_{n}\xi)\bigr|\le\lVert\mathbb{X}_{n}\rVert\,\lVert\xi\rVert^{2}\le6\alpha\qquad(n\in\mathbb{N}). ξ ⋅ ( X n ξ ) ≤ ∥ X n ∥ ∥ ξ ∥ 2 ≤ 6 α ( n ∈ N ) .
The sequence whose n n n -th term is ξ ⋅ ( X n ξ ) \xi\cdot(\mathbb{X}_{n}\xi) ξ ⋅ ( X n ξ ) converges to ξ ⋅ ( X ξ ) \xi\cdot(\mathbb{X}\xi) ξ ⋅ ( X ξ ) , and the sequence of absolute values converges to ∣ ξ ⋅ ( X ξ ) ∣ |\xi\cdot(\mathbb{X}\xi)| ∣ ξ ⋅ ( X ξ ) ∣ because ∣ ∣ r ∣ − ∣ r ′ ∣ ∣ ≤ ∣ r − r ′ ∣ \bigl||r|-|r'|\bigr|\le|r-r'| ∣ r ∣ − ∣ r ′ ∣ ≤ ∣ r − r ′ ∣ for real r , r ′ r,r' r , r ′ by claim 7 of Properties of the Absolute Value in an Ordered Field ; hence ∣ ξ ⋅ ( X ξ ) ∣ ≤ 6 α |\xi\cdot(\mathbb{X}\xi)|\le6\alpha ∣ ξ ⋅ ( X ξ ) ∣ ≤ 6 α by Order Properties of Limits of Real Sequences . Thus 6 α 6\alpha 6 α is an upper bound of the set whose supremum is ∥ X ∥ \lVert\mathbb{X}\rVert ∥ X ∥ in Norm of a Symmetric Real Matrix , so ∥ X ∥ ≤ 6 α \lVert\mathbb{X}\rVert\le6\alpha ∥ X ∥ ≤ 6 α ; the same argument gives ∥ Y ∥ ≤ 6 α \lVert\mathbb{Y}\rVert\le6\alpha ∥ Y ∥ ≤ 6 α . The four requirements of The Second-Order Structure Condition at Optimally Coupled Pairs on the Lift of the Wasserstein Space (i) hold, so ( X , Y ) (\mathbb{X},\mathbb{Y}) ( X , Y ) is admitted at α \alpha α .