Each result cited is universally quantified over the data in its own statement. Throughout, W = W 2 W=W_{2} W = W 2 , ∣ s ∣ |s| ∣ s ∣ is the absolute value of s ∈ R s\in\mathbb{R} s ∈ R , α − 1 \alpha^{-1} α − 1 is the multiplicative inverse of a positive α \alpha α , J = { δ ∈ R : 0 < δ < 1 } J=\{\delta\in\mathbb{R}:0<\delta<1\} J = { δ ∈ R : 0 < δ < 1 } , 0 d 0_{d} 0 d is the zero matrix in S ( d ) \mathcal{S}(d) S ( d ) , and suprema and infima of nonempty subsets of R \mathbb{R} R bounded above or below are those of The Real Numbers: Standing Notation and Background §bounds . Elementary order arithmetic and the approximation property Approximation Property of the Supremum and the Infimum in R \mathbb{R} R are in force by The Real Numbers: Standing Notation and Background §background . The order in which the auxiliary quantities are chosen is: e 0 e_{0} e 0 and μ 0 \mu_{0} μ 0 (Step 1); then, for a given θ \theta θ , the constants A A A , R 0 R_{0} R 0 , λ \lambda λ , ( ω 1 , ω 2 ) (\omega_{1},\omega_{2}) ( ω 1 , ω 2 ) , κ \kappa κ , t 1 t_{1} t 1 (Step 2); then α \alpha α and t 2 t_{2} t 2 (Step 3); then η 2 \eta_{2} η 2 , δ 1 \delta_{1} δ 1 and δ 0 \delta_{0} δ 0 (Step 4); then, for a given δ \delta δ with 0 < δ < δ 0 0<\delta<\delta_{0} 0 < δ < δ 0 , the constants K K K , B B B , B ˉ \bar{B} B ˉ , R R R , C C C , R ˉ \bar{R} R ˉ , ρ \rho ρ and finally τ \tau τ , after which the perturbed maximiser is taken (Step 5).
Step 1 (The corrected maximum and its monotonicity). By Basic Properties of a Wasserstein-Closed Penalty Pair: Lower Bound, Lower Semicontinuity, Complete Sublevel Sets, Bounded Distances, and Coercive Pairs §bounded-below fix e 0 ∈ R e_{0}\in\mathbb{R} e 0 ∈ R with e 0 ≤ E ( σ ) e_{0}\le\mathcal{E}(\sigma) e 0 ≤ E ( σ ) for every σ ∈ D \sigma\in\mathcal{D} σ ∈ D ; the set D \mathcal{D} D contains the nonempty D Σ \mathcal{D}_{\Sigma} D Σ (Penalty Pairs on the Wasserstein Space: the Penalty, Its Score, and Their Domains §pair , Penalty Pairs on the Wasserstein Space: the Penalty, Its Score, and Their Domains §nonempty ), so fix μ 0 ∈ D \mu_{0}\in\mathcal{D} μ 0 ∈ D . For positive δ , α \delta,\alpha δ , α let Ψ δ , α \Psi_{\delta,\alpha} Ψ δ , α and M ( δ , α ) M(\delta,\alpha) M ( δ , α ) be as in Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair , read with the present pair, e 0 e_{0} e 0 , u u u , v v v , b b b and b ′ b' b ′ ; by Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §bounds , M ( δ , α ) M(\delta,\alpha) M ( δ , α ) is a real number at most b − b ′ − 2 δ e 0 b-b'-2\delta e_{0} b − b ′ − 2 δ e 0 . For α > 0 \alpha>0 α > 0 and δ ∈ J \delta\in J δ ∈ J put
G ( α , δ ) = M ( δ , α ) + 2 δ e 0 , so that G ( α , δ ) ≤ b − b ′ . ( 1 a ) G(\alpha,\delta)=M(\delta,\alpha)+2\delta e_{0},\qquad\text{so that}\qquad G(\alpha,\delta)\le b-b'.\qquad(1\mathrm{a}) G ( α , δ ) = M ( δ , α ) + 2 δ e 0 , so that G ( α , δ ) ≤ b − b ′ . ( 1 a )
Lower bound. By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §diagonal at μ 0 \mu_{0} μ 0 , u ( μ 0 ) − v ( μ 0 ) − 2 δ E ( μ 0 ) ≤ M ( δ , α ) u(\mu_{0})-v(\mu_{0})-2\delta\mathcal{E}(\mu_{0})\le M(\delta,\alpha) u ( μ 0 ) − v ( μ 0 ) − 2 δ E ( μ 0 ) ≤ M ( δ , α ) ; for δ ∈ J \delta\in J δ ∈ J we have 2 δ E ( μ 0 ) ≤ 2 ∣ E ( μ 0 ) ∣ 2\delta\mathcal{E}(\mu_{0})\le2|\mathcal{E}(\mu_{0})| 2 δ E ( μ 0 ) ≤ 2∣ E ( μ 0 ) ∣ and − 2 ∣ e 0 ∣ ≤ 2 δ e 0 -2|e_{0}|\le2\delta e_{0} − 2∣ e 0 ∣ ≤ 2 δ e 0 , so
ℓ ≤ G ( α , δ ) , ℓ = u ( μ 0 ) − v ( μ 0 ) − 2 ∣ E ( μ 0 ) ∣ − 2 ∣ e 0 ∣ . ( 1 b ) \ell\le G(\alpha,\delta),\qquad\ell=u(\mu_{0})-v(\mu_{0})-2|\mathcal{E}(\mu_{0})|-2|e_{0}|.\qquad(1\mathrm{b}) ℓ ≤ G ( α , δ ) , ℓ = u ( μ 0 ) − v ( μ 0 ) − 2∣ E ( μ 0 ) ∣ − 2∣ e 0 ∣. ( 1 b )
Decreasing the weight. Let α > 0 \alpha>0 α > 0 , δ , δ ′ ∈ J \delta,\delta'\in J δ , δ ′ ∈ J with δ ′ < δ \delta'<\delta δ ′ < δ , let τ ≥ 0 \tau\ge0 τ ≥ 0 and let ( μ , ν ) ∈ D × D (\mu,\nu)\in\mathcal{D}\times\mathcal{D} ( μ , ν ) ∈ D × D satisfy M ( δ , α ) − τ ≤ Ψ δ , α ( μ , ν ) M(\delta,\alpha)-\tau\le\Psi_{\delta,\alpha}(\mu,\nu) M ( δ , α ) − τ ≤ Ψ δ , α ( μ , ν ) . By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §weight , M ( δ , α ) − τ + ( δ − δ ′ ) ( E ( μ ) + E ( ν ) ) ≤ M ( δ ′ , α ) M(\delta,\alpha)-\tau+(\delta-\delta')(\mathcal{E}(\mu)+\mathcal{E}(\nu))\le M(\delta',\alpha) M ( δ , α ) − τ + ( δ − δ ′ ) ( E ( μ ) + E ( ν )) ≤ M ( δ ′ , α ) ; adding 2 ( δ ′ − δ ) e 0 2(\delta'-\delta)e_{0} 2 ( δ ′ − δ ) e 0 to both sides,
( δ − δ ′ ) ( E ( μ ) − e 0 + E ( ν ) − e 0 ) ≤ G ( α , δ ′ ) − G ( α , δ ) + τ . ( 1 c ) (\delta-\delta')\bigl(\mathcal{E}(\mu)-e_{0}+\mathcal{E}(\nu)-e_{0}\bigr)\le G(\alpha,\delta')-G(\alpha,\delta)+\tau.\qquad(1\mathrm{c}) ( δ − δ ′ ) ( E ( μ ) − e 0 + E ( ν ) − e 0 ) ≤ G ( α , δ ′ ) − G ( α , δ ) + τ . ( 1 c )
The left side is nonnegative, as E ( μ ) − e 0 \mathcal{E}(\mu)-e_{0} E ( μ ) − e 0 and E ( ν ) − e 0 \mathcal{E}(\nu)-e_{0} E ( ν ) − e 0 are. For every positive τ \tau τ a pair ( μ , ν ) (\mu,\nu) ( μ , ν ) as above exists by the approximation property of the supremum M ( δ , α ) M(\delta,\alpha) M ( δ , α ) , so G ( α , δ ) ≤ G ( α , δ ′ ) + τ G(\alpha,\delta)\le G(\alpha,\delta')+\tau G ( α , δ ) ≤ G ( α , δ ′ ) + τ for every positive τ \tau τ , and Comparison of Real Numbers with Arbitrary Positive Slack §slack-above gives G ( α , δ ) ≤ G ( α , δ ′ ) G(\alpha,\delta)\le G(\alpha,\delta') G ( α , δ ) ≤ G ( α , δ ′ ) : G ( α , ⋅ ) G(\alpha,\cdot) G ( α , ⋅ ) is nonincreasing on J J J .
Decreasing the strength. Let 0 < α ′ < α 0<\alpha'<\alpha 0 < α ′ < α , δ ∈ J \delta\in J δ ∈ J , τ ≥ 0 \tau\ge0 τ ≥ 0 , and let ( μ , ν ) ∈ D × D (\mu,\nu)\in\mathcal{D}\times\mathcal{D} ( μ , ν ) ∈ D × D satisfy M ( δ , α ) − τ ≤ Ψ δ , α ( μ , ν ) M(\delta,\alpha)-\tau\le\Psi_{\delta,\alpha}(\mu,\nu) M ( δ , α ) − τ ≤ Ψ δ , α ( μ , ν ) . By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §strength ,
α − α ′ 2 W ( μ , ν ) 2 ≤ M ( δ , α ′ ) − M ( δ , α ) + τ = G ( α ′ , δ ) − G ( α , δ ) + τ . ( 1 d ) \tfrac{\alpha-\alpha'}{2}\,W(\mu,\nu)^{2}\le M(\delta,\alpha')-M(\delta,\alpha)+\tau=G(\alpha',\delta)-G(\alpha,\delta)+\tau.\qquad(1\mathrm{d}) 2 α − α ′ W ( μ , ν ) 2 ≤ M ( δ , α ′ ) − M ( δ , α ) + τ = G ( α ′ , δ ) − G ( α , δ ) + τ . ( 1 d )
Moreover, since W ( μ , ν ) 2 ≥ 0 W(\mu,\nu)^{2}\ge0 W ( μ , ν ) 2 ≥ 0 , every value Ψ δ , α ( μ , ν ) \Psi_{\delta,\alpha}(\mu,\nu) Ψ δ , α ( μ , ν ) is at most Ψ δ , α ′ ( μ , ν ) ≤ M ( δ , α ′ ) \Psi_{\delta,\alpha'}(\mu,\nu)\le M(\delta,\alpha') Ψ δ , α ′ ( μ , ν ) ≤ M ( δ , α ′ ) , so M ( δ , α ) ≤ M ( δ , α ′ ) M(\delta,\alpha)\le M(\delta,\alpha') M ( δ , α ) ≤ M ( δ , α ′ ) as M ( δ , α ) M(\delta,\alpha) M ( δ , α ) is the least upper bound; that is, G ( α , δ ) ≤ G ( α ′ , δ ) G(\alpha,\delta)\le G(\alpha',\delta) G ( α , δ ) ≤ G ( α ′ , δ ) , and G ( ⋅ , δ ) G(\cdot,\delta) G ( ⋅ , δ ) is nonincreasing on the positive reals.
Step 2 (Claim 1: constants independent of the doubling). Let θ \theta θ be positive. Put A = ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ + 1 A=|b|+|b'|+|e_{0}|+1 A = ∣ b ∣ + ∣ b ′ ∣ + ∣ e 0 ∣ + 1 and R 0 = 2 A R_{0}=2A R 0 = 2 A , both positive. Since F F F is locally strictly proper, fix by Locally Strictly Proper Second-Order Equation Operator on the Wasserstein Space §strictly-proper a properness constant λ > 0 \lambda>0 λ > 0 for F F F at R 0 R_{0} R 0 , with Q = D Σ Q=\mathcal{D}_{\Sigma} Q = D Σ ; since F F F satisfies the second-order structure condition, fix by The Second-Order Structure Condition at Uniquely Mapped Pairs on the Wasserstein Space §structure a second-order structure pair ( ω 1 , ω 2 ) (\omega_{1},\omega_{2}) ( ω 1 , ω 2 ) for F F F at R 0 R_{0} R 0 . Put κ = λ θ / 8 \kappa=\lambda\theta/8 κ = λ θ /8 , positive. By clause 2 of Modulus of Continuity fix a positive t 1 t_{1} t 1 with ω 1 ( t ) ≤ κ \omega_{1}(t)\le\kappa ω 1 ( t ) ≤ κ whenever 0 ≤ t ≤ t 1 0\le t\le t_{1} 0 ≤ t ≤ t 1 , and put β 0 = 1 + 2 t 1 − 1 \beta_{0}=1+2t_{1}^{-1} β 0 = 1 + 2 t 1 − 1 and η 1 = t 1 / 32 \eta_{1}=t_{1}/32 η 1 = t 1 /32 .
Step 3 (Choice of the doubling strength). For α ≥ β 0 \alpha\ge\beta_{0} α ≥ β 0 the set { G ( α , δ ) : δ ∈ J } \{G(\alpha,\delta):\delta\in J\} { G ( α , δ ) : δ ∈ J } is nonempty and bounded above by b − b ′ b-b' b − b ′ by (1a); let N ( α ) N(\alpha) N ( α ) be its least upper bound. By (1b), ℓ ≤ N ( α ) \ell\le N(\alpha) ℓ ≤ N ( α ) ; by Step 1, G ( ⋅ , δ ) G(\cdot,\delta) G ( ⋅ , δ ) is nonincreasing, so G ( α , δ ) ≤ G ( α ′ , δ ) ≤ N ( α ′ ) G(\alpha,\delta)\le G(\alpha',\delta)\le N(\alpha') G ( α , δ ) ≤ G ( α ′ , δ ) ≤ N ( α ′ ) for β 0 ≤ α ′ < α \beta_{0}\le\alpha'<\alpha β 0 ≤ α ′ < α and every δ ∈ J \delta\in J δ ∈ J , whence N ( α ) ≤ N ( α ′ ) N(\alpha)\le N(\alpha') N ( α ) ≤ N ( α ′ ) . The set { N ( α ) : α ≥ β 0 } \{N(\alpha):\alpha\ge\beta_{0}\} { N ( α ) : α ≥ β 0 } is nonempty and bounded below by ℓ \ell ℓ ; let L L L be its greatest lower bound. By Approximation Property of the Supremum and the Infimum in R \mathbb{R} R §epsilon-below fix α 1 ≥ β 0 \alpha_{1}\ge\beta_{0} α 1 ≥ β 0 with N ( α 1 ) < L + η 1 N(\alpha_{1})<L+\eta_{1} N ( α 1 ) < L + η 1 , and put α = 2 α 1 \alpha=2\alpha_{1} α = 2 α 1 , so that α 2 = α 1 \tfrac{\alpha}{2}=\alpha_{1} 2 α = α 1 . Then α ≥ α 1 ≥ β 0 \alpha\ge\alpha_{1}\ge\beta_{0} α ≥ α 1 ≥ β 0 , so L ≤ N ( α ) L\le N(\alpha) L ≤ N ( α ) and
N ( α 2 ) − N ( α ) < η 1 . ( 3 a ) N(\tfrac{\alpha}{2})-N(\alpha)<\eta_{1}.\qquad(3\mathrm{a}) N ( 2 α ) − N ( α ) < η 1 . ( 3 a )
Moreover 1 < β 0 ≤ α 1<\beta_{0}\le\alpha 1 < β 0 ≤ α , and from 2 t 1 − 1 < α 2t_{1}^{-1}<\alpha 2 t 1 − 1 < α we get α − 1 < t 1 / 2 \alpha^{-1}<t_{1}/2 α − 1 < t 1 /2 . By The Second-Order Structure Condition at Uniquely Mapped Pairs on the Wasserstein Space §pair the function with value ω 2 ( t , α ) \omega_{2}(t,\alpha) ω 2 ( t , α ) at t ≥ 0 t\ge0 t ≥ 0 is a modulus of continuity; by clause 2 of Modulus of Continuity fix a positive t 2 t_{2} t 2 with ω 2 ( t , α ) ≤ κ \omega_{2}(t,\alpha)\le\kappa ω 2 ( t , α ) ≤ κ whenever 0 ≤ t ≤ t 2 0\le t\le t_{2} 0 ≤ t ≤ t 2 .
Step 4 (Choice of the threshold). Let η 2 \eta_{2} η 2 be the least of η 1 \eta_{1} η 1 and t 2 / 8 t_{2}/8 t 2 /8 . By Approximation Property of the Supremum and the Infimum in R \mathbb{R} R §epsilon-above fix δ 1 ∈ J \delta_{1}\in J δ 1 ∈ J with N ( α ) − η 2 < G ( α , δ 1 ) N(\alpha)-\eta_{2}<G(\alpha,\delta_{1}) N ( α ) − η 2 < G ( α , δ 1 ) , and let δ 0 \delta_{0} δ 0 be the least of δ 1 \delta_{1} δ 1 and t 2 ( 8 ∣ e 0 ∣ + 4 ) − 1 t_{2}\bigl(8|e_{0}|+4\bigr)^{-1} t 2 ( 8∣ e 0 ∣ + 4 ) − 1 , a positive number. Let δ ∈ R \delta\in\mathbb{R} δ ∈ R satisfy 0 < δ < δ 0 0<\delta<\delta_{0} 0 < δ < δ 0 . Then δ ∈ J \delta\in J δ ∈ J , δ 2 ∈ J \tfrac{\delta}{2}\in J 2 δ ∈ J , δ ( 2 ∣ e 0 ∣ + 1 ) < t 2 / 4 \delta(2|e_{0}|+1)<t_{2}/4 δ ( 2∣ e 0 ∣ + 1 ) < t 2 /4 and δ < δ 1 \delta<\delta_{1} δ < δ 1 , so, G ( α , ⋅ ) G(\alpha,\cdot) G ( α , ⋅ ) being nonincreasing (Step 1),
N ( α ) − η 2 < G ( α , δ 1 ) ≤ G ( α , δ ) . ( 4 a ) N(\alpha)-\eta_{2}<G(\alpha,\delta_{1})\le G(\alpha,\delta).\qquad(4\mathrm{a}) N ( α ) − η 2 < G ( α , δ 1 ) ≤ G ( α , δ ) . ( 4 a )
Step 5 (Claim 1: the bound). With δ \delta δ as in Step 4 we show M ( δ , α ) ≤ θ M(\delta,\alpha)\le\theta M ( δ , α ) ≤ θ . Suppose instead θ < M ( δ , α ) \theta<M(\delta,\alpha) θ < M ( δ , α ) . Write Ψ = Ψ δ , α \Psi=\Psi_{\delta,\alpha} Ψ = Ψ δ , α and M = M ( δ , α ) M=M(\delta,\alpha) M = M ( δ , α ) .
Step 5a (Constants depending on δ \delta δ and α \alpha α ). By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §perturbed at δ \delta δ fix K , B ∈ R K,B\in\mathbb{R} K , B ∈ R , not depending on the strength or on the tolerance, with M 2 ( σ ) ≤ B M_{2}(\sigma)\le B M 2 ( σ ) ≤ B for every σ ∈ D \sigma\in\mathcal{D} σ ∈ D with E ( σ ) ≤ K \mathcal{E}(\sigma)\le K E ( σ ) ≤ K ; put B ˉ = ∣ B ∣ \bar{B}=|B| B ˉ = ∣ B ∣ , so 0 ≤ B ˉ 0\le\bar{B} 0 ≤ B ˉ and M 2 ( σ ) ≤ B ˉ M_{2}(\sigma)\le\bar{B} M 2 ( σ ) ≤ B ˉ for those σ \sigma σ , and let B ˉ \sqrt{\bar{B}} B ˉ be its square root (The Real Numbers: Standing Notation and Background §background ). Put
R = ( 2 α + 5 ) B ˉ + ∣ e 0 ∣ + ∣ K ∣ + A + 1 , R=(2\alpha+5)\sqrt{\bar{B}}+|e_{0}|+|K|+A+1, R = ( 2 α + 5 ) B ˉ + ∣ e 0 ∣ + ∣ K ∣ + A + 1 ,
a positive real. Since F F F satisfies the shift-coercivity condition and 0 < δ < 1 0<\delta<1 0 < δ < 1 , fix by The Shift-Coercivity Condition for an Equation Operator on the Wasserstein Space §coercivity a score bound C ≥ 0 C\ge0 C ≥ 0 for F F F at ( δ , R ) (\delta,R) ( δ , R ) , and put R ˉ = R + C \bar{R}=R+C R ˉ = R + C . Since F F F has momentum-continuous shifts, fix by Equation Operators on the Wasserstein Space with Momentum-Continuous Shifts §momentum , applied with δ \delta δ , R ˉ \bar{R} R ˉ and η = κ \eta=\kappa η = κ , a positive ρ \rho ρ with the property stated there. Finally let τ \tau τ be the least of 1 2 \tfrac{1}{2} 2 1 , θ 8 \tfrac{\theta}{8} 8 θ , η 1 \eta_{1} η 1 , t 2 8 \tfrac{t_{2}}{8} 8 t 2 and ρ ( 8 B ˉ + 2 ) − 1 \rho\bigl(8\sqrt{\bar{B}}+2\bigr)^{-1} ρ ( 8 B ˉ + 2 ) − 1 . Then 0 < τ < 1 0<\tau<1 0 < τ < 1 , τ < θ \tau<\theta τ < θ , λ τ ≤ κ \lambda\tau\le\kappa λ τ ≤ κ , τ ≤ η 1 \tau\le\eta_{1} τ ≤ η 1 , τ ≤ t 2 / 8 \tau\le t_{2}/8 τ ≤ t 2 /8 and 4 τ B ˉ < ρ 4\tau\sqrt{\bar{B}}<\rho 4 τ B ˉ < ρ .
Step 5b (The perturbed maximiser). By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §perturbed , with α \alpha α and τ \tau τ , there are ( μ ^ , ν ^ ) ∈ D × D (\hat{\mu},\hat{\nu})\in\mathcal{D}\times\mathcal{D} ( μ ^ , ν ^ ) ∈ D × D , sequences ( μ k ) k (\mu_{k})_{k} ( μ k ) k and ( ν k ) k (\nu_{k})_{k} ( ν k ) k in D \mathcal{D} D and positive reals c k c_{k} c k whose series converges with ∑ k = 1 ∞ c k ≤ τ \sum_{k=1}^{\infty}c_{k}\le\tau ∑ k = 1 ∞ c k ≤ τ , such that the following hold: by Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §localised , the measures μ ^ \hat{\mu} μ ^ , ν ^ \hat{\nu} ν ^ , μ k \mu_{k} μ k , ν k \nu_{k} ν k lie in D K = { σ ∈ D : E ( σ ) ≤ K } \mathcal{D}_{K}=\{\sigma\in\mathcal{D}:\mathcal{E}(\sigma)\le K\} D K = { σ ∈ D : E ( σ ) ≤ K } , so their second moments are at most B ˉ \bar{B} B ˉ ; by Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §near-maximiser , M − τ ≤ Ψ ( μ ^ , ν ^ ) M-\tau\le\Psi(\hat{\mu},\hat{\nu}) M − τ ≤ Ψ ( μ ^ , ν ^ ) ; and by Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §strict-maximum , with Φ \Phi Φ as there, Φ ( μ , ν ) < Φ ( μ ^ , ν ^ ) \Phi(\mu,\nu)<\Phi(\hat{\mu},\hat{\nu}) Φ ( μ , ν ) < Φ ( μ ^ , ν ^ ) for every ( μ , ν ) ∈ D × D (\mu,\nu)\in\mathcal{D}\times\mathcal{D} ( μ , ν ) ∈ D × D other than ( μ ^ , ν ^ ) (\hat{\mu},\hat{\nu}) ( μ ^ , ν ^ ) . By Basic Properties of a Wasserstein-Closed Penalty Pair: Lower Bound, Lower Semicontinuity, Complete Sublevel Sets, Bounded Distances, and Coercive Pairs §diameter with c = K c=K c = K and B ˉ \bar{B} B ˉ , the squared distance between any two of these measures is at most 4 B ˉ = ( 2 B ˉ ) 2 4\bar{B}=(2\sqrt{\bar{B}})^{2} 4 B ˉ = ( 2 B ˉ ) 2 , so by claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field the distance itself is at most 2 B ˉ 2\sqrt{\bar{B}} 2 B ˉ ; likewise M 2 ( μ ^ ) ≤ B ˉ \sqrt{M_{2}(\hat{\mu})}\le\sqrt{\bar{B}} M 2 ( μ ^ ) ≤ B ˉ and M 2 ( ν ^ ) ≤ B ˉ \sqrt{M_{2}(\hat{\nu})}\le\sqrt{\bar{B}} M 2 ( ν ^ ) ≤ B ˉ .
Step 5c (Test functions). Since D \mathcal{D} D has the map property and μ ^ , ν ^ ∈ D \hat{\mu},\hat{\nu}\in\mathcal{D} μ ^ , ν ^ ∈ D , the ordered pairs ( μ ^ , ν ^ ) (\hat{\mu},\hat{\nu}) ( μ ^ , ν ^ ) , ( ν ^ , μ ^ ) (\hat{\nu},\hat{\mu}) ( ν ^ , μ ^ ) , ( μ ^ , μ k ) (\hat{\mu},\mu_{k}) ( μ ^ , μ k ) and ( ν ^ , ν k ) (\hat{\nu},\nu_{k}) ( ν ^ , ν k ) are uniquely mapped (The Map Property of a Set of Probability Measures §map-property ), so by Optimal Transport Maps and Uniquely Mapped Pairs of Probability Measures §uniquely-mapped fix an optimal map S S S from μ ^ \hat{\mu} μ ^ to ν ^ \hat{\nu} ν ^ , an optimal map S ′ S' S ′ from ν ^ \hat{\nu} ν ^ to μ ^ \hat{\mu} μ ^ , and for each k k k optimal maps S k S_{k} S k from μ ^ \hat{\mu} μ ^ to μ k \mu_{k} μ k and S k ′ S'_{k} S k ′ from ν ^ \hat{\nu} ν ^ to ν k \nu_{k} ν k . Let φ 0 , ψ 0 , χ , χ ′ : P 2 ( R d ) → R \varphi_{0},\psi_{0},\chi,\chi':\mathcal{P}_{2}(\mathbb{R}^{d})\to\mathbb{R} φ 0 , ψ 0 , χ , χ ′ : P 2 ( R d ) → R be
φ 0 ( μ ) = W ( μ , ν ^ ) 2 , ψ 0 ( ν ) = W ( ν , μ ^ ) 2 , χ ( μ ) = ∑ k = 1 ∞ c k W ( μ , μ k ) 2 , χ ′ ( ν ) = ∑ k = 1 ∞ c k W ( ν , ν k ) 2 , \varphi_{0}(\mu)=W(\mu,\hat{\nu})^{2},\qquad\psi_{0}(\nu)=W(\nu,\hat{\mu})^{2},\qquad\chi(\mu)=\sum_{k=1}^{\infty}c_{k}W(\mu,\mu_{k})^{2},\qquad\chi'(\nu)=\sum_{k=1}^{\infty}c_{k}W(\nu,\nu_{k})^{2}, φ 0 ( μ ) = W ( μ , ν ^ ) 2 , ψ 0 ( ν ) = W ( ν , μ ^ ) 2 , χ ( μ ) = k = 1 ∑ ∞ c k W ( μ , μ k ) 2 , χ ′ ( ν ) = k = 1 ∑ ∞ c k W ( ν , ν k ) 2 ,
the series converging by A Convergent Series of Squared Wasserstein Distances to Measures of Bounded Second Moment is an Intrinsic Test Function §convergence (with Q = D Q=\mathcal{D} Q = D , the bound B ˉ \bar{B} B ˉ and the centres μ k \mu_{k} μ k , respectively ν k \nu_{k} ν k ). By The Squared Wasserstein Distance to a Fixed Measure and Functions of the Mean are Intrinsic Test Functions §distance , φ 0 \varphi_{0} φ 0 and ψ 0 \psi_{0} ψ 0 are intrinsic test functions on D \mathcal{D} D with ∇ φ 0 ( μ ^ ) = 2 ( i d − S ) \nabla\varphi_{0}(\hat{\mu})=2(\mathrm{id}-S) ∇ φ 0 ( μ ^ ) = 2 ( id − S ) and ∇ ψ 0 ( ν ^ ) = 2 ( i d − S ′ ) \nabla\psi_{0}(\hat{\nu})=2(\mathrm{id}-S') ∇ ψ 0 ( ν ^ ) = 2 ( id − S ′ ) ; by A Convergent Series of Squared Wasserstein Distances to Measures of Bounded Second Moment is an Intrinsic Test Function §test , χ \chi χ and χ ′ \chi' χ ′ are intrinsic test functions on D \mathcal{D} D , and by A Convergent Series of Squared Wasserstein Distances to Measures of Bounded Second Moment is an Intrinsic Test Function §gradient , with q ∗ = ∇ χ ( μ ^ ) q^{*}=\nabla\chi(\hat{\mu}) q ∗ = ∇ χ ( μ ^ ) and q ′ ∗ = ∇ χ ′ ( ν ^ ) q'^{*}=\nabla\chi'(\hat{\nu}) q ′ ∗ = ∇ χ ′ ( ν ^ ) ,
∥ q ∗ ∥ μ ^ ≤ 2 ∑ k = 1 ∞ c k W ( μ ^ , μ k ) ≤ 4 B ˉ ∑ k = 1 ∞ c k ≤ 4 τ B ˉ , \lVert q^{*}\rVert_{\hat{\mu}}\le2\sum_{k=1}^{\infty}c_{k}W(\hat{\mu},\mu_{k})\le4\sqrt{\bar{B}}\sum_{k=1}^{\infty}c_{k}\le4\tau\sqrt{\bar{B}}, ∥ q ∗ ∥ μ ^ ≤ 2 k = 1 ∑ ∞ c k W ( μ ^ , μ k ) ≤ 4 B ˉ k = 1 ∑ ∞ c k ≤ 4 τ B ˉ ,
where the middle step uses W ( μ ^ , μ k ) ≤ 2 B ˉ W(\hat{\mu},\mu_{k})\le2\sqrt{\bar{B}} W ( μ ^ , μ k ) ≤ 2 B ˉ (Step 5b) and the comparison and linearity of convergent series; likewise ∥ q ′ ∗ ∥ ν ^ ≤ 4 τ B ˉ \lVert q'^{*}\rVert_{\hat{\nu}}\le4\tau\sqrt{\bar{B}} ∥ q ′ ∗ ∥ ν ^ ≤ 4 τ B ˉ . Put
φ = α 2 φ 0 + χ , ψ = ( − α 2 ) ψ 0 + ( − 1 ) χ ′ . \varphi=\tfrac{\alpha}{2}\varphi_{0}+\chi,\qquad\psi=\bigl(-\tfrac{\alpha}{2}\bigr)\psi_{0}+(-1)\chi'. φ = 2 α φ 0 + χ , ψ = ( − 2 α ) ψ 0 + ( − 1 ) χ ′ .
By Restrictions, Sums, Real Multiples and Differences of Intrinsic Test Functions on the Wasserstein Space §linear these are intrinsic test functions on D \mathcal{D} D , with
q 1 : = ∇ φ ( μ ^ ) = α ( i d − S ) + q ∗ , q 2 : = ∇ ψ ( ν ^ ) = α ( S ′ − i d ) − q ′ ∗ . q_{1}:=\nabla\varphi(\hat{\mu})=\alpha(\mathrm{id}-S)+q^{*},\qquad q_{2}:=\nabla\psi(\hat{\nu})=\alpha(S'-\mathrm{id})-q'^{*}. q 1 := ∇ φ ( μ ^ ) = α ( id − S ) + q ∗ , q 2 := ∇ ψ ( ν ^ ) = α ( S ′ − id ) − q ′ ∗ .
Step 5d (Touching). For ( μ , ν ) ∈ D × D (\mu,\nu)\in\mathcal{D}\times\mathcal{D} ( μ , ν ) ∈ D × D the series ∑ k c k ( W ( μ , μ k ) 2 + W ( ν , ν k ) 2 ) \sum_{k}c_{k}\bigl(W(\mu,\mu_{k})^{2}+W(\nu,\nu_{k})^{2}\bigr) ∑ k c k ( W ( μ , μ k ) 2 + W ( ν , ν k ) 2 ) has sum χ ( μ ) + χ ′ ( ν ) \chi(\mu)+\chi'(\nu) χ ( μ ) + χ ′ ( ν ) by Elementary Properties of Series of Real Numbers §linearity , so
Φ ( μ , ν ) = u δ − ( μ ) − v δ + ( ν ) − α 2 W ( μ , ν ) 2 − χ ( μ ) − χ ′ ( ν ) . \Phi(\mu,\nu)=u^{-}_{\delta}(\mu)-v^{+}_{\delta}(\nu)-\tfrac{\alpha}{2}W(\mu,\nu)^{2}-\chi(\mu)-\chi'(\nu). Φ ( μ , ν ) = u δ − ( μ ) − v δ + ( ν ) − 2 α W ( μ , ν ) 2 − χ ( μ ) − χ ′ ( ν ) .
Taking ν = ν ^ \nu=\hat{\nu} ν = ν ^ , Step 5b gives Φ ( μ , ν ^ ) ≤ Φ ( μ ^ , ν ^ ) \Phi(\mu,\hat{\nu})\le\Phi(\hat{\mu},\hat{\nu}) Φ ( μ , ν ^ ) ≤ Φ ( μ ^ , ν ^ ) for every μ ∈ D \mu\in\mathcal{D} μ ∈ D , that is, u δ − ( μ ) − φ ( μ ) ≤ u δ − ( μ ^ ) − φ ( μ ^ ) u^{-}_{\delta}(\mu)-\varphi(\mu)\le u^{-}_{\delta}(\hat{\mu})-\varphi(\hat{\mu}) u δ − ( μ ) − φ ( μ ) ≤ u δ − ( μ ^ ) − φ ( μ ^ ) after cancelling v δ + ( ν ^ ) + χ ′ ( ν ^ ) v^{+}_{\delta}(\hat{\nu})+\chi'(\hat{\nu}) v δ + ( ν ^ ) + χ ′ ( ν ^ ) ; so the function with value u δ − ( μ ) − φ ( μ ) u^{-}_{\delta}(\mu)-\varphi(\mu) u δ − ( μ ) − φ ( μ ) has a local maximum at μ ^ \hat{\mu} μ ^ relative to D \mathcal{D} D (with radius 1 1 1 ). Taking μ = μ ^ \mu=\hat{\mu} μ = μ ^ and using W ( μ ^ , ν ) = W ( ν , μ ^ ) W(\hat{\mu},\nu)=W(\nu,\hat{\mu}) W ( μ ^ , ν ) = W ( ν , μ ^ ) (The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §symmetry ), Φ ( μ ^ , ν ) ≤ Φ ( μ ^ , ν ^ ) \Phi(\hat{\mu},\nu)\le\Phi(\hat{\mu},\hat{\nu}) Φ ( μ ^ , ν ) ≤ Φ ( μ ^ , ν ^ ) for every ν ∈ D \nu\in\mathcal{D} ν ∈ D reads v δ + ( ν ^ ) − ψ ( ν ^ ) ≤ v δ + ( ν ) − ψ ( ν ) v^{+}_{\delta}(\hat{\nu})-\psi(\hat{\nu})\le v^{+}_{\delta}(\nu)-\psi(\nu) v δ + ( ν ^ ) − ψ ( ν ^ ) ≤ v δ + ( ν ) − ψ ( ν ) ; so the function with value v δ + ( ν ) − ψ ( ν ) v^{+}_{\delta}(\nu)-\psi(\nu) v δ + ( ν ) − ψ ( ν ) has a local minimum at ν ^ \hat{\nu} ν ^ relative to D \mathcal{D} D .
Step 5e (Exact inequalities). By The Delta-Envelopes of Bounded Functions and Their Monotonicity in the Weight, for a Wasserstein-Closed Penalty Pair §growth , u u u has penalty-subordinate growth from above and v v v from below; the pair is Wasserstein-closed with closed score along couplings, F F F satisfies the shift-coercivity and shift-semicontinuity conditions, 0 < δ < 1 0<\delta<1 0 < δ < 1 , u u u is a viscosity subsolution and v v v a viscosity supersolution. So Exact Inequalities at a Touching Point of a Penalised Viscosity Subsolution or Supersolution on the Wasserstein Space §subsolution with φ \varphi φ and Exact Inequalities at a Touching Point of a Penalised Viscosity Subsolution or Supersolution on the Wasserstein Space §supersolution with ψ \psi ψ give μ ^ , ν ^ ∈ D Σ \hat{\mu},\hat{\nu}\in\mathcal{D}_{\Sigma} μ ^ , ν ^ ∈ D Σ and, with r 1 = u δ − ( μ ^ ) r_{1}=u^{-}_{\delta}(\hat{\mu}) r 1 = u δ − ( μ ^ ) and r 2 = v δ + ( ν ^ ) r_{2}=v^{+}_{\delta}(\hat{\nu}) r 2 = v δ + ( ν ^ ) ,
F δ − ( μ ^ , r 1 , q 1 , H φ ( μ ^ ) ) ≤ 0 ≤ F δ + ( ν ^ , r 2 , q 2 , H ψ ( ν ^ ) ) . F^{-}_{\delta}\bigl(\hat{\mu},r_{1},q_{1},H_{\varphi}(\hat{\mu})\bigr)\le0\le F^{+}_{\delta}\bigl(\hat{\nu},r_{2},q_{2},H_{\psi}(\hat{\nu})\bigr). F δ − ( μ ^ , r 1 , q 1 , H φ ( μ ^ ) ) ≤ 0 ≤ F δ + ( ν ^ , r 2 , q 2 , H ψ ( ν ^ ) ) .
For ( ν , q ) ∈ V ( D Σ ) (\nu,q)\in\mathcal{V}(\mathcal{D}_{\Sigma}) ( ν , q ) ∈ V ( D Σ ) , r ∈ R r\in\mathbb{R} r ∈ R and Y ∈ S ( d ) Y\in\mathcal{S}(d) Y ∈ S ( d ) , The Bundle of Vector Fields over a Set of Measures, Second-Order Equation Operators on the Wasserstein Space, and Their Delta-Shifts §shifted writes F δ − ( ν , r , q , Y ) F^{-}_{\delta}(\nu,r,q,Y) F δ − ( ν , r , q , Y ) as F F F evaluated at ν \nu ν , r + δ E ( ν ) r+\delta\mathcal{E}(\nu) r + δ E ( ν ) , q + δ Σ ( ν ) q+\delta\Sigma(\nu) q + δ Σ ( ν ) and Y + δ H E ( ν ) Y+\delta H_{\mathcal{E}}(\nu) Y + δ H E ( ν ) , where ( ν , q + δ Σ ( ν ) ) ∈ V ( D Σ ) (\nu,q+\delta\Sigma(\nu))\in\mathcal{V}(\mathcal{D}_{\Sigma}) ( ν , q + δ Σ ( ν )) ∈ V ( D Σ ) ; as F F F does not depend on its matrix argument, F δ − ( ν , r , q , Y ) = F δ − ( ν , r , q , 0 d ) F^{-}_{\delta}(\nu,r,q,Y)=F^{-}_{\delta}(\nu,r,q,0_{d}) F δ − ( ν , r , q , Y ) = F δ − ( ν , r , q , 0 d ) , and likewise F δ + ( ν , r , q , Y ) = F δ + ( ν , r , q , 0 d ) F^{+}_{\delta}(\nu,r,q,Y)=F^{+}_{\delta}(\nu,r,q,0_{d}) F δ + ( ν , r , q , Y ) = F δ + ( ν , r , q , 0 d ) . Hence
F δ − ( μ ^ , r 1 , q 1 , 0 d ) ≤ 0 ≤ F δ + ( ν ^ , r 2 , q 2 , 0 d ) . ( 5 a ) F^{-}_{\delta}(\hat{\mu},r_{1},q_{1},0_{d})\le0\le F^{+}_{\delta}(\hat{\nu},r_{2},q_{2},0_{d}).\qquad(5\mathrm{a}) F δ − ( μ ^ , r 1 , q 1 , 0 d ) ≤ 0 ≤ F δ + ( ν ^ , r 2 , q 2 , 0 d ) . ( 5 a )
Step 5f (Bounds). As Ψ ( μ ^ , ν ^ ) = r 1 − r 2 − α 2 W ( μ ^ , ν ^ ) 2 \Psi(\hat{\mu},\hat{\nu})=r_{1}-r_{2}-\tfrac{\alpha}{2}W(\hat{\mu},\hat{\nu})^{2} Ψ ( μ ^ , ν ^ ) = r 1 − r 2 − 2 α W ( μ ^ , ν ^ ) 2 , Step 5b and θ < M \theta<M θ < M give
r 1 − r 2 ≥ Ψ ( μ ^ , ν ^ ) ≥ M − τ > θ − τ > 0. ( 5 b ) r_{1}-r_{2}\ge\Psi(\hat{\mu},\hat{\nu})\ge M-\tau>\theta-\tau>0.\qquad(5\mathrm{b}) r 1 − r 2 ≥ Ψ ( μ ^ , ν ^ ) ≥ M − τ > θ − τ > 0. ( 5 b )
By The Delta-Envelopes of Bounded Functions and Their Monotonicity in the Weight, for a Wasserstein-Closed Penalty Pair §bounded , r 1 ≤ b − δ E ( μ ^ ) ≤ b − δ e 0 ≤ ∣ b ∣ + ∣ e 0 ∣ r_{1}\le b-\delta\mathcal{E}(\hat{\mu})\le b-\delta e_{0}\le|b|+|e_{0}| r 1 ≤ b − δ E ( μ ^ ) ≤ b − δ e 0 ≤ ∣ b ∣ + ∣ e 0 ∣ and r 2 ≥ b ′ + δ E ( ν ^ ) ≥ − ∣ b ′ ∣ − ∣ e 0 ∣ r_{2}\ge b'+\delta\mathcal{E}(\hat{\nu})\ge-|b'|-|e_{0}| r 2 ≥ b ′ + δ E ( ν ^ ) ≥ − ∣ b ′ ∣ − ∣ e 0 ∣ , using δ ∈ J \delta\in J δ ∈ J ; with r 2 < r 1 r_{2}<r_{1} r 2 < r 1 this gives − A < r 2 < r 1 < A -A<r_{2}<r_{1}<A − A < r 2 < r 1 < A . By Bounds, Monotonicity and Borwein-Preiss Perturbed Maximisers of the Wasserstein-Doubled Difference for a Wasserstein-Closed Penalty Pair §bounds and (5b), 0 < Ψ ( μ ^ , ν ^ ) ≤ b − b ′ − δ ( E ( μ ^ ) + E ( ν ^ ) ) 0<\Psi(\hat{\mu},\hat{\nu})\le b-b'-\delta(\mathcal{E}(\hat{\mu})+\mathcal{E}(\hat{\nu})) 0 < Ψ ( μ ^ , ν ^ ) ≤ b − b ′ − δ ( E ( μ ^ ) + E ( ν ^ )) , so δ E ( μ ^ ) < b − b ′ − δ E ( ν ^ ) ≤ b − b ′ − δ e 0 < A \delta\mathcal{E}(\hat{\mu})<b-b'-\delta\mathcal{E}(\hat{\nu})\le b-b'-\delta e_{0}<A δ E ( μ ^ ) < b − b ′ − δ E ( ν ^ ) ≤ b − b ′ − δ e 0 < A , while δ E ( μ ^ ) ≥ δ e 0 ≥ − ∣ e 0 ∣ > − A \delta\mathcal{E}(\hat{\mu})\ge\delta e_{0}\ge-|e_{0}|>-A δ E ( μ ^ ) ≥ δ e 0 ≥ − ∣ e 0 ∣ > − A ; thus δ ∣ E ( μ ^ ) ∣ < A \delta|\mathcal{E}(\hat{\mu})|<A δ ∣ E ( μ ^ ) ∣ < A and likewise δ ∣ E ( ν ^ ) ∣ < A \delta|\mathcal{E}(\hat{\nu})|<A δ ∣ E ( ν ^ ) ∣ < A . Also ∣ E ( μ ^ ) ∣ ≤ ∣ e 0 ∣ + ∣ K ∣ |\mathcal{E}(\hat{\mu})|\le|e_{0}|+|K| ∣ E ( μ ^ ) ∣ ≤ ∣ e 0 ∣ + ∣ K ∣ and ∣ E ( ν ^ ) ∣ ≤ ∣ e 0 ∣ + ∣ K ∣ |\mathcal{E}(\hat{\nu})|\le|e_{0}|+|K| ∣ E ( ν ^ ) ∣ ≤ ∣ e 0 ∣ + ∣ K ∣ , since e 0 ≤ E ≤ K e_{0}\le\mathcal{E}\le K e 0 ≤ E ≤ K at both points. By The Optimal Map as a Square-Integrable Vector Field: Integrability, Transport Cost and Uniqueness of the Class §cost , ∥ i d − S ∥ μ ^ 2 = W ( μ ^ , ν ^ ) 2 \lVert\mathrm{id}-S\rVert_{\hat{\mu}}^{2}=W(\hat{\mu},\hat{\nu})^{2} ∥ id − S ∥ μ ^ 2 = W ( μ ^ , ν ^ ) 2 , so by claim 3 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field and the scaling identity of The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §metric in the real Hilbert space L 2 ( μ ^ ; R d ) L^{2}(\hat{\mu};\mathbb{R}^{d}) L 2 ( μ ^ ; R d ) (Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §fields ),
∥ α ( i d − S ) ∥ μ ^ = α W ( μ ^ , ν ^ ) ≤ 2 α B ˉ , \lVert\alpha(\mathrm{id}-S)\rVert_{\hat{\mu}}=\alpha W(\hat{\mu},\hat{\nu})\le2\alpha\sqrt{\bar{B}}, ∥ α ( id − S ) ∥ μ ^ = α W ( μ ^ , ν ^ ) ≤ 2 α B ˉ ,
and likewise ∥ α ( S ′ − i d ) ∥ ν ^ = α W ( ν ^ , μ ^ ) ≤ 2 α B ˉ \lVert\alpha(S'-\mathrm{id})\rVert_{\hat{\nu}}=\alpha W(\hat{\nu},\hat{\mu})\le2\alpha\sqrt{\bar{B}} ∥ α ( S ′ − id ) ∥ ν ^ = α W ( ν ^ , μ ^ ) ≤ 2 α B ˉ . By The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §triangle and Step 5c, ∥ q 1 ∥ μ ^ ≤ ( 2 α + 4 ) B ˉ < R \lVert q_{1}\rVert_{\hat{\mu}}\le(2\alpha+4)\sqrt{\bar{B}}<R ∥ q 1 ∥ μ ^ ≤ ( 2 α + 4 ) B ˉ < R and ∥ q 2 ∥ ν ^ < R \lVert q_{2}\rVert_{\hat{\nu}}<R ∥ q 2 ∥ ν ^ < R , while ∥ q 1 − α ( i d − S ) ∥ μ ^ = ∥ q ∗ ∥ μ ^ ≤ 4 τ B ˉ < ρ \lVert q_{1}-\alpha(\mathrm{id}-S)\rVert_{\hat{\mu}}=\lVert q^{*}\rVert_{\hat{\mu}}\le4\tau\sqrt{\bar{B}}<\rho ∥ q 1 − α ( id − S ) ∥ μ ^ = ∥ q ∗ ∥ μ ^ ≤ 4 τ B ˉ < ρ and ∥ q 2 − α ( S ′ − i d ) ∥ ν ^ = ∥ q ′ ∗ ∥ ν ^ < ρ \lVert q_{2}-\alpha(S'-\mathrm{id})\rVert_{\hat{\nu}}=\lVert q'^{*}\rVert_{\hat{\nu}}<\rho ∥ q 2 − α ( S ′ − id ) ∥ ν ^ = ∥ q ′ ∗ ∥ ν ^ < ρ . Finally ∥ 0 d ∥ = d S ( d ) ( 0 d , 0 d ) = 0 \lVert0_{d}\rVert=d_{\mathcal{S}(d)}(0_{d},0_{d})=0 ∥ 0 d ∥ = d S ( d ) ( 0 d , 0 d ) = 0 (Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §norm ).
Step 5g (Score bounds). The quadruples ξ = ( μ ^ , r 1 , q 1 , 0 d ) \xi=(\hat{\mu},r_{1},q_{1},0_{d}) ξ = ( μ ^ , r 1 , q 1 , 0 d ) and ζ = ( ν ^ , r 2 , q 2 , 0 d ) \zeta=(\hat{\nu},r_{2},q_{2},0_{d}) ζ = ( ν ^ , r 2 , q 2 , 0 d ) are test data for F F F , as μ ^ , ν ^ ∈ D Σ \hat{\mu},\hat{\nu}\in\mathcal{D}_{\Sigma} μ ^ , ν ^ ∈ D Σ . By Step 5f each is R R R -bounded : the square roots of the second moments are at most B ˉ < R \sqrt{\bar{B}}<R B ˉ < R , the penalties have absolute value at most ∣ e 0 ∣ + ∣ K ∣ < R |e_{0}|+|K|<R ∣ e 0 ∣ + ∣ K ∣ < R , ∣ r 1 ∣ , ∣ r 2 ∣ < A < R |r_{1}|,|r_{2}|<A<R ∣ r 1 ∣ , ∣ r 2 ∣ < A < R , the fields have norm below R R R , and the matrix has norm 0 < R 0<R 0 < R . By (5a), F δ − ( ξ ) − F δ + ( ζ ) ≤ 0 < R F^{-}_{\delta}(\xi)-F^{+}_{\delta}(\zeta)\le0<R F δ − ( ξ ) − F δ + ( ζ ) ≤ 0 < R , so ξ ∈ S δ , R − \xi\in S^{-}_{\delta,R} ξ ∈ S δ , R − and ζ ∈ S δ , R + \zeta\in S^{+}_{\delta,R} ζ ∈ S δ , R + (Test Data for an Intrinsic Second-Order Equation Operator on the Wasserstein Space and the Admissible Sets §admissible ), each witnessing the other. As C C C is a score bound at ( δ , R ) (\delta,R) ( δ , R ) (The Shift-Coercivity Condition for an Equation Operator on the Wasserstein Space §bound ), ∥ Σ ( μ ^ ) ∥ μ ^ ≤ C ≤ R ˉ \lVert\Sigma(\hat{\mu})\rVert_{\hat{\mu}}\le C\le\bar{R} ∥ Σ ( μ ^ ) ∥ μ ^ ≤ C ≤ R ˉ and ∥ Σ ( ν ^ ) ∥ ν ^ ≤ R ˉ \lVert\Sigma(\hat{\nu})\rVert_{\hat{\nu}}\le\bar{R} ∥ Σ ( ν ^ ) ∥ ν ^ ≤ R ˉ .
Step 5h (Removing the perturbation of the momentum). By the choice of ρ \rho ρ in Step 5a (Equation Operators on the Wasserstein Space with Momentum-Continuous Shifts §momentum ), applied at μ ^ \hat{\mu} μ ^ with r 1 r_{1} r 1 , q = q 1 q=q_{1} q = q 1 , q ′ = α ( i d − S ) q'=\alpha(\mathrm{id}-S) q ′ = α ( id − S ) and Y = 0 d Y=0_{d} Y = 0 d , all of which satisfy the bounds there by Steps 5f and 5g (∣ r 1 ∣ < A ≤ R ˉ |r_{1}|<A\le\bar{R} ∣ r 1 ∣ < A ≤ R ˉ , both fields of norm below R ≤ R ˉ R\le\bar{R} R ≤ R ˉ , their difference of norm below ρ \rho ρ , ∥ 0 d ∥ = 0 ≤ R ˉ \lVert0_{d}\rVert=0\le\bar{R} ∥ 0 d ∥ = 0 ≤ R ˉ , ∥ Σ ( μ ^ ) ∥ μ ^ ≤ R ˉ \lVert\Sigma(\hat{\mu})\rVert_{\hat{\mu}}\le\bar{R} ∥ Σ ( μ ^ ) ∥ μ ^ ≤ R ˉ ), and then at ν ^ \hat{\nu} ν ^ with r 2 r_{2} r 2 , q = q 2 q=q_{2} q = q 2 , q ′ = α ( S ′ − i d ) q'=\alpha(S'-\mathrm{id}) q ′ = α ( S ′ − id ) and Y = 0 d Y=0_{d} Y = 0 d , (5a) gives
F δ − ( μ ^ , r 1 , α ( i d − S ) , 0 d ) < κ , − κ < F δ + ( ν ^ , r 2 , α ( S ′ − i d ) , 0 d ) . ( 5 c ) F^{-}_{\delta}\bigl(\hat{\mu},r_{1},\alpha(\mathrm{id}-S),0_{d}\bigr)<\kappa,\qquad-\kappa<F^{+}_{\delta}\bigl(\hat{\nu},r_{2},\alpha(S'-\mathrm{id}),0_{d}\bigr).\qquad(5\mathrm{c}) F δ − ( μ ^ , r 1 , α ( id − S ) , 0 d ) < κ , − κ < F δ + ( ν ^ , r 2 , α ( S ′ − id ) , 0 d ) . ( 5 c )
Step 5i (Properness). By The Bundle of Vector Fields over a Set of Measures, Second-Order Equation Operators on the Wasserstein Space, and Their Delta-Shifts §shifted , F δ − ( μ ^ , r , α ( i d − S ) , 0 d ) F^{-}_{\delta}(\hat{\mu},r,\alpha(\mathrm{id}-S),0_{d}) F δ − ( μ ^ , r , α ( id − S ) , 0 d ) is F F F evaluated at μ ^ \hat{\mu} μ ^ , r + δ E ( μ ^ ) r+\delta\mathcal{E}(\hat{\mu}) r + δ E ( μ ^ ) , α ( i d − S ) + δ Σ ( μ ^ ) \alpha(\mathrm{id}-S)+\delta\Sigma(\hat{\mu}) α ( id − S ) + δ Σ ( μ ^ ) and 0 d + δ H E ( μ ^ ) 0_{d}+\delta H_{\mathcal{E}}(\hat{\mu}) 0 d + δ H E ( μ ^ ) for every r ∈ R r\in\mathbb{R} r ∈ R , the last three arguments not depending on r r r . By (5b) and Step 5f, r 2 + δ E ( μ ^ ) ≤ r 1 + δ E ( μ ^ ) r_{2}+\delta\mathcal{E}(\hat{\mu})\le r_{1}+\delta\mathcal{E}(\hat{\mu}) r 2 + δ E ( μ ^ ) ≤ r 1 + δ E ( μ ^ ) and both have absolute value below A + A = R 0 A+A=R_{0} A + A = R 0 , so the properness constant λ \lambda λ at R 0 R_{0} R 0 (Locally Strictly Proper Second-Order Equation Operator on the Wasserstein Space §constant ) gives
λ ( r 1 − r 2 ) ≤ F δ − ( μ ^ , r 1 , α ( i d − S ) , 0 d ) − F δ − ( μ ^ , r 2 , α ( i d − S ) , 0 d ) . ( 5 d ) \lambda(r_{1}-r_{2})\le F^{-}_{\delta}\bigl(\hat{\mu},r_{1},\alpha(\mathrm{id}-S),0_{d}\bigr)-F^{-}_{\delta}\bigl(\hat{\mu},r_{2},\alpha(\mathrm{id}-S),0_{d}\bigr).\qquad(5\mathrm{d}) λ ( r 1 − r 2 ) ≤ F δ − ( μ ^ , r 1 , α ( id − S ) , 0 d ) − F δ − ( μ ^ , r 2 , α ( id − S ) , 0 d ) . ( 5 d )
Step 5j (The structure condition). The pair ( 0 d , 0 d ) (0_{d},0_{d}) ( 0 d , 0 d ) is admitted at α \alpha α : 0 d ⪯ 0 d 0_{d}\preceq0_{d} 0 d ⪯ 0 d by claim 2 of The Positive Semidefinite Ordering is a Partial Order Compatible with the Linear Structure ; ∥ 0 d ∥ = 0 ≤ 6 α \lVert0_{d}\rVert=0\le6\alpha ∥ 0 d ∥ = 0 ≤ 6 α ; and for z , w ∈ R d z,w\in\mathbb{R}^{d} z , w ∈ R d the products 0 d z 0_{d}z 0 d z and 0 d w 0_{d}w 0 d w are origins, all entries of 0 d 0_{d} 0 d being 0 0 0 (Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §matrices ), so z ⋅ ( 0 d z ) − w ⋅ ( 0 d w ) = 0 z\cdot(0_{d}z)-w\cdot(0_{d}w)=0 z ⋅ ( 0 d z ) − w ⋅ ( 0 d w ) = 0 , which lies between − 3 α ( ∥ z ∥ 2 + ∥ w ∥ 2 ) ≤ 0 -3\alpha(\lVert z\rVert^{2}+\lVert w\rVert^{2})\le0 − 3 α (∥ z ∥ 2 + ∥ w ∥ 2 ) ≤ 0 and 0 ≤ 3 α ∥ z − w ∥ 2 0\le3\alpha\lVert z-w\rVert^{2} 0 ≤ 3 α ∥ z − w ∥ 2 . Further 1 < α 1<\alpha 1 < α , 0 < δ < 1 0<\delta<1 0 < δ < 1 , μ ^ , ν ^ ∈ D Σ \hat{\mu},\hat{\nu}\in\mathcal{D}_{\Sigma} μ ^ , ν ^ ∈ D Σ with both ordered pairs uniquely mapped (Step 5c), S S S and S ′ S' S ′ are optimal maps between them, δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ ) < 2 A = R 0 \delta(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|)<2A=R_{0} δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ ) < 2 A = R 0 and − R 0 ≤ r 2 ≤ R 0 -R_{0}\le r_{2}\le R_{0} − R 0 ≤ r 2 ≤ R 0 (Step 5f). So The Second-Order Structure Condition at Uniquely Mapped Pairs on the Wasserstein Space §pair , for the pair ( ω 1 , ω 2 ) (\omega_{1},\omega_{2}) ( ω 1 , ω 2 ) at R 0 R_{0} R 0 with the value slot r 2 r_{2} r 2 and the matrices ( 0 d , 0 d ) (0_{d},0_{d}) ( 0 d , 0 d ) , gives, writing Ω 1 = ω 1 ( α W ( μ ^ , ν ^ ) 2 + α − 1 ) \Omega_{1}=\omega_{1}\bigl(\alpha W(\hat{\mu},\hat{\nu})^{2}+\alpha^{-1}\bigr) Ω 1 = ω 1 ( α W ( μ ^ , ν ^ ) 2 + α − 1 ) and Ω 2 = ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) \Omega_{2}=\omega_{2}\bigl(\delta(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|+1),\alpha\bigr) Ω 2 = ω 2 ( δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) , α ) ,
− Ω 1 − Ω 2 ≤ F δ − ( μ ^ , r 2 , α ( i d − S ) , 0 d ) − F δ + ( ν ^ , r 2 , α ( S ′ − i d ) , 0 d ) . -\Omega_{1}-\Omega_{2}\le F^{-}_{\delta}\bigl(\hat{\mu},r_{2},\alpha(\mathrm{id}-S),0_{d}\bigr)-F^{+}_{\delta}\bigl(\hat{\nu},r_{2},\alpha(S'-\mathrm{id}),0_{d}\bigr). − Ω 1 − Ω 2 ≤ F δ − ( μ ^ , r 2 , α ( id − S ) , 0 d ) − F δ + ( ν ^ , r 2 , α ( S ′ − id ) , 0 d ) .
Adding this to (5d) and using (5c),
λ ( r 1 − r 2 ) ≤ F δ − ( μ ^ , r 1 , α ( i d − S ) , 0 d ) − F δ + ( ν ^ , r 2 , α ( S ′ − i d ) , 0 d ) + Ω 1 + Ω 2 < 2 κ + Ω 1 + Ω 2 . ( 5 e ) \lambda(r_{1}-r_{2})\le F^{-}_{\delta}\bigl(\hat{\mu},r_{1},\alpha(\mathrm{id}-S),0_{d}\bigr)-F^{+}_{\delta}\bigl(\hat{\nu},r_{2},\alpha(S'-\mathrm{id}),0_{d}\bigr)+\Omega_{1}+\Omega_{2}<2\kappa+\Omega_{1}+\Omega_{2}.\qquad(5\mathrm{e}) λ ( r 1 − r 2 ) ≤ F δ − ( μ ^ , r 1 , α ( id − S ) , 0 d ) − F δ + ( ν ^ , r 2 , α ( S ′ − id ) , 0 d ) + Ω 1 + Ω 2 < 2 κ + Ω 1 + Ω 2 . ( 5 e )
Step 5k (The first modulus). By (1d) with α ′ = α 2 \alpha'=\tfrac{\alpha}{2} α ′ = 2 α , whose coefficient is α 4 \tfrac{\alpha}{4} 4 α , applied to ( μ ^ , ν ^ ) (\hat{\mu},\hat{\nu}) ( μ ^ , ν ^ ) (admissible by Step 5b), then G ( α 2 , δ ) ≤ N ( α 2 ) G(\tfrac{\alpha}{2},\delta)\le N(\tfrac{\alpha}{2}) G ( 2 α , δ ) ≤ N ( 2 α ) , (4a), η 2 ≤ η 1 \eta_{2}\le\eta_{1} η 2 ≤ η 1 , (3a) and τ ≤ η 1 \tau\le\eta_{1} τ ≤ η 1 ,
α 4 W ( μ ^ , ν ^ ) 2 ≤ G ( α 2 , δ ) − G ( α , δ ) + τ < N ( α 2 ) − N ( α ) + η 2 + τ < 3 η 1 , \tfrac{\alpha}{4}W(\hat{\mu},\hat{\nu})^{2}\le G(\tfrac{\alpha}{2},\delta)-G(\alpha,\delta)+\tau<N(\tfrac{\alpha}{2})-N(\alpha)+\eta_{2}+\tau<3\eta_{1}, 4 α W ( μ ^ , ν ^ ) 2 ≤ G ( 2 α , δ ) − G ( α , δ ) + τ < N ( 2 α ) − N ( α ) + η 2 + τ < 3 η 1 ,
so α W ( μ ^ , ν ^ ) 2 < 12 η 1 < t 1 / 2 \alpha W(\hat{\mu},\hat{\nu})^{2}<12\eta_{1}<t_{1}/2 α W ( μ ^ , ν ^ ) 2 < 12 η 1 < t 1 /2 , and with α − 1 < t 1 / 2 \alpha^{-1}<t_{1}/2 α − 1 < t 1 /2 (Step 3) the argument of ω 1 \omega_{1} ω 1 lies in [ 0 , t 1 ] [0,t_{1}] [ 0 , t 1 ] ; hence Ω 1 ≤ κ \Omega_{1}\le\kappa Ω 1 ≤ κ .
Step 5l (The second modulus). By (1c) with δ ′ = δ 2 ∈ J \delta'=\tfrac{\delta}{2}\in J δ ′ = 2 δ ∈ J , applied to ( μ ^ , ν ^ ) (\hat{\mu},\hat{\nu}) ( μ ^ , ν ^ ) , then G ( α , δ 2 ) ≤ N ( α ) G(\alpha,\tfrac{\delta}{2})\le N(\alpha) G ( α , 2 δ ) ≤ N ( α ) and (4a),
δ 2 ( E ( μ ^ ) − e 0 + E ( ν ^ ) − e 0 ) ≤ G ( α , δ 2 ) − G ( α , δ ) + τ < η 2 + τ ≤ t 2 8 + t 2 8 . \tfrac{\delta}{2}\bigl(\mathcal{E}(\hat{\mu})-e_{0}+\mathcal{E}(\hat{\nu})-e_{0}\bigr)\le G(\alpha,\tfrac{\delta}{2})-G(\alpha,\delta)+\tau<\eta_{2}+\tau\le\tfrac{t_{2}}{8}+\tfrac{t_{2}}{8}. 2 δ ( E ( μ ^ ) − e 0 + E ( ν ^ ) − e 0 ) ≤ G ( α , 2 δ ) − G ( α , δ ) + τ < η 2 + τ ≤ 8 t 2 + 8 t 2 .
As E ( μ ^ ) − e 0 ≥ 0 \mathcal{E}(\hat{\mu})-e_{0}\ge0 E ( μ ^ ) − e 0 ≥ 0 , the triangle inequality for ∣ ⋅ ∣ |\cdot| ∣ ⋅ ∣ applied to E ( μ ^ ) = ( E ( μ ^ ) − e 0 ) + e 0 \mathcal{E}(\hat{\mu})=(\mathcal{E}(\hat{\mu})-e_{0})+e_{0} E ( μ ^ ) = ( E ( μ ^ ) − e 0 ) + e 0 gives ∣ E ( μ ^ ) ∣ ≤ E ( μ ^ ) − e 0 + ∣ e 0 ∣ |\mathcal{E}(\hat{\mu})|\le\mathcal{E}(\hat{\mu})-e_{0}+|e_{0}| ∣ E ( μ ^ ) ∣ ≤ E ( μ ^ ) − e 0 + ∣ e 0 ∣ , and likewise for ν ^ \hat{\nu} ν ^ . Multiplying by the positive δ \delta δ and using δ ( 2 ∣ e 0 ∣ + 1 ) < t 2 / 4 \delta(2|e_{0}|+1)<t_{2}/4 δ ( 2∣ e 0 ∣ + 1 ) < t 2 /4 (Step 4),
δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) ≤ δ ( E ( μ ^ ) − e 0 + E ( ν ^ ) − e 0 ) + δ ( 2 ∣ e 0 ∣ + 1 ) < t 2 2 + t 2 4 < t 2 , \delta\bigl(|\mathcal{E}(\hat{\mu})|+|\mathcal{E}(\hat{\nu})|+1\bigr)\le\delta\bigl(\mathcal{E}(\hat{\mu})-e_{0}+\mathcal{E}(\hat{\nu})-e_{0}\bigr)+\delta\bigl(2|e_{0}|+1\bigr)<\tfrac{t_{2}}{2}+\tfrac{t_{2}}{4}<t_{2}, δ ( ∣ E ( μ ^ ) ∣ + ∣ E ( ν ^ ) ∣ + 1 ) ≤ δ ( E ( μ ^ ) − e 0 + E ( ν ^ ) − e 0 ) + δ ( 2∣ e 0 ∣ + 1 ) < 2 t 2 + 4 t 2 < t 2 ,
and the argument is positive; hence Ω 2 ≤ κ \Omega_{2}\le\kappa Ω 2 ≤ κ .
Step 5m (Contradiction). By (5e), Steps 5k and 5l, λ ( r 1 − r 2 ) < 4 κ \lambda(r_{1}-r_{2})<4\kappa λ ( r 1 − r 2 ) < 4 κ . By (5b) and 0 < λ 0<\lambda 0 < λ , λ ( θ − τ ) < λ ( r 1 − r 2 ) \lambda(\theta-\tau)<\lambda(r_{1}-r_{2}) λ ( θ − τ ) < λ ( r 1 − r 2 ) , and λ τ ≤ κ \lambda\tau\le\kappa λ τ ≤ κ (Step 5a), so λ θ < λ τ + 4 κ ≤ 5 κ = 5 8 λ θ \lambda\theta<\lambda\tau+4\kappa\le5\kappa=\tfrac{5}{8}\lambda\theta λ θ < λ τ + 4 κ ≤ 5 κ = 8 5 λ θ , that is 3 8 λ θ < 0 \tfrac{3}{8}\lambda\theta<0 8 3 λ θ < 0 , contradicting 0 < λ θ 0<\lambda\theta 0 < λ θ . Therefore M ( δ , α ) ≤ θ M(\delta,\alpha)\le\theta M ( δ , α ) ≤ θ . For μ ∈ D \mu\in\mathcal{D} μ ∈ D , since W ( μ , μ ) = 0 W(\mu,\mu)=0 W ( μ , μ ) = 0 (The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §separation ),
u δ − ( μ ) − v δ + ( μ ) = Ψ δ , α ( μ , μ ) ≤ M ( δ , α ) ≤ θ . u^{-}_{\delta}(\mu)-v^{+}_{\delta}(\mu)=\Psi_{\delta,\alpha}(\mu,\mu)\le M(\delta,\alpha)\le\theta . u δ − ( μ ) − v δ + ( μ ) = Ψ δ , α ( μ , μ ) ≤ M ( δ , α ) ≤ θ .
As δ \delta δ with 0 < δ < δ 0 0<\delta<\delta_{0} 0 < δ < δ 0 was arbitrary, this is claim A Comparison Principle for First-Order Equations on the Wasserstein Space Relative to a Wasserstein-Closed Penalty Pair §envelopes .
Step 6 (Claim 2). Let μ ∈ D \mu\in\mathcal{D} μ ∈ D and let θ \theta θ be positive; let δ 0 \delta_{0} δ 0 be as in claim 1 for θ \theta θ , and let δ \delta δ be half the least of δ 0 \delta_{0} δ 0 and θ ( 2 ∣ E ( μ ) ∣ + 1 ) − 1 \theta\bigl(2|\mathcal{E}(\mu)|+1\bigr)^{-1} θ ( 2∣ E ( μ ) ∣ + 1 ) − 1 , so that 0 < δ < δ 0 0<\delta<\delta_{0} 0 < δ < δ 0 and 2 δ ∣ E ( μ ) ∣ ≤ θ 2\delta|\mathcal{E}(\mu)|\le\theta 2 δ ∣ E ( μ ) ∣ ≤ θ . Since u u u has penalty-subordinate growth from above and v v v from below (Step 5e), Basic Properties of the Delta-Envelopes on the Wasserstein Space §semicontinuity gives u ( μ ) − δ E ( μ ) ≤ u δ − ( μ ) u(\mu)-\delta\mathcal{E}(\mu)\le u^{-}_{\delta}(\mu) u ( μ ) − δ E ( μ ) ≤ u δ − ( μ ) and v δ + ( μ ) ≤ v ( μ ) + δ E ( μ ) v^{+}_{\delta}(\mu)\le v(\mu)+\delta\mathcal{E}(\mu) v δ + ( μ ) ≤ v ( μ ) + δ E ( μ ) , so by A Comparison Principle for First-Order Equations on the Wasserstein Space Relative to a Wasserstein-Closed Penalty Pair §envelopes
u ( μ ) − v ( μ ) = ( u ( μ ) − δ E ( μ ) ) − ( v ( μ ) + δ E ( μ ) ) + 2 δ E ( μ ) ≤ u δ − ( μ ) − v δ + ( μ ) + 2 δ ∣ E ( μ ) ∣ ≤ 2 θ . u(\mu)-v(\mu)=\bigl(u(\mu)-\delta\mathcal{E}(\mu)\bigr)-\bigl(v(\mu)+\delta\mathcal{E}(\mu)\bigr)+2\delta\mathcal{E}(\mu)\le u^{-}_{\delta}(\mu)-v^{+}_{\delta}(\mu)+2\delta|\mathcal{E}(\mu)|\le2\theta . u ( μ ) − v ( μ ) = ( u ( μ ) − δ E ( μ ) ) − ( v ( μ ) + δ E ( μ ) ) + 2 δ E ( μ ) ≤ u δ − ( μ ) − v δ + ( μ ) + 2 δ ∣ E ( μ ) ∣ ≤ 2 θ .
As θ \theta θ was arbitrary, u ( μ ) − v ( μ ) ≤ 0 u(\mu)-v(\mu)\le0 u ( μ ) − v ( μ ) ≤ 0 by Comparison of Real Numbers with Arbitrary Positive Slack §slack-above , that is u ( μ ) ≤ v ( μ ) u(\mu)\le v(\mu) u ( μ ) ≤ v ( μ ) ; this is claim A Comparison Principle for First-Order Equations on the Wasserstein Space Relative to a Wasserstein-Closed Penalty Pair §comparison .