TheoremBase

A minimising sequence of couplings is tight, so Prokhorov extracts a weakly convergent subsequence; the limit is again a coupling and its cost does not exceed the infimum.

Proof

Each result cited below is universally quantified over the data in its own statement, and is applied to the data named where it is used.

The infimum. By The Quadratic Wasserstein Distance on Euclidean Space (i) the set {I(σ):σ∈Π(μ,ν)}\{I(\sigma):\sigma\in\Pi(\mu,\nu)\} is a nonempty set of real numbers bounded below by 00, its greatest lower bound c∗=inf⁡{I(σ):σ∈Π(μ,ν)}c_{*}=\inf\{I(\sigma):\sigma\in\Pi(\mu,\nu)\} is a nonnegative real number, and W2(μ,ν)W_{2}(\mu,\nu) is its nonnegative square root; hence W2(μ,ν)2=c∗W_{2}(\mu,\nu)^{2}=c_{*} by Existence and Uniqueness of the Nonnegative Square Root. Since c∗c_{*} is a lower bound of that set, every σ∈Π(μ,ν)\sigma\in\Pi(\mu,\nu) satisfies c∗≤I(σ)c_{*}\le I(\sigma); so the final assertion of the statement follows once a coupling of cost c∗c_{*} is produced.

A minimising sequence. Let ιN\iota_{\mathbb{N}} be the embedding of The Canonical Map from the Natural Numbers to a Field of the natural numbers in R\mathbb{R}; for k∈Nk\in\mathbb{N} the number tk=ιN(k)t_{k}=\iota_{\mathbb{N}}(k) is positive by claim 3 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field, so tk−1t_{k}^{-1} exists and is positive by claim 7 of Elementary Order Arithmetic in an Ordered Field, and c∗<c∗+tk−1c_{*}<c_{*}+t_{k}^{-1} by claim 1 of that lemma. By Lower Bound and Greatest Lower Bound the number c∗+tk−1c_{*}+t_{k}^{-1}, being larger than the greatest lower bound, is not a lower bound of {I(σ):σ∈Π(μ,ν)}\{I(\sigma):\sigma\in\Pi(\mu,\nu)\}; choose, for each k∈Nk\in\mathbb{N}, a coupling πk∈Π(μ,ν)\pi_{k}\in\Pi(\mu,\nu) with

I(πk)<c∗+tk−1.I(\pi_{k})<c_{*}+t_{k}^{-1}.

Extraction. By Tightness from Bounded Second Moments, and Tightness of the Couplings of Two Measures with Finite Second Moment (ii) the family Π(μ,ν)\Pi(\mu,\nu) is tight in (Rm+m,dE)(\mathbb{R}^{m+m},d_{E}). The set {πk:k∈N}\{\pi_{k}:k\in\mathbb{N}\} of terms of the sequence (πk)k∈N(\pi_{k})_{k\in\mathbb{N}} is a subset of Π(μ,ν)\Pi(\mu,\nu), so a compact set witnessing the tightness of Π(μ,ν)\Pi(\mu,\nu) for a given tolerance witnesses it for that subset as well; hence the sequence (πk)k∈N(\pi_{k})_{k\in\mathbb{N}} is tight in the sense of Tight Family of Borel Measures on a Metric Space (ii). Its terms belong to P(Rm+m)\mathcal{P}(\mathbb{R}^{m+m}), so by Prokhorov's Theorem on Euclidean Space: a Tight Sequence of Probability Measures Has a Weakly Convergent Subsequence there are a strictly increasing sequence (kj)j∈N(k_{j})_{j\in\mathbb{N}} in N\mathbb{N} and a measure π∈P(Rm+m)\pi\in\mathcal{P}(\mathbb{R}^{m+m}) such that (πkj)j∈N(\pi_{k_{j}})_{j\in\mathbb{N}} converges weakly to π\pi on (Rm+m,dE)(\mathbb{R}^{m+m},d_{E}).

By The Couplings of Two Probability Measures on Euclidean Space are Closed under Weak Convergence, applied to the sequence (πkj)j∈N(\pi_{k_{j}})_{j\in\mathbb{N}}, whose terms lie in Π(μ,ν)\Pi(\mu,\nu), we get π∈Π(μ,ν)\pi\in\Pi(\mu,\nu). In particular I(π)=J(π)I(\pi)=J(\pi) in the notation of Continuity of the Coordinate Projections and of the Quadratic Cost Function, and Passage of a Cost Bound to a Weak Limit.

The cost of the limit. Let ε∈R\varepsilon\in\mathbb{R} be positive. By The Archimedean Property of the Real Numbers there is N∈NN\in\mathbb{N} with ε−1<tN\varepsilon^{-1}<t_{N}, the inverse ε−1\varepsilon^{-1} existing and being positive by claim 7 of Elementary Order Arithmetic in an Ordered Field. Let j∈Nj\in\mathbb{N} satisfy N≤jN\le j. By Strictly Increasing Sequences of Natural Numbers Dominate Their Index we have j≤kjj\le k_{j}, so N≤kjN\le k_{j} and therefore tN≤tkjt_{N}\le t_{k_{j}}: by the trichotomy of claim 3 of Properties of the Order on the Natural Numbers either N=kjN=k_{j}, and the two are equal, or N<kjN<k_{j}, and claim 6 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field gives tN<tkjt_{N}<t_{k_{j}}; hence ε−1<tkj\varepsilon^{-1}<t_{k_{j}} by claim 2 of Elementary Order Arithmetic in an Ordered Field. Multiplying by the positive number ε\varepsilon and then by the positive number tkj−1t_{k_{j}}^{-1}, using claim 10 of Elementary Order Arithmetic in an Ordered Field twice, gives 1<ε tkj1<\varepsilon\,t_{k_{j}} and then tkj−1<εt_{k_{j}}^{-1}<\varepsilon. Consequently

J(πkj)=I(πkj)<c∗+tkj−1<c∗+ε,J(\pi_{k_{j}})=I(\pi_{k_{j}})<c_{*}+t_{k_{j}}^{-1}<c_{*}+\varepsilon ,

so J(πkj)≤c∗+εJ(\pi_{k_{j}})\le c_{*}+\varepsilon for every jj with N≤jN\le j.

Since ε\varepsilon was an arbitrary positive real number, Continuity of the Coordinate Projections and of the Quadratic Cost Function, and Passage of a Cost Bound to a Weak Limit (iii), applied to the sequence (πkj)j∈N(\pi_{k_{j}})_{j\in\mathbb{N}}, its weak limit π\pi and the real number c∗c_{*}, gives J(π)≤c∗J(\pi)\le c_{*}, that is, I(π)≤c∗I(\pi)\le c_{*}. Together with c∗≤I(π)c_{*}\le I(\pi) from the first paragraph this gives

I(π)=c∗=W2(μ,ν)2,I(\pi)=c_{*}=W_{2}(\mu,\nu)^{2},

so π\pi is an optimal coupling of μ\mu and ν\nu in the sense of Optimal Coupling of Two Probability Measures with Finite Second Moment (i). Finally, any π∈Π(μ,ν)\pi\in\Pi(\mu,\nu) with I(π)=W2(μ,ν)2=c∗I(\pi)=W_{2}(\mu,\nu)^{2}=c_{*} satisfies I(π)≤I(σ)I(\pi)\le I(\sigma) for every σ∈Π(μ,ν)\sigma\in\Pi(\mu,\nu), because c∗c_{*} is a lower bound of {I(σ):σ∈Π(μ,ν)}\{I(\sigma):\sigma\in\Pi(\mu,\nu)\}.

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…