TheoremBase

Wasserstein convergence implies weak convergence, under which sublevel sets of relative entropy are closed, so limits of sublevel sequences stay in the domain with the same bound; the sublevel sets are moment-bounded by the moment bound of the free-energy pair.

Proof

Each result cited is universally quantified over the data in its own statement.

We work in the settings of The Real Numbers: Standing Notation and Background and The Intrinsic Calculus on the Wasserstein Space: Standing Notation; elementary order and arithmetic of real numbers is carried by The Real Numbers: Standing Notation and Background §background. The quadruple is a penalty pair by The Gaussian Free-Energy Pair is a Penalty Pair: Translations, the First Variation, Lower Semicontinuity, the Moment Bound and the Map Property §pair, so Wasserstein-Closed Penalty Pairs §w2-closed applies to it. Since the letter cc denotes the variance vector here, we write ℓ∈R\ell\in\mathbb{R} for the level called cc in that definition; fix such an ℓ\ell. By The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair, D\mathcal{D} is the set of μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) of finite relative entropy with respect to γc\gamma_{c}, and E(μ)=a H(μ ∣ γc)\mathcal{E}(\mu)=a\,H(\mu\,|\,\gamma_{c}); the measure γc\gamma_{c} is a probability measure on Rd\mathbb{R}^{d} by Diagonal Gaussian Measures on Euclidean Space §measure.

Step 1 (closed sublevel sets). Let (μn)n∈N(\mu_{n})_{n\in\mathbb{N}} be a sequence in D\mathcal{D} with E(μn)≤ℓ\mathcal{E}(\mu_{n})\le\ell for every nn, converging in (P2(Rd),W2)(\mathcal{P}_{2}(\mathbb{R}^{d}),W_{2}) to some μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). By Convergent Sequence in a Metric Space, for every positive ε\varepsilon there is N∈NN\in\mathbb{N} with W2(μn,μ)<εW_{2}(\mu_{n},\mu)<\varepsilon for all n≥Nn\ge N; as W2(μn,μ)W_{2}(\mu_{n},\mu) is nonnegative by The Quadratic Wasserstein Distance on Euclidean Space §distance, ∣W2(μn,μ)−0∣=W2(μn,μ)<ε|W_{2}(\mu_{n},\mu)-0|=W_{2}(\mu_{n},\mu)<\varepsilon for those nn, so lim⁡n→∞W2(μn,μ)=0\lim_{n\to\infty}W_{2}(\mu_{n},\mu)=0 in the sense of Limit of a Sequence of Real Numbers. Hence Convergence in the Wasserstein Distance Implies Weak Convergence and Convergence of Integrals of Continuous Functions of Quadratic Growth §weak, read with m=dm=d, gives μn⇒μ\mu_{n}\Rightarrow\mu.

Step 2. Each μn\mu_{n} has finite relative entropy with respect to γc\gamma_{c}, and since aa is positive, a H(μn ∣ γc)=E(μn)≤ℓa\,H(\mu_{n}\,|\,\gamma_{c})=\mathcal{E}(\mu_{n})\le\ell gives H(μn ∣ γc)≤ℓaH(\mu_{n}\,|\,\gamma_{c})\le\tfrac{\ell}{a}. Apply Relative Entropy on Euclidean Space: the Gibbs Inequality, a Variational Criterion for Finite Relative Entropy, and Closed Sublevel Sets under Weak Convergence §closed with m=dm=d, γ=γc\gamma=\gamma_{c}, level ℓa\tfrac{\ell}{a}, the sequence (μn)(\mu_{n}) in P(Rd)\mathcal{P}(\mathbb{R}^{d}) and the limit μ∈P2(Rd)⊆P(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d})\subseteq\mathcal{P}(\mathbb{R}^{d}); the weak convergence there is the same weak convergence for the Euclidean distance as in Step 1. It gives that μ\mu has finite relative entropy with respect to γc\gamma_{c} and H(μ ∣ γc)≤ℓaH(\mu\,|\,\gamma_{c})\le\tfrac{\ell}{a}. As μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), this means μ∈D\mu\in\mathcal{D} by The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair, and multiplying by the positive number aa gives E(μ)=a H(μ ∣ γc)≤ℓ\mathcal{E}(\mu)=a\,H(\mu\,|\,\gamma_{c})\le\ell. This is condition Wasserstein-Closed Penalty Pairs §closed at level ℓ\ell.

Step 3 (bounded sublevel sets). Let cmax⁡c_{\max} be the greatest variance, which is positive by The Diagonal Gaussian Density on Euclidean Space and Its Notation §variances, so 4cmax⁡a\tfrac{4c_{\max}}{a} is positive. Put B=4cmax⁡a ℓ+2∑i=1dciB=\tfrac{4c_{\max}}{a}\,\ell+2\sum_{i=1}^{d}c_{i}. For μ∈D\mu\in\mathcal{D} with E(μ)≤ℓ\mathcal{E}(\mu)\le\ell, The Gaussian Free-Energy Pair is a Penalty Pair: Translations, the First Variation, Lower Semicontinuity, the Moment Bound and the Map Property §moment gives

M2(μ)≤4cmax⁡a E(μ)+2∑i=1dci≤4cmax⁡a ℓ+2∑i=1dci=B.M_{2}(\mu)\le\frac{4c_{\max}}{a}\,\mathcal{E}(\mu)+2\sum_{i=1}^{d}c_{i}\le\frac{4c_{\max}}{a}\,\ell+2\sum_{i=1}^{d}c_{i}=B .

This is condition Wasserstein-Closed Penalty Pairs §bounded at level ℓ\ell.

As ℓ\ell was arbitrary, both conditions hold at every level, and the pair is Wasserstein-closed by Wasserstein-Closed Penalty Pairs §w2-closed. ■\blacksquare

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…