TheoremBase

Split the Gibbs entropy into the Gaussian entropy plus the potential energy and the score into the Gaussian score plus the noise gradient of V. The Gaussian part is beta/kappa-displacement convex by the Gaussian lemma, and integrating the tangent inequality of V over the optimal coupling contributes -K.

Proof

Each result cited is universally quantified over the data in its own statement. Elementary real-number order and arithmetic are carried by The Real Numbers: Standing Notation and Background §background and are not cited step by step.

Let γβV\gamma^{V}_{\beta} be the Gibbs measure of VV at temperature β\beta, with normaliser ZV,β>0Z_{V,\beta}>0 (The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §normaliser), and let (DG,DΣG,EG,ΣG)(\mathcal{D}^{G},\mathcal{D}^{G}_{\Sigma},\mathcal{E}^{G},\Sigma^{G}) be the Gaussian entropy pair with temperature β\beta; its hypothesis holds with the given κ\kappa, since ck≤κakc_{k}\le\kappa a_{k} for every kk. Fix μ∈DΣ\mu\in\mathcal{D}_{\Sigma}, ν∈D\nu\in\mathcal{D} and a noise-optimal coupling π∈Πa(μ,ν)\pi\in\Pi^{a}(\mu,\nu); write x=π1(z)x=\pi_{1}(z), y=π2(z)y=\pi_{2}(z) for z∈X×Xz\in X\times X.

Step 1 (Splitting the penalty). By The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain and The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain, μ,ν\mu,\nu have finite relative entropy with respect to γβV\gamma^{V}_{\beta}, so by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy they have finite relative entropy with respect to γc\gamma_{c}, VV is integrable with respect to both, and, multiplying the identity there by β\beta and using the definition of E\mathcal{E} in The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §pair and of EG\mathcal{E}^{G} in The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §pair,

E(μ)=EG(μ)+∫XV dμ+βlog⁡ZV,β,E(ν)=EG(ν)+∫XV dν+βlog⁡ZV,β.(1)\mathcal{E}(\mu)=\mathcal{E}^{G}(\mu)+\int_{X}V\,d\mu+\beta\log Z_{V,\beta},\qquad\mathcal{E}(\nu)=\mathcal{E}^{G}(\nu)+\int_{X}V\,d\nu+\beta\log Z_{V,\beta}.\tag{1}

In particular μ,ν∈DG\mu,\nu\in\mathcal{D}^{G} by The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §penalty-domain.

Step 2 (Splitting the score). By The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain, μ\mu has a relative score with respect to γc\gamma_{c} and finite Fisher information relative to γc\gamma_{c} with weights aa, and ∫X∣∇aV∣a2 dμ<∞\int_{X}|\nabla_{a}V|_{a}^{2}\,d\mu<\infty. Hence μ∈DΣG\mu\in\mathcal{D}^{G}_{\Sigma} by The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §score-domain, with ΣG(μ)=βZμa\Sigma^{G}(\mu)=\beta Z^{a}_{\mu}, and the class of ∇aV\nabla_{a}V lies in L2(μ;Xa)L^{2}(\mu;X^{a}) by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §tangent. Since Σ(μ)=βZμa+∇aV\Sigma(\mu)=\beta Z^{a}_{\mu}+\nabla_{a}V by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §pair, linearity of the noise displacement pairing in the field, Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §linear (with s=t=1s=t=1), gives

Ja(Σ(μ),π)=Ja(ΣG(μ),π)+Ja(∇aV,π).(2)\mathcal{J}^{a}(\Sigma(\mu),\pi)=\mathcal{J}^{a}(\Sigma^{G}(\mu),\pi)+\mathcal{J}^{a}(\nabla_{a}V,\pi).\tag{2}

Step 3 (The Gaussian part). π\pi is a noise-optimal coupling in Πa(μ,ν)\Pi^{a}(\mu,\nu) with μ∈DΣG\mu\in\mathcal{D}^{G}_{\Sigma} and ν∈DG\nu\in\mathcal{D}^{G}, so The Gaussian Entropy Pair is Uniformly Displacement Convex, with Modulus the Temperature over the Variance-to-Noise Bound §convex gives

EG(μ)+Ja(ΣG(μ),π)+β2κIa(π)≤EG(ν).(3)\mathcal{E}^{G}(\mu)+\mathcal{J}^{a}(\Sigma^{G}(\mu),\pi)+\frac{\beta}{2\kappa}I^{a}(\pi)\le\mathcal{E}^{G}(\nu).\tag{3}

Step 4 (The potential part). Let DaD_{a}, cac_{a} be as in The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §pairs and let δ\delta be the displacement field of Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §displacement-field for π\pi, so δ(z)=y−x\delta(z)=y-x on DaD_{a}. Consider the functions on X×XX\times X

f1(z)=V(x),f2(z)=V(y),P(z)=⟨∇aV(x),δ(z)⟩a,ca(z).f_{1}(z)=V(x),\qquad f_{2}(z)=V(y),\qquad P(z)=\langle\nabla_{a}V(x),\delta(z)\rangle_{a},\qquad c_{a}(z).

VV is Borel by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity and π1,π2\pi_{1},\pi_{2} are Borel by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §product-sigma; since (π1)#π=μ(\pi_{1})_{\#}\pi=\mu and (π2)#π=ν(\pi_{2})_{\#}\pi=\nu (Couplings of Two Borel Probability Measures on a Hilbert Space and Their Quadratic Cost §coupling), claim 2 of Image Measures, Measures with Densities, and Change of Variables shows that f1,f2f_{1},f_{2} are integrable with respect to π\pi, with ∫f1 dπ=∫XV dμ\int f_{1}\,d\pi=\int_{X}V\,d\mu and ∫f2 dπ=∫XV dν\int f_{2}\,d\pi=\int_{X}V\,d\nu. By Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §pairing (with η\eta the class of ∇aV\nabla_{a}V, represented by ∇aV\nabla_{a}V itself), PP is Borel and integrable with ∫P dπ=Ja(∇aV,π)\int P\,d\pi=\mathcal{J}^{a}(\nabla_{a}V,\pi). Since π\pi has finite noise cost, cac_{a} is Borel, nonnegative and integrable with ∫ca dπ=Ia(π)\int c_{a}\,d\pi=I^{a}(\pi), and π(Da)=1\pi(D_{a})=1 (Couplings of Finite Noise Cost and Their Noise Cost §finite, Couplings of Finite Noise Cost and Their Noise Cost §cost). Hence, by Linearity and Monotonicity of the Lebesgue Integral §integrable, A=f2−f1−P+K2caA=f_{2}-f_{1}-P+\tfrac{K}{2}c_{a} is integrable with

∫X×XA dπ=∫XV dν−∫XV dμ−Ja(∇aV,π)+K2Ia(π).\int_{X\times X}A\,d\pi=\int_{X}V\,d\nu-\int_{X}V\,d\mu-\mathcal{J}^{a}(\nabla_{a}V,\pi)+\frac{K}{2}I^{a}(\pi).

For z∈Daz\in D_{a} we have y−x∈Xay-x\in X^{a}, δ(z)=y−x\delta(z)=y-x and ca(z)=∣y−x∣a2c_{a}(z)=|y-x|_{a}^{2} (Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §noise-space), so Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §tangent-inequality gives A(z)≥0A(z)\ge0. Thus the negative part A−=max⁡(−A,0)A^{-}=\max(-A,0) of Integrable Function and the Lebesgue Integral, a nonnegative measurable function, vanishes off the set (X×X)∖Da(X\times X)\setminus D_{a}, which is π\pi-null as π(Da)=1=π(X×X)\pi(D_{a})=1=\pi(X\times X); by The Lebesgue Integral and Null Sets: Almost-Everywhere Comparison, Markov's Inequality, and Dominated Convergence Almost Everywhere §null-integral, ∫A− dπ=0\int A^{-}\,d\pi=0, so ∫A dπ=∫A+ dπ−∫A− dπ=∫A+ dπ≥0\int A\,d\pi=\int A^{+}\,d\pi-\int A^{-}\,d\pi=\int A^{+}\,d\pi\ge0 (Integrable Function and the Lebesgue Integral). Therefore

∫XV dμ+Ja(∇aV,π)−K2Ia(π)≤∫XV dν.(4)\int_{X}V\,d\mu+\mathcal{J}^{a}(\nabla_{a}V,\pi)-\frac{K}{2}I^{a}(\pi)\le\int_{X}V\,d\nu.\tag{4}

Step 5 (Claim 1). Adding (3), (4) and βlog⁡ZV,β\beta\log Z_{V,\beta} to both sides, and using (1) and (2),

E(μ)+Ja(Σ(μ),π)+12(βκ−K)Ia(π)≤E(ν).\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)+\frac{1}{2}\Bigl(\frac{\beta}{\kappa}-K\Bigr)I^{a}(\pi)\le\mathcal{E}(\nu).

As μ\mu, ν\nu and π\pi were arbitrary, the pair, a noise penalty pair by The Gibbs Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair, is (βκ−K)(\frac{\beta}{\kappa}-K)-displacement convex in the sense of Lambda-Displacement Convexity of a Noise Penalty Pair §convex.

Step 6 (Claim 2). If K≤β/κK\le\beta/\kappa, then 12(βκ−K)Ia(π)≥0\tfrac12(\tfrac{\beta}{\kappa}-K)I^{a}(\pi)\ge0, since Ia(π)≥0I^{a}(\pi)\ge0 by Couplings of Finite Noise Cost and Their Noise Cost §cost. So the inequality of Step 5 gives E(μ)+Ja(Σ(μ),π)+02Ia(π)≤E(ν)\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)+\tfrac{0}{2}I^{a}(\pi)\le\mathcal{E}(\nu) for all such μ,ν,π\mu,\nu,\pi, i.e. the pair is 00-displacement convex, which is displacement convexity.

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…