TheoremBase

The noise-optimal coupling is given by a noise-optimal map T, and the Euclidean uniform displacement convexity of the Gaussian free-energy pair is applied to the rescaled heads with the bound ck/akc_k/a_k <= kappa. Lifting the head inequality to the noise tangent space and passing to the limit with the head approximations of the score field and of T - id gives the beta/kappa inequality, and dropping the nonnegative cost term gives displacement convexity.

Proof

Each result cited is universally quantified over the data in its own statement.

Let μ∈DΣ\mu\in\mathcal{D}_{\Sigma}, let ν∈D\nu\in\mathcal{D}, and let π∈Πa(μ,ν)\pi\in\Pi^{a}(\mu,\nu) be a noise-optimal coupling. Write ⟨⋅,⋅⟩μ\langle\cdot,\cdot\rangle_{\mu} and ∥⋅∥μ\lVert\cdot\rVert_{\mu} for the inner product and norm of L2(μ;Xa)L^{2}(\mu;X^{a}), a real Hilbert space by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §fields, in particular a real inner product space. By The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §penalty-domain and The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §score-domain, μ\mu and ν\nu have finite relative entropy with respect to γc\gamma_{c} and lie in Pρa\mathcal{P}^{a}_{\rho} and in P2(X)\mathcal{P}_{2}(X), and μ\mu has a relative score with respect to γc\gamma_{c} and finite Fisher information relative to γc\gamma_{c} with weights aa; by The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §pair, E(μ)=βH(μ ∣ γc)\mathcal{E}(\mu)=\beta H(\mu\,|\,\gamma_{c}), E(ν)=βH(ν ∣ γc)\mathcal{E}(\nu)=\beta H(\nu\,|\,\gamma_{c}) and Σ(μ)=βZμa\Sigma(\mu)=\beta Z^{a}_{\mu}, with ZμaZ^{a}_{\mu} the noise score field of The Noise Score Field of a Measure of Finite Weighted Fisher Information: Existence, Norm, Pairing with Noise Gradients, Head Approximation and Tangency §field.

Step 1 (the noise-optimal map). Since ck≤κakc_{k}\le\kappa a_{k} for every k∈Nk\in\mathbb{N}, the set D\mathcal{D} is the set DH\mathcal{D}_{H} of The Entropy Domain of a Diagonal Gaussian Reference Measure Has the Noise Map Property, so it has the noise map property by The Entropy Domain of a Diagonal Gaussian Reference Measure Has the Noise Map Property §map-property. As μ∈D\mu\in\mathcal{D} and ν∈Pρa\nu\in\mathcal{P}^{a}_{\rho}, the ordered pair (μ,ν)(\mu,\nu) is uniquely noise-mapped by The Noise Map Property of a Set of Probability Measures §map-property, so by Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §uniquely-mapped there is a noise-optimal map TT from μ\mu to ν\nu such that every noise-optimal coupling of μ\mu and ν\nu equals (id,T)#μ(\mathrm{id},T)_{\#}\mu; hence π=(id,T)#μ\pi=(\mathrm{id},T)_{\#}\mu. By Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §map, T#μ=νT_{\#}\mu=\nu and the map x↦T(x)−xx\mapsto T(x)-x is measurable into XaX^{a} and square-integrable with respect to μ\mu; let h=T−id∈L2(μ;Xa)h=T-\mathrm{id}\in L^{2}(\mu;X^{a}) be its class. Apply Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §displacement to hh, with its representative x↦T(x)−xx\mapsto T(x)-x and with t=1t=1: the map StS_{t} there at t=1t=1 is x↦x+(T(x)−x)=T(x)x\mapsto x+(T(x)-x)=T(x), so it equals TT, it pushes μ\mu forward to ν\nu, and the coupling (id,St)#μ(\mathrm{id},S_{t})_{\#}\mu at t=1t=1 is (id,T)#μ=π(\mathrm{id},T)_{\#}\mu=\pi, and that clause gives

Ia(π)=∥h∥μ2,Ja(η,π)=⟨η,h⟩μfor every η∈L2(μ;Xa).(1)I^{a}(\pi)=\lVert h\rVert_{\mu}^{2},\qquad\mathcal{J}^{a}(\eta,\pi)=\langle\eta,h\rangle_{\mu}\quad\text{for every }\eta\in L^{2}(\mu;X^{a}).\tag{1}

Step 2 (the inequality for the rescaled heads). Fix n∈Nn\in\mathbb{N}; the Euclidean items cited below are read with d=nd=n (each is stated for every dimension dd), as A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation §euclidean does for the items listed there. Since μ,ν∈P2(X)\mu,\nu\in\mathcal{P}_{2}(X), the rescaled heads μ~n\tilde{\mu}_{n} and ν~n\tilde{\nu}_{n} of A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation §heads lie in P2(Rn)\mathcal{P}_{2}(\mathbb{R}^{n}) by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §head. By Gaussian-Tail Extensions: the Gaussian Reference Measure, Marginals, Densities, Relative Entropy, Relative Score and the Noise Wasserstein Distance §heads, applied to μ\mu and to ν\nu, both μ~n\tilde{\mu}_{n} and ν~n\tilde{\nu}_{n} have finite relative entropy with respect to γ~n\tilde{\gamma}_{n}, the sequence (H(μ~m ∣ γ~m))m∈N\bigl(H(\tilde{\mu}_{m}\,|\,\tilde{\gamma}_{m})\bigr)_{m\in\mathbb{N}} converges to H(μ ∣ γc)H(\mu\,|\,\gamma_{c}), and H(ν~n ∣ γ~n)=H((pn)#ν ∣ γc(n))H(\tilde{\nu}_{n}\,|\,\tilde{\gamma}_{n})=H((p_{n})_{\#}\nu\,|\,\gamma_{c^{(n)}}). As γc(n)=(pn)#γc\gamma_{c^{(n)}}=(p_{n})_{\#}\gamma_{c} by Diagonal Gaussian Measures on a Hilbert Space §measure, Relative Entropy of the Finite-Dimensional Projections of Borel Probability Measures on a Hilbert Space: Monotonicity and Approximation §projections gives

H(ν~n ∣ γ~n)≤H(ν ∣ γc).(2)H(\tilde{\nu}_{n}\,|\,\tilde{\gamma}_{n})\le H(\nu\,|\,\gamma_{c}).\tag{2}

Since μ\mu has a relative score with respect to γc\gamma_{c}, μ~n\tilde{\mu}_{n} has finite Fisher information relative to γ~n\tilde{\gamma}_{n} by The Relative Score of the Rescaled Head: Projections of the Score, the Ornstein-Uhlenbeck Functional of the Head, and the Converse under Bounded Head Fisher Information §head-score; write ζn=ζμ~nc~(n)∈L2(μ~n;Rn)\zeta_{n}=\zeta^{\tilde{c}^{(n)}}_{\tilde{\mu}_{n}}\in L^{2}(\tilde{\mu}_{n};\mathbb{R}^{n}) for its relative score. Let (Dn,DΣ,n,En,Σn)(\mathcal{D}_{n},\mathcal{D}_{\Sigma,n},\mathcal{E}_{n},\Sigma_{n}) be the Gaussian free-energy pair with variances c~(n)\tilde{c}^{(n)}, a variance vector by A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation §heads, and temperature β\beta. By that definition and what was just shown, ν~n∈Dn\tilde{\nu}_{n}\in\mathcal{D}_{n}, μ~n∈DΣ,n\tilde{\mu}_{n}\in\mathcal{D}_{\Sigma,n}, En(μ~n)=βH(μ~n ∣ γ~n)\mathcal{E}_{n}(\tilde{\mu}_{n})=\beta H(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n}), En(ν~n)=βH(ν~n ∣ γ~n)\mathcal{E}_{n}(\tilde{\nu}_{n})=\beta H(\tilde{\nu}_{n}\,|\,\tilde{\gamma}_{n}) and Σn(μ~n)=βζn\Sigma_{n}(\tilde{\mu}_{n})=\beta\zeta_{n}.

The set Dn\mathcal{D}_{n} has the map property by The Gaussian Free-Energy Pair is a Penalty Pair: Translations, the First Variation, Lower Semicontinuity, the Moment Bound and the Map Property §maps, so by The Map Property of a Set of Probability Measures §map-property the ordered pair (μ~n,ν~n)(\tilde{\mu}_{n},\tilde{\nu}_{n}) is uniquely mapped, and by Optimal Transport Maps and Uniquely Mapped Pairs of Probability Measures §uniquely-mapped and Optimal Transport Maps and Uniquely Mapped Pairs of Probability Measures §map there is a Borel map Sn:Rn→RnS_{n}:\mathbb{R}^{n}\to\mathbb{R}^{n} with (Sn)#μ~n=ν~n(S_{n})_{\#}\tilde{\mu}_{n}=\tilde{\nu}_{n} such that πn=(id,Sn)#μ~n\pi_{n}=(\mathrm{id},S_{n})_{\#}\tilde{\mu}_{n} is an optimal coupling of μ~n\tilde{\mu}_{n} and ν~n\tilde{\nu}_{n}. The maps SnS_{n} (n∈Nn\in\mathbb{N}) satisfy the hypothesis of Lifted Optimal Maps between Rescaled Heads Converge Strongly to the Noise-Optimal Displacement, which applies to μ,ν∈Pρa\mu,\nu\in\mathcal{P}^{a}_{\rho}, the pair (μ,ν)(\mu,\nu) being uniquely noise-mapped with noise-optimal map TT by Step 1. By Lifted Optimal Maps between Rescaled Heads Converge Strongly to the Noise-Optimal Displacement §cost, ∫Rn∥Sn(u)−u∥2 μ~n(du)\int_{\mathbb{R}^{n}}\lVert S_{n}(u)-u\rVert^{2}\,\tilde{\mu}_{n}(du) is finite, so The Displacement Pairing of a Square-Integrable Vector Field Along a Coupling §displacement, applied with S=SnS=S_{n} (for which πS=πn\pi_{S}=\pi_{n}), gives that the class Sn−idS_{n}-\mathrm{id} lies in L2(μ~n;Rn)L^{2}(\tilde{\mu}_{n};\mathbb{R}^{n}) and, with J\mathcal{J} and II the displacement pairing and cost of The Intrinsic Calculus on the Wasserstein Space: Standing Notation §couplings,

I(πn)=∥Sn−id∥μ~n2,J(βζn,πn)=⟨βζn,Sn−id⟩μ~n=β ⟨ζn,Sn−id⟩μ~n.I(\pi_{n})=\lVert S_{n}-\mathrm{id}\rVert_{\tilde{\mu}_{n}}^{2},\qquad\mathcal{J}(\beta\zeta_{n},\pi_{n})=\langle\beta\zeta_{n},S_{n}-\mathrm{id}\rangle_{\tilde{\mu}_{n}}=\beta\,\langle\zeta_{n},S_{n}-\mathrm{id}\rangle_{\tilde{\mu}_{n}} .

By The Gaussian Free-Energy Pair is Uniformly Displacement Convex, with Closed Score Along Couplings and Regular Penalised Maxima §convex the pair (Dn,DΣ,n,En,Σn)(\mathcal{D}_{n},\mathcal{D}_{\Sigma,n},\mathcal{E}_{n},\Sigma_{n}) is βc~max⁡(n)\frac{\beta}{\tilde{c}^{(n)}_{\max}}-displacement convex, with c~max⁡(n)\tilde{c}^{(n)}_{\max} the greatest variance of The Diagonal Gaussian Density on Euclidean Space and Its Notation §variances; applying λ\lambda-Displacement Convexity of a Penalty Pair on the Wasserstein Space §convex to μ~n\tilde{\mu}_{n}, ν~n\tilde{\nu}_{n} and πn\pi_{n},

βH(μ~n ∣ γ~n)+β ⟨ζn,Sn−id⟩μ~n+β2c~max⁡(n) ∥Sn−id∥μ~n2≤βH(ν~n ∣ γ~n).\beta H(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n})+\beta\,\langle\zeta_{n},S_{n}-\mathrm{id}\rangle_{\tilde{\mu}_{n}}+\frac{\beta}{2\tilde{c}^{(n)}_{\max}}\,\lVert S_{n}-\mathrm{id}\rVert_{\tilde{\mu}_{n}}^{2}\le\beta H(\tilde{\nu}_{n}\,|\,\tilde{\gamma}_{n}).

By The Diagonal Gaussian Density on Euclidean Space and Its Notation §variances there is j∈[n]j\in[n] with c~max⁡(n)=cj/aj\tilde{c}^{(n)}_{\max}=c_{j}/a_{j}, and cj/aj≤κc_{j}/a_{j}\le\kappa because cj≤κajc_{j}\le\kappa a_{j} and aj>0a_{j}>0; since c~max⁡(n)>0\tilde{c}^{(n)}_{\max}>0, β>0\beta>0 and ∥Sn−id∥μ~n2≥0\lVert S_{n}-\mathrm{id}\rVert_{\tilde{\mu}_{n}}^{2}\ge0, the coefficient β2c~max⁡(n)\frac{\beta}{2\tilde{c}^{(n)}_{\max}} may be replaced by the smaller β2κ\frac{\beta}{2\kappa} without affecting the inequality.

Step 3 (lifting). Let un=Λnζnu_{n}=\Lambda_{n}\zeta_{n} and vn=Λn(Sn−id)v_{n}=\Lambda_{n}(S_{n}-\mathrm{id}), elements of L2(μ;Xa)L^{2}(\mu;X^{a}) by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §lift. That clause gives ⟨Λnξ,Λnη⟩μ=⟨ξ,η⟩μ~n\langle\Lambda_{n}\xi,\Lambda_{n}\eta\rangle_{\mu}=\langle\xi,\eta\rangle_{\tilde{\mu}_{n}} for all ξ,η∈L2(μ~n;Rn)\xi,\eta\in L^{2}(\tilde{\mu}_{n};\mathbb{R}^{n}); with (ξ,η)=(ζn,Sn−id)(\xi,\eta)=(\zeta_{n},S_{n}-\mathrm{id}) and with ξ=η=Sn−id\xi=\eta=S_{n}-\mathrm{id} it yields ⟨ζn,Sn−id⟩μ~n=⟨un,vn⟩μ\langle\zeta_{n},S_{n}-\mathrm{id}\rangle_{\tilde{\mu}_{n}}=\langle u_{n},v_{n}\rangle_{\mu} and ∥Sn−id∥μ~n2=∥vn∥μ2\lVert S_{n}-\mathrm{id}\rVert_{\tilde{\mu}_{n}}^{2}=\lVert v_{n}\rVert_{\mu}^{2}. Together with Step 2 and (2), for every n∈Nn\in\mathbb{N},

βH(μ~n ∣ γ~n)+β ⟨un,vn⟩μ+β2κ ∥vn∥μ2≤βH(ν ∣ γc).(3)\beta H(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n})+\beta\,\langle u_{n},v_{n}\rangle_{\mu}+\frac{\beta}{2\kappa}\,\lVert v_{n}\rVert_{\mu}^{2}\le\beta H(\nu\,|\,\gamma_{c}).\tag{3}

Step 4 (the limit). By The Noise Score Field of a Measure of Finite Weighted Fisher Information: Existence, Norm, Pairing with Noise Gradients, Head Approximation and Tangency §head, ∥Zμa−un∥μ2→0\lVert Z^{a}_{\mu}-u_{n}\rVert_{\mu}^{2}\to0, hence ∥un−Zμa∥μ→0\lVert u_{n}-Z^{a}_{\mu}\rVert_{\mu}\to0 (a nonnegative real whose square is below ε2\varepsilon^{2} is below ε\varepsilon), that is, (un)(u_{n}) converges to ZμaZ^{a}_{\mu} in the metric of L2(μ;Xa)L^{2}(\mu;X^{a}); by Lifted Optimal Maps between Rescaled Heads Converge Strongly to the Noise-Optimal Displacement §convergence, (vn)(v_{n}) converges to hh likewise. By The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §continuity, ⟨un,vn⟩μ→⟨Zμa,h⟩μ\langle u_{n},v_{n}\rangle_{\mu}\to\langle Z^{a}_{\mu},h\rangle_{\mu} and ∥vn∥μ→∥h∥μ\lVert v_{n}\rVert_{\mu}\to\lVert h\rVert_{\mu}, so ∥vn∥μ2→∥h∥μ2\lVert v_{n}\rVert_{\mu}^{2}\to\lVert h\rVert_{\mu}^{2} by the product rule for limits; and H(μ~n ∣ γ~n)→H(μ ∣ γc)H(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n})\to H(\mu\,|\,\gamma_{c}) by Step 2. By the sum rule and the scalar rule for limits, the left side of (3) converges to βH(μ ∣ γc)+β⟨Zμa,h⟩μ+β2κ∥h∥μ2\beta H(\mu\,|\,\gamma_{c})+\beta\langle Z^{a}_{\mu},h\rangle_{\mu}+\frac{\beta}{2\kappa}\lVert h\rVert_{\mu}^{2}, and the comparison claim (claim 1) of Order Properties of Limits of Real Sequences, applied with the constant right side of (3), gives

βH(μ ∣ γc)+β ⟨Zμa,h⟩μ+β2κ ∥h∥μ2≤βH(ν ∣ γc).\beta H(\mu\,|\,\gamma_{c})+\beta\,\langle Z^{a}_{\mu},h\rangle_{\mu}+\frac{\beta}{2\kappa}\,\lVert h\rVert_{\mu}^{2}\le\beta H(\nu\,|\,\gamma_{c}).

By (1) with η=βZμa=Σ(μ)\eta=\beta Z^{a}_{\mu}=\Sigma(\mu) and homogeneity of the inner product, Ja(Σ(μ),π)=β⟨Zμa,h⟩μ\mathcal{J}^{a}(\Sigma(\mu),\pi)=\beta\langle Z^{a}_{\mu},h\rangle_{\mu}, and Ia(π)=∥h∥μ2I^{a}(\pi)=\lVert h\rVert_{\mu}^{2}; with the values of E(μ)\mathcal{E}(\mu) and E(ν)\mathcal{E}(\nu) recalled above, this is

E(μ)+Ja(Σ(μ),π)+β2κ Ia(π)≤E(ν).\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)+\frac{\beta}{2\kappa}\,I^{a}(\pi)\le\mathcal{E}(\nu).

As μ\mu, ν\nu and π\pi were arbitrary, the pair is βκ\frac{\beta}{\kappa}-displacement convex in the sense of Lambda-Displacement Convexity of a Noise Penalty Pair §convex (its being a noise penalty pair is The Gaussian Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair). This proves claim 1.

Step 5 (claim 2). With μ\mu, ν\nu, π\pi as above, Ia(π)≥0I^{a}(\pi)\ge0 by Couplings of Finite Noise Cost and Their Noise Cost §cost and β2κ>0\frac{\beta}{2\kappa}>0, so by claim 1

E(μ)+Ja(Σ(μ),π)+02 Ia(π)=E(μ)+Ja(Σ(μ),π)≤E(μ)+Ja(Σ(μ),π)+β2κ Ia(π)≤E(ν).\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)+\frac{0}{2}\,I^{a}(\pi)=\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)\le\mathcal{E}(\mu)+\mathcal{J}^{a}(\Sigma(\mu),\pi)+\frac{\beta}{2\kappa}\,I^{a}(\pi)\le\mathcal{E}(\nu).

Hence the pair is 00-displacement convex, that is, displacement convex in the sense of Lambda-Displacement Convexity of a Noise Penalty Pair §displacement-convex.

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…