TheoremBase

At a local maximum, perturbing along noise gradients of bounded C2C^2 cylindrical functions and expanding the Gaussian entropy (second-order expansion) and the potential energy (tangent inequality plus dominated convergence) shows that the Gibbs Ornstein-Uhlenbeck functional is bounded by the noise-gradient norm; the Gibbs Fisher bound lemma then puts the maximiser in the score domain.

Proof

Each result cited is universally quantified over the data in its own statement.

Real arithmetic, the order of R\mathbb{R} and absolute values are those of The Real Numbers: Standing Notation and Background §background, used without further mention; square roots are the nonnegative ones of Existence and Uniqueness of the Nonnegative Square Root, and for nonnegative reals s,ts,t, s≤ts\le t if and only if s2≤t2s^{2}\le t^{2} by claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field.

The quadruple (D,DΣ,E,Σ)(\mathcal{D},\mathcal{D}_{\Sigma},\mathcal{E},\Sigma) is a noise penalty pair on Pρa\mathcal{P}^{a}_{\rho} by The Gibbs Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair, so Noise Penalty Pairs with Regular Penalised Maxima §regular applies to it. Let χ:Pρa→R\chi:\mathcal{P}^{a}_{\rho}\to\mathbb{R} be a noise intrinsic test function on D\mathcal{D}, let λ∈R\lambda\in\mathbb{R} be positive, and let μ∈D\mu\in\mathcal{D} be a point at which χ−λE\chi-\lambda\mathcal{E} has a local maximum relative to D\mathcal{D} in the metric space (Pρa,Wa)(\mathcal{P}^{a}_{\rho},W_{a}) of First-Order Equations on the Noise Wasserstein Space Relative to a Noise Penalty Pair: Standing Notation §space. By Local Maximum of a Function Relative to a Subset of a Metric Space there is a positive r∈Rr\in\mathbb{R} such that every ν∈D\nu\in\mathcal{D} with Wa(μ,ν)<rW_{a}(\mu,\nu)<r satisfies

χ(ν)−χ(μ)≤λ(E(ν)−E(μ)).(0.1)\chi(\nu)-\chi(\mu)\le\lambda\bigl(\mathcal{E}(\nu)-\mathcal{E}(\mu)\bigr).\tag{0.1}

We must show μ∈DΣ\mu\in\mathcal{D}_{\Sigma}. By property (b) of Noise Intrinsic Test Functions on the Noise Wasserstein Space §differentiability, χ\chi is differentiable along noise couplings at μ\mu, and its gradient ∇χ(μ)∈L2(μ;Xa)\nabla\chi(\mu)\in L^{2}(\mu;X^{a}) has the property of Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §differentiable by Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §gradient.

Data on VV and on μ\mu. Write V=v∘pdV=v\circ p_{d} with head dimension dd, profile vv and semiconvexity constant K≥0K\ge0 (Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §admissible), fix bb and CC as in Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §below and Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §slope, so C≥0C\ge0, and let L=C1/2(∣b+1∣+2)≥0L=C^{1/2}(|b+1|+2)\ge0 be the number of Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §translation. Let ZV,βZ_{V,\beta} be the normaliser of The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §normaliser. Since μ∈D\mu\in\mathcal{D}, μ\mu has finite relative entropy with respect to γβV\gamma^{V}_{\beta} (The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain); by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy, μ\mu has finite relative entropy with respect to γc\gamma_{c} and VV is integrable with respect to μ\mu, and by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §domain, μ∈P2(X)\mu\in\mathcal{P}_{2}(X) and each ∂kV\partial_{k}V is integrable with respect to μ\mu. For every ν∈D\nu\in\mathcal{D}, The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §pair and Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy give

E(ν)=βH(ν ∣ γβV)=βH(ν ∣ γc)+∫XV dν+βlog⁡ZV,β.(0.2)\mathcal{E}(\nu)=\beta H(\nu\,|\,\gamma^{V}_{\beta})=\beta H(\nu\,|\,\gamma_{c})+\int_{X}V\,d\nu+\beta\log Z_{V,\beta}.\tag{0.2}

For every y∈Xy\in X we have −b≤V(y)-b\le V(y) and V(y)+b+1≥1V(y)+b+1\ge1 by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, hence ∣V(y)∣≤V(y)+b+1+∣b∣|V(y)|\le V(y)+b+1+|b| (if V(y)≥0V(y)\ge0 this holds as b+∣b∣+1≥0b+|b|+1\ge0; if V(y)<0V(y)<0, then ∣V(y)∣=−V(y)≤b≤∣b∣≤V(y)+b+1+∣b∣|V(y)|=-V(y)\le b\le|b|\le V(y)+b+1+|b|, as V(y)+b+1≥1V(y)+b+1\ge1); and by Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §slope and Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, ∣∇aV(y)∣a2=∑k=1dak(∂kv(pd(y)))2≤C(1+∣V(y)∣)2|\nabla_{a}V(y)|_{a}^{2}=\sum_{k=1}^{d}a_{k}(\partial_{k}v(p_{d}(y)))^{2}\le C(1+|V(y)|)^{2}, so

∣∇aV(y)∣a≤C1/2(1+∣V(y)∣)≤C1/2(V(y)+b+2+∣b∣)(y∈X).(0.3)|\nabla_{a}V(y)|_{a}\le C^{1/2}\bigl(1+|V(y)|\bigr)\le C^{1/2}\bigl(V(y)+b+2+|b|\bigr)\qquad(y\in X).\tag{0.3}

Step 1 (Data for a fixed cylindrical direction). Fix n∈Nn\in\mathbb{N} and g∈Cb2(Rn)g\in C^{2}_{b}(\mathbb{R}^{n}), and put ψ=g∘pn\psi=g\circ p_{n}, a bounded C1C^{1} cylindrical function with noise gradient ∇aψ(x)=∑k=1nak ∂kg(pn(x)) ek\nabla_{a}\psi(x)=\sum_{k=1}^{n}a_{k}\,\partial_{k}g(p_{n}(x))\,e_{k}, by the preamble of Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation (whose hypothesis holds for μ\mu); so the kk-th coordinate of ∇aψ(x)\nabla_{a}\psi(x) is ak∂kg(pn(x))a_{k}\partial_{k}g(p_{n}(x)) for k≤nk\le n and 00 for k>nk>n. Let h∈L2(μ;Xa)h\in L^{2}(\mu;X^{a}) be the class of ∇aψ\nabla_{a}\psi, which is square-integrable with respect to μ\mu by The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient; it is the element written ∇a(g∘pn)\nabla_{a}(g\circ p_{n}) in A Bound on the Gibbs Ornstein-Uhlenbeck Functional by Noise Gradients Gives Finite Fisher Information Relative to the Gibbs Measure. By Bounded Twice Continuously Differentiable Functions with Bounded First and Second Partial Derivatives on Euclidean Space §bounded there are nonnegative B,b′∈RB,b'\in\mathbb{R} with ∣∂kg(u)∣≤B|\partial_{k}g(u)|\le B and ai1/2aj1/2∣∂j∂ig(u)∣≤b′a_{i}^{1/2}a_{j}^{1/2}|\partial_{j}\partial_{i}g(u)|\le b' for all u∈Rnu\in\mathbb{R}^{n} and i,j,k∈[n]i,j,k\in[n]; these are the numbers written BB and bb in Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation. Let θn>0\theta_{n}>0 and Kn≥0K_{n}\ge0 be the constants of that lemma (Determinants of Positive Definite Matrices: Positivity, the Bound log⁡det⁡A≤tr A−d\log\det A\le\mathrm{tr}\,A-d, Bounds under Pinching, and the Expansion of det⁡(I+tB)\det(I+tB) §expansion, read with d=nd=n, where they are written cdc_{d} and KdK_{d}), and put

Cg=Knb′2+B2∑k=1nak22ck≥0,ℓ0=Lμa(g),G=⟨∇χ(μ),h⟩μ,Bψ=(∑k=1nakB2)1/2,t∗=(1+2nb′)−1,C_{g}=K_{n}b'^{2}+B^{2}\sum_{k=1}^{n}\frac{a_{k}^{2}}{2c_{k}}\ge0,\quad\ell_{0}=L^{a}_{\mu}(g),\quad G=\langle\nabla\chi(\mu),h\rangle_{\mu},\quad B_{\psi}=\Bigl(\sum_{k=1}^{n}a_{k}B^{2}\Bigr)^{1/2},\quad t_{*}=(1+2nb')^{-1},

where Lμa(g)L^{a}_{\mu}(g) is the noise Ornstein-Uhlenbeck functional. By the formula of The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient, ∣∇aψ(x)∣a2=∑k=1nak(∂kg(pn(x)))2≤Bψ2|\nabla_{a}\psi(x)|_{a}^{2}=\sum_{k=1}^{n}a_{k}(\partial_{k}g(p_{n}(x)))^{2}\le B_{\psi}^{2}, so ∣∇aψ(x)∣a≤Bψ|\nabla_{a}\psi(x)|_{a}\le B_{\psi} for every xx. Note 0<t∗≤10<t_{*}\le1, and every tt with ∣t∣≤t∗|t|\le t_{*} satisfies 2n∣t∣b′≤2nb′(1+2nb′)−1≤12n|t|b'\le2nb'(1+2nb')^{-1}\le1. For t∈Rt\in\mathbb{R} let St(x)=x+t ∇aψ(x)S_{t}(x)=x+t\,\nabla_{a}\psi(x), the map id+t∇aψ\mathrm{id}+t\nabla_{a}\psi of Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation, and put μt=(St)#μ\mu_{t}=(S_{t})_{\#}\mu and πt=(id,St)#μ\pi_{t}=(\mathrm{id},S_{t})_{\#}\mu. By Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §displacement, applied with hh and its representative ∇aψ\nabla_{a}\psi, πt∈Πa(μ,μt)\pi_{t}\in\Pi^{a}(\mu,\mu_{t}), Ia(πt)=t2∥h∥μ2I^{a}(\pi_{t})=t^{2}\lVert h\rVert_{\mu}^{2}, and Ja(∇χ(μ),πt)=t G\mathcal{J}^{a}(\nabla\chi(\mu),\pi_{t})=t\,G.

The potential pairing. By Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, applied with the vector ∇aψ(x)∈Xa\nabla_{a}\psi(x)\in X^{a}, and since ∂kV=0\partial_{k}V=0 for k>dk>d (Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §gradient), for all t∈Rt\in\mathbb{R} and x∈Xx\in X the function

qt(x)=⟨∇aV(St(x)),∇aψ(x)⟩a=∑k=1nak ∂kV(St(x)) ∂kg(pn(x))(1.1)q_{t}(x)=\langle\nabla_{a}V(S_{t}(x)),\nabla_{a}\psi(x)\rangle_{a}=\sum_{k=1}^{n}a_{k}\,\partial_{k}V(S_{t}(x))\,\partial_{k}g(p_{n}(x))\tag{1.1}

is given by the displayed finite sum. Each product ∂kV (∂kg∘pn)\partial_{k}V\,(\partial_{k}g\circ p_{n}) is integrable with respect to μ\mu by the preamble of The Gibbs Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates, so q0q_{0} is integrable; put P=∫Xq0 dμP=\int_{X}q_{0}\,d\mu. For each k∈[n]k\in[n] the integrand of the kk-th term of The Gibbs Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates §functional is that of the kk-th term of The Noise Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates §functional plus β−1∂kV (∂kg∘pn)\beta^{-1}\partial_{k}V\,(\partial_{k}g\circ p_{n}), so the linearity of Linearity and Monotonicity of the Lebesgue Integral §integrable and (1.1) with t=0t=0 give

Lμa,V(g)=ℓ0+β−1P,(1.2)L^{a,V}_{\mu}(g)=\ell_{0}+\beta^{-1}P,\tag{1.2}

the left-hand side being the Gibbs Ornstein-Uhlenbeck functional, defined as μ∈P2(X)\mu\in\mathcal{P}_{2}(X) and VV is integrable with respect to μ\mu.

Step 2 (A bound on GG). With t=1t=1, the bound Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §bound gives ∣G∣=∣Ja(∇χ(μ),π1)∣≤∥∇χ(μ)∥μIa(π1)=∥∇χ(μ)∥μ∥h∥μ|G|=|\mathcal{J}^{a}(\nabla\chi(\mu),\pi_{1})|\le\lVert\nabla\chi(\mu)\rVert_{\mu}\sqrt{I^{a}(\pi_{1})}=\lVert\nabla\chi(\mu)\rVert_{\mu}\lVert h\rVert_{\mu}.

Step 3 (The perturbed measures lie in D\mathcal{D}, and the change of the potential energy). Let t∈Rt\in\mathbb{R} with ∣t∣≤t∗|t|\le t_{*}, so ∣t∣≤1|t|\le1 and 2n∣t∣b′≤12n|t|b'\le1. By Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation §pushforward, StS_{t} is Borel and μt\mu_{t} has finite relative entropy with respect to γc\gamma_{c}. Let x∈Xx\in X. The vector t∇aψ(x)t\nabla_{a}\psi(x) lies in XaX^{a}, a linear subspace of XX by The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §hilbert, and ∣t∇aψ(x)∣a=∣t∣ ∣∇aψ(x)∣a≤Bψ|t\nabla_{a}\psi(x)|_{a}=|t|\,|\nabla_{a}\psi(x)|_{a}\le B_{\psi}. So Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §translation, the positivity V(x)+b+1≥1V(x)+b+1\ge1 and the monotonicity of exp⁡\exp (claim 4 of Basic Properties of the Exponential Function) give

1≤V(St(x))+b+1≤(V(x)+b+1)exp⁡(LBψ),1\le V(S_{t}(x))+b+1\le\bigl(V(x)+b+1\bigr)\exp(LB_{\psi}),

and therefore, by the bound ∣V(y)∣≤V(y)+b+1+∣b∣|V(y)|\le V(y)+b+1+|b| of the data paragraph,

1+∣V(St(x))∣≤Λ(x):=(V(x)+b+1)exp⁡(LBψ)+∣b∣+1.(3.1)1+|V(S_{t}(x))|\le\Lambda(x):=\bigl(V(x)+b+1\bigr)\exp(LB_{\psi})+|b|+1 .\tag{3.1}

The function Λ\Lambda is integrable with respect to μ\mu by Linearity and Monotonicity of the Lebesgue Integral §integrable, VV being integrable and constants integrable by claim 6(a) of Borel Measurability and Bounded Integration on a Metric Space. The function V∘StV\circ S_{t} is Borel, by claims 3 and 4 of Borel Measurability and Bounded Integration on a Metric Space, VV being continuous (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity); and ∣V∘St∣≤Λ|V\circ S_{t}|\le\Lambda, so V∘StV\circ S_{t} is integrable, by the monotonicity of Linearity and Monotonicity of the Lebesgue Integral §nonnegative and the definition of integrability. By the change of variables formula of Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §pushforward (claim 2 of Image Measures, Measures with Densities, and Change of Variables), VV is integrable with respect to μt\mu_{t} and ∫XV dμt=∫XV∘St dμ\int_{X}V\,d\mu_{t}=\int_{X}V\circ S_{t}\,d\mu. Hence, by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy, μt\mu_{t} has finite relative entropy with respect to γβV\gamma^{V}_{\beta}, that is, μt∈D⊆Pρa\mu_{t}\in\mathcal{D}\subseteq\mathcal{P}^{a}_{\rho} (The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain), and (0.2) for ν=μt\nu=\mu_{t} and ν=μ\nu=\mu, with the linearity of Linearity and Monotonicity of the Lebesgue Integral §integrable, gives

E(μt)−E(μ)=β(H(μt ∣ γc)−H(μ ∣ γc))+∫X(V∘St−V) dμ.(3.2)\mathcal{E}(\mu_{t})-\mathcal{E}(\mu)=\beta\bigl(H(\mu_{t}\,|\,\gamma_{c})-H(\mu\,|\,\gamma_{c})\bigr)+\int_{X}\bigl(V\circ S_{t}-V\bigr)\,d\mu.\tag{3.2}

Next, x−St(x)=−t∇aψ(x)∈Xax-S_{t}(x)=-t\nabla_{a}\psi(x)\in X^{a}, so Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §tangent-inequality, applied at the points St(x)S_{t}(x) and xx (in the roles of its xx and yy), gives V(x)≥V(St(x))−t qt(x)−K2t2∣∇aψ(x)∣a2V(x)\ge V(S_{t}(x))-t\,q_{t}(x)-\tfrac{K}{2}t^{2}|\nabla_{a}\psi(x)|_{a}^{2}, with qtq_{t} of (1.1); since K≥0K\ge0,

V(St(x))−V(x)≤t qt(x)+K2 t2Bψ2.(3.3)V(S_{t}(x))-V(x)\le t\,q_{t}(x)+\tfrac{K}{2}\,t^{2}B_{\psi}^{2}.\tag{3.3}

The function qtq_{t} is Borel by (1.1), each ∂kV\partial_{k}V being continuous (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity) and each ∂kg∘pn\partial_{k}g\circ p_{n} Borel (Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel), with claims 3 and 4 of Borel Measurability and Bounded Integration on a Metric Space and claims 2 and 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions. By the Cauchy-Schwarz inequality in the real Hilbert space XaX^{a} (The Cauchy-Schwarz Inequality in a Real Inner Product Space, The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §hilbert), (0.3) and (3.1),

∣qt(x)∣≤∣∇aV(St(x))∣a ∣∇aψ(x)∣a≤C1/2Bψ Λ(x),(3.4)|q_{t}(x)|\le|\nabla_{a}V(S_{t}(x))|_{a}\,|\nabla_{a}\psi(x)|_{a}\le C^{1/2}B_{\psi}\,\Lambda(x),\tag{3.4}

so qtq_{t} is integrable. Integrating (3.3), by the linearity and monotonicity of Linearity and Monotonicity of the Lebesgue Integral §integrable,

∫X(V∘St−V) dμ≤t∫Xqt dμ+K2 t2Bψ2(∣t∣≤t∗).(3.5)\int_{X}\bigl(V\circ S_{t}-V\bigr)\,d\mu\le t\int_{X}q_{t}\,d\mu+\tfrac{K}{2}\,t^{2}B_{\psi}^{2}\qquad(|t|\le t_{*}).\tag{3.5}

Step 4 (Continuity of the potential pairing at t=0t=0). We claim: for every positive η∈R\eta\in\mathbb{R} there is tη∈Rt_{\eta}\in\mathbb{R} with 0<tη≤t∗0<t_{\eta}\le t_{*} such that ∣∫Xqt dμ−P∣≤η\bigl|\int_{X}q_{t}\,d\mu-P\bigr|\le\eta whenever ∣t∣≤tη|t|\le t_{\eta}. Suppose not, for some η>0\eta>0. Then for each j∈Nj\in\mathbb{N} the number t∗/jt_{*}/j does not qualify, so there is tjt_{j} with ∣tj∣≤t∗/j|t_{j}|\le t_{*}/j and ∣∫Xqtj dμ−P∣>η\bigl|\int_{X}q_{t_{j}}\,d\mu-P\bigr|>\eta. Then tj→0t_{j}\to0 by The Archimedean Property of the Real Numbers and Limit of a Sequence of Real Numbers. Fix x∈Xx\in X and k∈[d]k\in[d]. The distance from Stj(x)S_{t_{j}}(x) to xx in XX is ∣tj∣ ∣∇aψ(x)∣|t_{j}|\,|\nabla_{a}\psi(x)|, which tends to 00; given ε′>0\varepsilon'>0, the continuity of ∂kV\partial_{k}V at xx (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, in the sense of Continuous Map Between Metric Spaces) provides δ>0\delta>0 with ∣∂kV(y)−∂kV(x)∣<ε′|\partial_{k}V(y)-\partial_{k}V(x)|<\varepsilon' whenever ∣y−x∣<δ|y-x|<\delta, and ∣tj∣ ∣∇aψ(x)∣<δ|t_{j}|\,|\nabla_{a}\psi(x)|<\delta for all large jj; so ∂kV(Stj(x))→∂kV(x)\partial_{k}V(S_{t_{j}}(x))\to\partial_{k}V(x), and qtj(x)→q0(x)q_{t_{j}}(x)\to q_{0}(x) by (1.1) and Arithmetic of Limits of Real Sequences. Since ∣tj∣≤t∗|t_{j}|\le t_{*}, (3.4) gives ∣qtj∣≤C1/2BψΛ|q_{t_{j}}|\le C^{1/2}B_{\psi}\Lambda, an integrable function. By claim 3 of Dominated Convergence Theorem (on the measure space (X,B(X),μ)(X,\mathcal{B}(X),\mu), with the Borel functions qtjq_{t_{j}} and limit function q0q_{0}), ∫Xqtj dμ→∫Xq0 dμ=P\int_{X}q_{t_{j}}\,d\mu\to\int_{X}q_{0}\,d\mu=P, so ∣∫Xqtj dμ−P∣<η\bigl|\int_{X}q_{t_{j}}\,d\mu-P\bigr|<\eta for all large jj (Limit of a Sequence of Real Numbers), a contradiction. This proves the claim.

Step 5 (λβLμa,V(g)=G\lambda\beta L^{a,V}_{\mu}(g)=G). Let ε∈R\varepsilon\in\mathbb{R} be positive. First choose, by Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §differentiable applied to ∇χ(μ)\nabla\chi(\mu) and ε\varepsilon, a positive θχ∈R\theta_{\chi}\in\mathbb{R} such that ∣χ(ν)−χ(μ)−Ja(∇χ(μ),π)∣≤εIa(π)|\chi(\nu)-\chi(\mu)-\mathcal{J}^{a}(\nabla\chi(\mu),\pi)|\le\varepsilon\sqrt{I^{a}(\pi)} for every ν∈Pρa\nu\in\mathcal{P}^{a}_{\rho} and every π∈Πa(μ,ν)\pi\in\Pi^{a}(\mu,\nu) with Ia(π)<θχ2I^{a}(\pi)<\theta_{\chi}^{2}. Next let tε/λt_{\varepsilon/\lambda} be given by Step 4 with η=ε/λ\eta=\varepsilon/\lambda. Then choose a positive s∈Rs\in\mathbb{R} with

s≤tε/λ,s b′≤θn,s∥h∥μ<θχ,s∥h∥μ<r,λβCg s≤ε,λKBψ2 s≤2ε,s\le t_{\varepsilon/\lambda},\qquad s\,b'\le\theta_{n},\qquad s\lVert h\rVert_{\mu}<\theta_{\chi},\qquad s\lVert h\rVert_{\mu}<r,\qquad\lambda\beta C_{g}\,s\le\varepsilon,\qquad\lambda KB_{\psi}^{2}\,s\le2\varepsilon,

which is possible since each condition holds for all sufficiently small positive ss. Let t∈{s,−s}t\in\{s,-s\}, so ∣t∣=s≤t∗|t|=s\le t_{*} and 2n∣t∣b′≤12n|t|b'\le1.

By Step 3, μt∈D\mu_{t}\in\mathcal{D}. As μ,μt∈Pρa\mu,\mu_{t}\in\mathcal{P}^{a}_{\rho} and πt∈Πa(μ,μt)\pi_{t}\in\Pi^{a}(\mu,\mu_{t}), The Noise Wasserstein Distance §distance (the pair (μ,μt)(\mu,\mu_{t}) being noise-connected by The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §connected) gives Wa(μ,μt)2≤Ia(πt)=s2∥h∥μ2<r2W_{a}(\mu,\mu_{t})^{2}\le I^{a}(\pi_{t})=s^{2}\lVert h\rVert_{\mu}^{2}<r^{2}, so Wa(μ,μt)<rW_{a}(\mu,\mu_{t})<r, both numbers being nonnegative. Hence (0.1) gives χ(μt)−χ(μ)≤λ(E(μt)−E(μ))\chi(\mu_{t})-\chi(\mu)\le\lambda(\mathcal{E}(\mu_{t})-\mathcal{E}(\mu)).

Since Ia(πt)=s2∥h∥μ2<θχ2I^{a}(\pi_{t})=s^{2}\lVert h\rVert_{\mu}^{2}<\theta_{\chi}^{2} and Ia(πt)=s∥h∥μ\sqrt{I^{a}(\pi_{t})}=s\lVert h\rVert_{\mu}, the choice of θχ\theta_{\chi} gives ∣χ(μt)−χ(μ)−tG∣≤εs∥h∥μ|\chi(\mu_{t})-\chi(\mu)-tG|\le\varepsilon s\lVert h\rVert_{\mu}, so tG−εs∥h∥μ≤χ(μt)−χ(μ)tG-\varepsilon s\lVert h\rVert_{\mu}\le\chi(\mu_{t})-\chi(\mu).

Since 2n∣t∣b′≤12n|t|b'\le1 and ∣t∣b′≤θn|t|b'\le\theta_{n}, Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation §expansion gives H(μt ∣ γc)−H(μ ∣ γc)≤tℓ0+Cgs2H(\mu_{t}\,|\,\gamma_{c})-H(\mu\,|\,\gamma_{c})\le t\ell_{0}+C_{g}s^{2}. Since ∣t∣=s≤tε/λ|t|=s\le t_{\varepsilon/\lambda}, Step 4 gives t∫Xqt dμ=tP+t(∫Xqt dμ−P)≤tP+sε/λt\int_{X}q_{t}\,d\mu=tP+t\bigl(\int_{X}q_{t}\,d\mu-P\bigr)\le tP+s\varepsilon/\lambda. With (3.2) and (3.5),

E(μt)−E(μ)≤βtℓ0+βCgs2+tP+sελ+K2Bψ2s2.\mathcal{E}(\mu_{t})-\mathcal{E}(\mu)\le\beta t\ell_{0}+\beta C_{g}s^{2}+tP+\frac{s\varepsilon}{\lambda}+\frac{K}{2}B_{\psi}^{2}s^{2}.

Multiplying by λ>0\lambda>0 and using λβCgs≤ε\lambda\beta C_{g}s\le\varepsilon and λK2Bψ2s≤ε\lambda\tfrac{K}{2}B_{\psi}^{2}s\le\varepsilon, λ(E(μt)−E(μ))≤λt(βℓ0+P)+3εs\lambda(\mathcal{E}(\mu_{t})-\mathcal{E}(\mu))\le\lambda t(\beta\ell_{0}+P)+3\varepsilon s. Combining the three inequalities,

tG−εs∥h∥μ≤λt(βℓ0+P)+3εs,that ist(G−λ(βℓ0+P))≤εs(∥h∥μ+3).tG-\varepsilon s\lVert h\rVert_{\mu}\le\lambda t(\beta\ell_{0}+P)+3\varepsilon s,\qquad\text{that is}\qquad t\bigl(G-\lambda(\beta\ell_{0}+P)\bigr)\le\varepsilon s\bigl(\lVert h\rVert_{\mu}+3\bigr).

Taking t=st=s and t=−st=-s and dividing by s>0s>0 gives ∣G−λ(βℓ0+P)∣≤ε(∥h∥μ+3)|G-\lambda(\beta\ell_{0}+P)|\le\varepsilon(\lVert h\rVert_{\mu}+3). As ε>0\varepsilon>0 was arbitrary (given ε′′>0\varepsilon''>0, take ε=ε′′(∥h∥μ+3)−1\varepsilon=\varepsilon''(\lVert h\rVert_{\mu}+3)^{-1}), Comparison of Real Numbers with Arbitrary Positive Slack §vanishing gives G=λ(βℓ0+P)G=\lambda(\beta\ell_{0}+P), and by (1.2),

G=λβ Lμa,V(g).G=\lambda\beta\,L^{a,V}_{\mu}(g).

Step 6 (Conclusion). By Steps 5 and 2, with R=(λβ)−1∥∇χ(μ)∥μR=(\lambda\beta)^{-1}\lVert\nabla\chi(\mu)\rVert_{\mu}, a nonnegative real number not depending on nn or gg,

∣Lμa,V(g)∣=(λβ)−1∣G∣≤R ∥∇a(g∘pn)∥μ.\bigl|L^{a,V}_{\mu}(g)\bigr|=(\lambda\beta)^{-1}|G|\le R\,\lVert\nabla_{a}(g\circ p_{n})\rVert_{\mu}.

This holds for every n∈Nn\in\mathbb{N} and every g∈Cb2(Rn)g\in C^{2}_{b}(\mathbb{R}^{n}). Since μ∈P2(X)\mu\in\mathcal{P}_{2}(X) and VV is integrable with respect to μ\mu, A Bound on the Gibbs Ornstein-Uhlenbeck Functional by Noise Gradients Gives Finite Fisher Information Relative to the Gibbs Measure §fisher shows that μ\mu has a relative score with respect to γβV\gamma^{V}_{\beta} and finite Fisher information relative to γβV\gamma^{V}_{\beta} with weights aa. As μ∈D\mu\in\mathcal{D}, μ∈DΣ\mu\in\mathcal{D}_{\Sigma} by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain. Since χ\chi, λ\lambda and the local maximiser μ\mu were arbitrary, the pair has regular penalised maxima (Noise Penalty Pairs with Regular Penalised Maxima §regular). ■\blacksquare

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…