TheoremBase

The Riccati coefficient is found by completing the square, and the positivity condition selects the root with the plus sign. The dressed variances, the profile and the shifted pair then follow by algebra, the quadratic-function lemma and the change-of-variances lemma; for the operator, Gaussian integration by parts on the quadratic profile cancels every coefficient of xi2x_i^2 and leaves the constant -e.

Proof

Each result cited is universally quantified over the data in its own statement. Elementary ordered-field arithmetic and order, and the elementary properties of finite sums and squares, are used without further comment, as provided by The Real Numbers: Standing Notation and Background §background. For i∈[d]i\in[d] put

pi=λ02+aci,Di=pi2+2θβi.p_{i}=\frac{\lambda_{0}}{2}+\frac{a}{c_{i}},\qquad D_{i}=p_{i}^{2}+2\theta\beta_{i}.

Clause 1. Fix i∈[d]i\in[d]. Expanding the square,

Di−(λ02)2=(aci)2+λ0 aci+2θβi,D_{i}-\Bigl(\frac{\lambda_{0}}{2}\Bigr)^{2}=\Bigl(\frac{a}{c_{i}}\Bigr)^{2}+\lambda_{0}\,\frac{a}{c_{i}}+2\theta\beta_{i},

which is positive by hypothesis. Hence Di>(λ0/2)2≥0D_{i}>(\lambda_{0}/2)^{2}\ge0; so the radicand Di=(λ0/2+a/ci)2+2θβiD_{i}=(\lambda_{0}/2+a/c_{i})^{2}+2\theta\beta_{i} of clause 1 is positive, and Di\sqrt{D_{i}} is the unique nonnegative real number whose square is DiD_{i}, by Existence and Uniqueness of the Nonnegative Square Root. Since 0≤λ0/20\le\lambda_{0}/2, 0≤Di0\le\sqrt{D_{i}} and (λ0/2)2<Di=(Di)2(\lambda_{0}/2)^{2}<D_{i}=(\sqrt{D_{i}})^{2}, claim 1 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field gives

λ02<Di.(A)\frac{\lambda_{0}}{2}<\sqrt{D_{i}}.\tag{A}

For s∈Rs\in\mathbb{R} put ts=θs+pit_{s}=\theta s+p_{i}. Since θ≠0\theta\ne0, multiplying by 2θ2\theta and then adding pi2p_{i}^{2} shows

θ2 s2+pi s=βi  ⟺  θ2s2+2θpi s=2θβi  ⟺  ts2=Di,\frac{\theta}{2}\,s^{2}+p_{i}\,s=\beta_{i}\iff\theta^{2}s^{2}+2\theta p_{i}\,s=2\theta\beta_{i}\iff t_{s}^{2}=D_{i},

and moreover a/ci+θs=ts−λ0/2a/c_{i}+\theta s=t_{s}-\lambda_{0}/2.

Existence: for bi=θ−1(Di−pi)b_{i}=\theta^{-1}(\sqrt{D_{i}}-p_{i}) we have tbi=Dit_{b_{i}}=\sqrt{D_{i}}, so tbi2=Dit_{b_{i}}^{2}=D_{i} and the equation of clause 1 holds, and a/ci+θbi=Di−λ0/2>0a/c_{i}+\theta b_{i}=\sqrt{D_{i}}-\lambda_{0}/2>0 by (A). Uniqueness: if s∈Rs\in\mathbb{R} satisfies the equation and a/ci+θs>0a/c_{i}+\theta s>0, then ts=(a/ci+θs)+λ0/2>0t_{s}=(a/c_{i}+\theta s)+\lambda_{0}/2>0 and ts2=Dit_{s}^{2}=D_{i}, so ts=Dit_{s}=\sqrt{D_{i}} by the uniqueness part of Existence and Uniqueness of the Nonnegative Square Root, that is s=θ−1(Di−pi)=bis=\theta^{-1}(\sqrt{D_{i}}-p_{i})=b_{i}. This is the formula of clause 1.

Clause 2. By clause 1, a/ci+θbi>0a/c_{i}+\theta b_{i}>0 for every i∈[d]i\in[d], and a>0a>0; so ci′=a (a/ci+θbi)−1c'_{i}=a\,(a/c_{i}+\theta b_{i})^{-1} is positive for every ii, and c′c' is a variance vector by The Diagonal Gaussian Density on Euclidean Space and Its Notation §variances. Moreover

1ci′=1a(aci+θbi)=1ci+θa bi(i∈[d]).\frac{1}{c'_{i}}=\frac{1}{a}\Bigl(\frac{a}{c_{i}}+\theta b_{i}\Bigr)=\frac{1}{c_{i}}+\frac{\theta}{a}\,b_{i}\qquad(i\in[d]).

Let x∈Rdx\in\mathbb{R}^{d}. By The Diagonal Gaussian Density on Euclidean Space and Its Notation §scaling, the iith component of a Sc′(x)a\,S_{c'}(x) is a xi/ci′=a xi/ci+θbixia\,x_{i}/c'_{i}=a\,x_{i}/c_{i}+\theta b_{i}x_{i}, which is the iith component of a Sc(x)+θ(b1x1,…,bdxd)a\,S_{c}(x)+\theta(b_{1}x_{1},\dots,b_{d}x_{d}); and by the same clause

∣x∣c′2−∣x∣c2=∑i=1dxi2(1ci′−1ci)=θa∑i=1dbixi2.|x|_{c'}^{2}-|x|_{c}^{2}=\sum_{i=1}^{d}x_{i}^{2}\Bigl(\frac{1}{c'_{i}}-\frac{1}{c_{i}}\Bigr)=\frac{\theta}{a}\sum_{i=1}^{d}b_{i}x_{i}^{2}.

Clause 3. Let BB be the diagonal real d×dd\times d matrix with diagonal entries b1,…,bdb_{1},\dots,b_{d}; it is symmetric, so B∈S(d)B\in\mathcal{S}(d). For z∈Rdz\in\mathbb{R}^{d}, Bz=(b1z1,…,bdzd)Bz=(b_{1}z_{1},\dots,b_{d}z_{d}) by the definition of the matrix-vector product, and 12 z⋅(Bz)=12∑i=1dbizi2=u0(z)\tfrac12\,z\cdot(Bz)=\tfrac12\sum_{i=1}^{d}b_{i}z_{i}^{2}=u_{0}(z) by the definition of the dot product. Hence Quadratic and Affine Functions of Class C2C^2, Translation, and Quadratic Perturbation of Semiconvexity §quadratic, applied with n=dn=d (note 1≤d1\le d by The Wasserstein Space and Its Lift to Square-Integrable Random Vectors: Standing Notation §data), the matrix BB, linear coefficient 00 and constant term 00, shows that u0u_{0} is of class C2C^{2} on Rd\mathbb{R}^{d} with Du0(x)=Bx=(b1x1,…,bdxd)Du_{0}(x)=Bx=(b_{1}x_{1},\dots,b_{d}x_{d}) and Hessian matrix D2u0(x)=BD^{2}u_{0}(x)=B for every xx; the entries of the Hessian matrix being the iterated partial derivatives (Hessian Matrix of a C^2 Function), ∂j∂iu0(x)\partial_{j}\partial_{i}u_{0}(x) is bib_{i} if i=ji=j and 00 otherwise (BB being diagonal, the order of the two indices is immaterial).

Put Mb=∑k=1d∣bk∣M_{b}=\sum_{k=1}^{d}|b_{k}|. Then 0≤Mb0\le M_{b}, and ∣∂j∂iu0(x)∣≤Mb|\partial_{j}\partial_{i}u_{0}(x)|\le M_{b} for all x∈Rdx\in\mathbb{R}^{d} and i,j∈[d]i,j\in[d], since ∣bi∣|b_{i}| is one of the nonnegative summands of MbM_{b}. So Integrals of Functions with a Bounded Hessian are Intrinsic Test Functions on the Wasserstein Space §test, applied with f=u0f=u_{0} and M=MbM=M_{b}, shows that Φ0=φu0\Phi_{0}=\varphi_{u_{0}} is an intrinsic test function on P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}), that ∇Φ0(μ)\nabla\Phi_{0}(\mu) is the class Du0Du_{0} for every μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), and that HΦ0(μ)=∫RdD2u0 dμH_{\Phi_{0}}(\mu)=\int_{\mathbb{R}^{d}}D^{2}u_{0}\,d\mu. The entries of D2u0D^{2}u_{0} are the constant functions with values bib_{i} (on the diagonal) and 00 (off it), whose μ\mu-integrals are bib_{i} and 00 because μ\mu is a probability measure; so HΦ0(μ)=BH_{\Phi_{0}}(\mu)=B.

Clause 4. By The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair, D\mathcal{D} (respectively D′\mathcal{D}') is the set of μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) of finite relative entropy with respect to γc\gamma_{c} (respectively γc′\gamma_{c'}), and DΣ\mathcal{D}_{\Sigma} (respectively DΣ′\mathcal{D}'_{\Sigma}) is the set of μ∈D\mu\in\mathcal{D} (respectively μ∈D′\mu\in\mathcal{D}') of finite Fisher information relative to γc\gamma_{c} (respectively γc′\gamma_{c'}). By Changing the Variances of a Diagonal Gaussian Reference Measure: Equal Domains, the Shift of the Relative Entropy and the Shift of the Relative Score §domains the two entropy conditions agree and the two Fisher-information conditions agree; hence D′=D\mathcal{D}'=\mathcal{D} and DΣ′=DΣ\mathcal{D}'_{\Sigma}=\mathcal{D}_{\Sigma}.

Let μ∈D\mu\in\mathcal{D}. By clauses 2 and 3, ∣x∣c′2−∣x∣c2=2θa u0(x)|x|_{c'}^{2}-|x|_{c}^{2}=\frac{2\theta}{a}\,u_{0}(x) for every x∈Rdx\in\mathbb{R}^{d}. The function u0u_{0} is μ\mu-integrable by Integrals of Functions with a Bounded Hessian are Intrinsic Test Functions on the Wasserstein Space §integrable (with M=MbM=M_{b}), so Linearity and Monotonicity of the Lebesgue Integral §integrable gives ∫Rd(∣x∣c′2−∣x∣c2) μ(dx)=2θa Φ0(μ)\int_{\mathbb{R}^{d}}(|x|_{c'}^{2}-|x|_{c}^{2})\,\mu(dx)=\frac{2\theta}{a}\,\Phi_{0}(\mu). Therefore, by The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair and Changing the Variances of a Diagonal Gaussian Reference Measure: Equal Domains, the Shift of the Relative Entropy and the Shift of the Relative Score §entropy,

E′(μ)=a H(μ ∣ γc′)=a H(μ ∣ γc)+a2⋅2θa Φ0(μ)+a (Zc′−Zc)=E(μ)+θ Φ0(μ)+a (Zc′−Zc).\mathcal{E}'(\mu)=a\,H(\mu\,|\,\gamma_{c'})=a\,H(\mu\,|\,\gamma_{c})+\frac{a}{2}\cdot\frac{2\theta}{a}\,\Phi_{0}(\mu)+a\,(Z_{c'}-Z_{c})=\mathcal{E}(\mu)+\theta\,\Phi_{0}(\mu)+a\,(Z_{c'}-Z_{c}).

Let ν∈DΣ\nu\in\mathcal{D}_{\Sigma}. By Changing the Variances of a Diagonal Gaussian Reference Measure: Equal Domains, the Shift of the Relative Entropy and the Shift of the Relative Score §score, ζνc′=ζνc+Sc′−Sc\zeta^{c'}_{\nu}=\zeta^{c}_{\nu}+S_{c'}-S_{c} in L2(ν;Rd)L^{2}(\nu;\mathbb{R}^{d}). By clause 2, a Sc′(x)−a Sc(x)=θ Du0(x)a\,S_{c'}(x)-a\,S_{c}(x)=\theta\,Du_{0}(x) for every xx, so a Sc′−a Sc=θ Du0a\,S_{c'}-a\,S_{c}=\theta\,Du_{0} as classes in L2(ν;Rd)L^{2}(\nu;\mathbb{R}^{d}). Hence, by The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair and clause 3,

Σ′(ν)=a ζνc′=a ζνc+θ Du0=Σ(ν)+θ ∇Φ0(ν).\Sigma'(\nu)=a\,\zeta^{c'}_{\nu}=a\,\zeta^{c}_{\nu}+\theta\,Du_{0}=\Sigma(\nu)+\theta\,\nabla\Phi_{0}(\nu).

Clause 5. Let (ν,q)∈V(DΣ)(\nu,q)\in\mathcal{V}(\mathcal{D}_{\Sigma}), r∈Rr\in\mathbb{R} and Y∈S(d)Y\in\mathcal{S}(d); thus ν∈DΣ=DΣ′\nu\in\mathcal{D}_{\Sigma}=\mathcal{D}'_{\Sigma} (clause 4) and q∈L2(ν;Rd)q\in L^{2}(\nu;\mathbb{R}^{d}), so both sides of the asserted identity are defined. By clause 3 and Restrictions, Sums, Real Multiples and Differences of Intrinsic Test Functions on the Wasserstein Space §restriction, regarding Φ0\Phi_{0} as an intrinsic test function on D\mathcal{D} changes neither ∇Φ0(ν)=Du0\nabla\Phi_{0}(\nu)=Du_{0} nor HΦ0(ν)=BH_{\Phi_{0}}(\nu)=B. By Viscosity Subsolutions, Supersolutions and Solutions Relative to a Penalty Pair and a Profile §shifted and the formula of The Lifted Hamilton-Jacobi Equation with a Wick-Square Cost Relative to a Diagonal Gaussian Measure §operator,

FΦ0(ν,r,q,Y)=F(ν,r+Φ0(ν),q+Du0,Y+B)=λ0r+λ0Φ0(ν)+θ2∥q+Du0∥ν2+a ⟨ζνc,q+Du0⟩ν−∫RdVc,β dν−g(ν).(B)F^{\Phi_{0}}(\nu,r,q,Y)=F\bigl(\nu,r+\Phi_{0}(\nu),q+Du_{0},Y+B\bigr)=\lambda_{0}r+\lambda_{0}\Phi_{0}(\nu)+\frac{\theta}{2}\lVert q+Du_{0}\rVert_{\nu}^{2}+a\,\langle\zeta^{c}_{\nu},q+Du_{0}\rangle_{\nu}-\int_{\mathbb{R}^{d}}V_{c,\beta}\,d\nu-g(\nu).\tag{B}

The inner product of L2(ν;Rd)L^{2}(\nu;\mathbb{R}^{d}) is bilinear and symmetric and ∥η∥ν2=⟨η,η⟩ν\lVert\eta\rVert_{\nu}^{2}=\langle\eta,\eta\rangle_{\nu}, by Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §fields; hence

θ2∥q+Du0∥ν2+a ⟨ζνc,q+Du0⟩ν=θ2∥q∥ν2+⟨a ζνc+θ Du0,q⟩ν+θ2∥Du0∥ν2+a ⟨ζνc,Du0⟩ν.\frac{\theta}{2}\lVert q+Du_{0}\rVert_{\nu}^{2}+a\,\langle\zeta^{c}_{\nu},q+Du_{0}\rangle_{\nu}=\frac{\theta}{2}\lVert q\rVert_{\nu}^{2}+\langle a\,\zeta^{c}_{\nu}+\theta\,Du_{0},q\rangle_{\nu}+\frac{\theta}{2}\lVert Du_{0}\rVert_{\nu}^{2}+a\,\langle\zeta^{c}_{\nu},Du_{0}\rangle_{\nu}.

By clause 4, a ζνc+θ Du0=a ζνc′a\,\zeta^{c}_{\nu}+\theta\,Du_{0}=a\,\zeta^{c'}_{\nu}, so ⟨a ζνc+θ Du0,q⟩ν=a ⟨ζνc′,q⟩ν\langle a\,\zeta^{c}_{\nu}+\theta\,Du_{0},q\rangle_{\nu}=a\,\langle\zeta^{c'}_{\nu},q\rangle_{\nu}. It remains to evaluate

R(ν)=λ0Φ0(ν)+θ2∥Du0∥ν2+a ⟨ζνc,Du0⟩ν−∫RdVc,β dν.R(\nu)=\lambda_{0}\Phi_{0}(\nu)+\frac{\theta}{2}\lVert Du_{0}\rVert_{\nu}^{2}+a\,\langle\zeta^{c}_{\nu},Du_{0}\rangle_{\nu}-\int_{\mathbb{R}^{d}}V_{c,\beta}\,d\nu .

We express each term as an integral. First, Φ0(ν)=∫u0 dν\Phi_{0}(\nu)=\int u_{0}\,d\nu. Second, by Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §fields, ∥Du0∥ν2=∫∥Du0(x)∥2 ν(dx)\lVert Du_{0}\rVert_{\nu}^{2}=\int\lVert Du_{0}(x)\rVert^{2}\,\nu(dx), where ∥Du0(x)∥2=∑ibi2xi2\lVert Du_{0}(x)\rVert^{2}=\sum_{i}b_{i}^{2}x_{i}^{2}; the functions u0u_{0} and x↦∥Du0(x)∥2x\mapsto\lVert Du_{0}(x)\rVert^{2} are ν\nu-integrable by Integrals of Functions with a Bounded Hessian are Intrinsic Test Functions on the Wasserstein Space §integrable. Third, ν\nu has finite Fisher information relative to γc\gamma_{c} by The Gaussian Free-Energy Pair: Relative Entropy and Relative Score with Respect to a Diagonal Gaussian Measure §pair, so Gaussian Integration by Parts Relative to a Diagonal Gaussian Measure for Functions with a Bounded Hessian §ibp, applied with f=u0f=u_{0} and M=MbM=M_{b}, gives ⟨ζνc,Du0⟩ν=−∫Lcu0 dν\langle\zeta^{c}_{\nu},Du_{0}\rangle_{\nu}=-\int L_{c}u_{0}\,d\nu, the function Lcu0L_{c}u_{0} being ν\nu-integrable by Gaussian Integration by Parts Relative to a Diagonal Gaussian Measure for Functions with a Bounded Hessian §generator; by The Laplacian of a Twice Continuously Differentiable Function §laplacian, clause 3, The Diagonal Gaussian Density on Euclidean Space and Its Notation §scaling and the definition of the dot product,

Lcu0(x)=Δu0(x)−Sc(x)⋅Du0(x)=∑i=1dbi−∑i=1dbici xi2.L_{c}u_{0}(x)=\Delta u_{0}(x)-S_{c}(x)\cdot Du_{0}(x)=\sum_{i=1}^{d}b_{i}-\sum_{i=1}^{d}\frac{b_{i}}{c_{i}}\,x_{i}^{2}.

Fourth, Vc,β(x)=∑iβi(xi2−ci)V_{c,\beta}(x)=\sum_{i}\beta_{i}(x_{i}^{2}-c_{i}) by The Wick-Square Potential Relative to a Diagonal Gaussian Measure §potential, so that Vc,β(x)=12 x⋅(Mβx)+0Rd⋅x+(−∑i=1dβici)V_{c,\beta}(x)=\tfrac12\,x\cdot(M_{\beta}x)+0_{\mathbb{R}^{d}}\cdot x+\bigl(-\sum_{i=1}^{d}\beta_{i}c_{i}\bigr) for every x∈Rdx\in\mathbb{R}^{d}, where Mβ∈S(d)M_{\beta}\in\mathcal{S}(d) is the diagonal matrix with diagonal entries 2β1,…,2βd2\beta_{1},\dots,2\beta_{d} (as Mβx=(2β1x1,…,2βdxd)M_{\beta}x=(2\beta_{1}x_{1},\dots,2\beta_{d}x_{d}) by the definition of the matrix-vector product). Hence Quadratic and Affine Functions of Class C2C^2, Translation, and Quadratic Perturbation of Semiconvexity §quadratic, applied with n=dn=d, the matrix MβM_{\beta}, linear coefficient 0Rd0_{\mathbb{R}^{d}} and constant term −∑i=1dβici-\sum_{i=1}^{d}\beta_{i}c_{i}, shows that Vc,βV_{c,\beta} is of class C2C^{2} on Rd\mathbb{R}^{d} with Hessian matrix MβM_{\beta}, whose entries are bounded in absolute value by 2∑i=1d∣βi∣2\sum_{i=1}^{d}|\beta_{i}|; so Vc,βV_{c,\beta} is ν\nu-integrable by Integrals of Functions with a Bounded Hessian are Intrinsic Test Functions on the Wasserstein Space §integrable, applied with f=Vc,βf=V_{c,\beta} and M=2∑i=1d∣βi∣M=2\sum_{i=1}^{d}|\beta_{i}|. By Linearity and Monotonicity of the Lebesgue Integral §integrable, R(ν)=∫h dνR(\nu)=\int h\,d\nu with h=λ0u0+θ2∥Du0∥2−a Lcu0−Vc,βh=\lambda_{0}u_{0}+\frac{\theta}{2}\lVert Du_{0}\rVert^{2}-a\,L_{c}u_{0}-V_{c,\beta}, and for every x∈Rdx\in\mathbb{R}^{d}

h(x)=∑i=1d(λ02bi+θ2bi2+acibi−βi)xi2−∑i=1d(a bi−βici).h(x)=\sum_{i=1}^{d}\Bigl(\frac{\lambda_{0}}{2}b_{i}+\frac{\theta}{2}b_{i}^{2}+\frac{a}{c_{i}}b_{i}-\beta_{i}\Bigr)x_{i}^{2}-\sum_{i=1}^{d}\bigl(a\,b_{i}-\beta_{i}c_{i}\bigr).

Each coefficient θ2bi2+(λ02+aci)bi−βi\frac{\theta}{2}b_{i}^{2}+\bigl(\frac{\lambda_{0}}{2}+\frac{a}{c_{i}}\bigr)b_{i}-\beta_{i} vanishes by clause 1, so h(x)=−eh(x)=-e for every xx, and R(ν)=−eR(\nu)=-e since ν\nu is a probability measure. Substituting into (B),

FΦ0(ν,r,q,Y)=λ0r+θ2∥q∥ν2+a ⟨ζνc′,q⟩ν−(g(ν)+e).F^{\Phi_{0}}(\nu,r,q,Y)=\lambda_{0}r+\frac{\theta}{2}\lVert q\rVert_{\nu}^{2}+a\,\langle\zeta^{c'}_{\nu},q\rangle_{\nu}-\bigl(g(\nu)+e\bigr).

By The Lifted Ornstein-Uhlenbeck Hamilton-Jacobi Equation Relative to a Diagonal Gaussian Measure §operator, applied to the Gaussian free-energy pair with variances c′c' and temperature aa (whose score domain is DΣ\mathcal{D}_{\Sigma} by clause 4, and whose score is a ζνc′a\,\zeta^{c'}_{\nu}), with discount λ0\lambda_{0}, control cost θ\theta and running cost ν↦g(ν)+e\nu\mapsto g(\nu)+e, the right-hand side is F′(ν,r,q,Y)F'(\nu,r,q,Y). The argument YY enters neither operator.

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…