TheoremBase

The second-order Taylor remainder bound gives linear growth of the gradient and quadratic growth of the function, hence integrability and differentiability along couplings; tangency holds because adding (dM/2)|x|^2 makes the function convex, so its square-integrable gradient is tangent and a multiple of the identity can be subtracted. The averaged translates are differentiated under the integral with quadratic domination, and continuity follows from convergence of integrals of continuous functions of quadratic growth under Wasserstein convergence.

Proof

Each result cited is universally quantified over the data in its own statement. The dimension dd is the one fixed in The Wasserstein Space and Its Lift to Square-Integrable Random Vectors: Standing Notation §data; inside real expressions it is read in R\mathbb{R} through the canonical map ι\iota of The Canonical Map from the Natural Numbers to a Field and written dd again, so that 0<d0<d by claim 3 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field, and d\sqrt{d} is the nonnegative square root fixed in Probability Measures on Euclidean Space and Random Vectors: Standing Notation §spaces. Since 0≤M0\le M, the real numbers d M\sqrt{d}\,M and dMdM are nonnegative by claim 5 of Elementary Arithmetic in an Ordered Field, and (dM)2(dM)^{2} is nonnegative by claim 2 of Nonnegativity of Squares in an Ordered Field. For z∈Rd+dz\in\mathbb{R}^{d+d} we write x=pr1(z)x=\mathrm{pr}_{1}(z) and y=pr2(z)y=\mathrm{pr}_{2}(z), as in The Intrinsic Calculus on the Wasserstein Space: Standing Notation §couplings. Linearity, homogeneity and monotonicity of integrals are claim 1 (for measurable [0,∞][0,\infty]-valued functions) and claim 2 (for integrable functions, together with ∣∫g∣≤∫∣g∣|\int g|\le\int|g|) of Linearity and Monotonicity of the Lebesgue Integral; by Probability Measures on Euclidean Space and Random Vectors: Standing Notation §measures a nonnegative Borel real function is integrated as a [0,∞][0,\infty]-valued map, and every bounded Borel real function is integrable with respect to every probability measure on Rq\mathbb{R}^{q}. A constant real function cc is Borel by claim 1 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions, and its integral against a probability measure ρ\rho is cc when 0≤c0\le c, by The Integral of an Indicator Function is the Measure of the Set (with the set Rq\mathbb{R}^{q}, of measure 11) and the homogeneity in claim 1 of Linearity and Monotonicity of the Lebesgue Integral. We write φ\varphi for φf\varphi_{f}.

Step 1. Regularity of ff and three pointwise bounds. The set Rd\mathbb{R}^{d} is open by claim 1 of Euclidean Space is Open in Itself, and CkC^k Maps are Continuous. Since ff is of class C2C^{2}, clause 2 of C^k Maps on a Euclidean Open Set (read through clause 3 there) shows that ff is of class C1C^{1} and that each ∂if\partial_{i}f is of class C1C^{1} on Rd\mathbb{R}^{d}, its partial derivatives being the iterated partial derivatives ∂j∂if\partial_{j}\partial_{i}f of clause 4 there; by clause 1 there the functions ff, ∂if\partial_{i}f and ∂j∂if\partial_{j}\partial_{i}f (i,j∈[d]i,j\in[d]) are continuous at every point of Rd\mathbb{R}^{d} in the Euclidean sense, hence continuous from (Rd,dE)(\mathbb{R}^{d},d_{E}) to (R,dR)(\mathbb{R},d_{\mathbb{R}}) by claim 1 of Euclidean Continuity Agrees with Metric Continuity for Real-Valued Functions, hence Borel by Probability Measures on Euclidean Space and Random Vectors: Standing Notation §borel-maps. For x,y∈Rdx,y\in\mathbb{R}^{d} the segment joining xx and yy lies in Rd\mathbb{R}^{d}, the Euclidean distance between xx and yy is ∥x−y∥\lVert x-y\rVert by claim 2 of Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n, and ∥y−x∥=∥x−y∥\lVert y-x\rVert=\lVert x-y\rVert by claim 5 there with the scalar −1-1, whose absolute value is 11. We record three bounds, valid for all x,y∈Rdx,y\in\mathbb{R}^{d} and all i∈[d]i\in[d], and then the growth bounds they imply; no bound on the first derivatives of ff is used.

(T2) ∣f(y)−f(x)−Df(x)⋅(y−x)∣≤C1∥x−y∥2|f(y)-f(x)-Df(x)\cdot(y-x)|\le C_{1}\lVert x-y\rVert^{2} with C1=2−1dMC_{1}=2^{-1}dM, by claim (ii) of Multivariate Taylor Expansion with Uniform Second-Order Remainder, read with n=dn=d, W=RdW=\mathbb{R}^{d} and M2=MM_{2}=M, since with h=y−xh=y-x the sum ∑i=1d∂if(x)hi\sum_{i=1}^{d}\partial_{i}f(x)h_{i} is Df(x)⋅(y−x)Df(x)\cdot(y-x) by Gradient of a Real-Valued Function on a Euclidean Open Set and Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n. Here 0≤C10\le C_{1}, because 0<2−10<2^{-1} by claim 8 of Elementary Order Arithmetic in an Ordered Field and 0≤dM0\le dM, using claim 5 of Elementary Arithmetic in an Ordered Field.

(T3) ∣∂if(y)−∂if(x)∣≤d M∥x−y∥|\partial_{i}f(y)-\partial_{i}f(x)|\le\sqrt{d}\,M\lVert x-y\rVert, by claim (i) of Multivariate Taylor Expansion with Uniform Second-Order Remainder applied to the function ∂if\partial_{i}f, of class C1C^{1} with partial derivatives ∂j∂if\partial_{j}\partial_{i}f bounded in absolute value by MM.

(T4) ∥Df(x)−Df(y)∥2≤(dM)2∥x−y∥2\lVert Df(x)-Df(y)\rVert^{2}\le(dM)^{2}\lVert x-y\rVert^{2}. Indeed, by claim 1 of Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n, Gradient of a Real-Valued Function on a Euclidean Open Set and Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n, ∥Df(x)−Df(y)∥2=∑i=1d(∂if(x)−∂if(y))2\lVert Df(x)-Df(y)\rVert^{2}=\sum_{i=1}^{d}(\partial_{i}f(x)-\partial_{i}f(y))^{2}. Each summand is at most (d M∥x−y∥)2=d M2∥x−y∥2(\sqrt{d}\,M\lVert x-y\rVert)^{2}=d\,M^{2}\lVert x-y\rVert^{2}, by (T3), claim 2 of Properties of the Absolute Value in an Ordered Field, claim 1 of Nonnegativity of Squares in an Ordered Field and claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field. Summing, by claims 2, 3 and 5 of Properties of Finite Sums applied to the nonnegative differences, and evaluating the sum of dd equal summands d M2∥x−y∥2d\,M^{2}\lVert x-y\rVert^{2} as d⋅d M2∥x−y∥2d\cdot d\,M^{2}\lVert x-y\rVert^{2} by claim 3 there and The Canonical Map from the Natural Numbers to a Field, we obtain (T4), the right-hand side being (dM)2∥x−y∥2(dM)^{2}\lVert x-y\rVert^{2} by commutativity.

(G1) ∥Df(x)−Df(0Rd)∥≤dM∥x∥\lVert Df(x)-Df(0_{\mathbb{R}^{d}})\rVert\le dM\lVert x\rVert and ∥Df(x)∥≤∥Df(0Rd)∥+dM∥x∥\lVert Df(x)\rVert\le\lVert Df(0_{\mathbb{R}^{d}})\rVert+dM\lVert x\rVert for every x∈Rdx\in\mathbb{R}^{d}. Indeed, x−0Rd=xx-0_{\mathbb{R}^{d}}=x componentwise (Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n), so (T4), read with 0Rd0_{\mathbb{R}^{d}} in place of yy, gives ∥Df(x)−Df(0Rd)∥2≤(dM)2∥x∥2=(dM∥x∥)2\lVert Df(x)-Df(0_{\mathbb{R}^{d}})\rVert^{2}\le(dM)^{2}\lVert x\rVert^{2}=(dM\lVert x\rVert)^{2}. Both ∥Df(x)−Df(0Rd)∥\lVert Df(x)-Df(0_{\mathbb{R}^{d}})\rVert and dM∥x∥dM\lVert x\rVert are nonnegative (Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §square and claim 5 of Elementary Arithmetic in an Ordered Field), so the first bound follows by claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field. Since Df(x)=(Df(x)−Df(0Rd))+Df(0Rd)Df(x)=(Df(x)-Df(0_{\mathbb{R}^{d}}))+Df(0_{\mathbb{R}^{d}}) in the real vector space Rd\mathbb{R}^{d} (Euclidean Space Rn\mathbb{R}^n is a Real Vector Space, claim 3 there), the triangle inequality Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §triangle gives the second.

(G2) ∣f(x)∣≤∣f(0Rd)∣+∥Df(0Rd)∥ ∥x∥+C1∥x∥2|f(x)|\le|f(0_{\mathbb{R}^{d}})|+\lVert Df(0_{\mathbb{R}^{d}})\rVert\,\lVert x\rVert+C_{1}\lVert x\rVert^{2} for every x∈Rdx\in\mathbb{R}^{d}, where C1=dM2C_{1}=\tfrac{dM}{2}; with (G1) this is the pair of bounds asserted in claim 1. Indeed, (T2), read with 0Rd0_{\mathbb{R}^{d}} in place of xx and xx in place of yy, gives ∣r∣≤C1∥x∥2|r|\le C_{1}\lVert x\rVert^{2} for r=f(x)−f(0Rd)−Df(0Rd)⋅xr=f(x)-f(0_{\mathbb{R}^{d}})-Df(0_{\mathbb{R}^{d}})\cdot x, as x−0Rd=xx-0_{\mathbb{R}^{d}}=x and ∥0Rd−x∥=∥x∥\lVert0_{\mathbb{R}^{d}}-x\rVert=\lVert x\rVert (Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §homogeneity with the scalar −1-1). As f(x)=f(0Rd)+Df(0Rd)⋅x+rf(x)=f(0_{\mathbb{R}^{d}})+Df(0_{\mathbb{R}^{d}})\cdot x+r, two applications of Properties of the Absolute Value in an Ordered Field §triangle and the Cauchy-Schwarz inequality Cauchy-Schwarz Inequality for the Euclidean Dot Product, which gives ∣Df(0Rd)⋅x∣≤∥Df(0Rd)∥ ∥x∥|Df(0_{\mathbb{R}^{d}})\cdot x|\le\lVert Df(0_{\mathbb{R}^{d}})\rVert\,\lVert x\rVert, yield (G2).

(G3) ∣∂kf(x)∣≤∥Df(0Rd)∥+d M∥x∥|\partial_{k}f(x)|\le\lVert Df(0_{\mathbb{R}^{d}})\rVert+\sqrt{d}\,M\lVert x\rVert for every x∈Rdx\in\mathbb{R}^{d} and k∈[d]k\in[d]. Indeed, ∂kf(0Rd)\partial_{k}f(0_{\mathbb{R}^{d}}) is the kkth component of Df(0Rd)Df(0_{\mathbb{R}^{d}}) (Gradient of a Real-Valued Function on a Euclidean Open Set), so ∣∂kf(0Rd)∣≤∥Df(0Rd)∥|\partial_{k}f(0_{\mathbb{R}^{d}})|\le\lVert Df(0_{\mathbb{R}^{d}})\rVert by Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §coordinate; and ∣∂kf(x)−∂kf(0Rd)∣≤d M∥x∥|\partial_{k}f(x)-\partial_{k}f(0_{\mathbb{R}^{d}})|\le\sqrt{d}\,M\lVert x\rVert by (T3) read with 0Rd0_{\mathbb{R}^{d}} in place of xx and xx in place of yy, as ∥0Rd−x∥=∥x∥\lVert0_{\mathbb{R}^{d}}-x\rVert=\lVert x\rVert (Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §homogeneity with the scalar −1-1); Properties of the Absolute Value in an Ordered Field §triangle combines the two.

(G) With A=∣f(0Rd)∣+∥Df(0Rd)∥+C1A=|f(0_{\mathbb{R}^{d}})|+\lVert Df(0_{\mathbb{R}^{d}})\rVert+C_{1} and B=∥Df(0Rd)∥+d MB=\lVert Df(0_{\mathbb{R}^{d}})\rVert+\sqrt{d}\,M, nonnegative real numbers (Properties of the Absolute Value in an Ordered Field §nonnegative, Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §square and claim 2 of Elementary Arithmetic in an Ordered Field), we have ∣f(x)∣≤A(1+∥x∥2)|f(x)|\le A(1+\lVert x\rVert^{2}) and ∣∂kf(x)∣≤B(1+∥x∥2)|\partial_{k}f(x)|\le B(1+\lVert x\rVert^{2}) for every x∈Rdx\in\mathbb{R}^{d} and k∈[d]k\in[d]. Indeed, we first show 1≤1+∥x∥21\le1+\lVert x\rVert^{2} and ∥x∥≤1+∥x∥2\lVert x\rVert\le1+\lVert x\rVert^{2}: as 0≤∥x∥20\le\lVert x\rVert^{2} (claim 2 of Nonnegativity of Squares in an Ordered Field), the first holds by claim 3 of Elementary Arithmetic in an Ordered Field; if ∥x∥≤1\lVert x\rVert\le1 the second follows from the first; if 1<∥x∥1<\lVert x\rVert, then 0<∥x∥0<\lVert x\rVert and ∥x∥=∥x∥⋅1<∥x∥⋅∥x∥\lVert x\rVert=\lVert x\rVert\cdot1<\lVert x\rVert\cdot\lVert x\rVert by claims 2, 6 and 10 of Elementary Order Arithmetic in an Ordered Field, and ∥x∥2≤1+∥x∥2\lVert x\rVert^{2}\le1+\lVert x\rVert^{2} as 0≤10\le1. Multiplying the three inequalities 1≤1+∥x∥21\le1+\lVert x\rVert^{2}, ∥x∥≤1+∥x∥2\lVert x\rVert\le1+\lVert x\rVert^{2} and ∥x∥2≤1+∥x∥2\lVert x\rVert^{2}\le1+\lVert x\rVert^{2} by the nonnegative numbers ∣f(0Rd)∣|f(0_{\mathbb{R}^{d}})|, ∥Df(0Rd)∥\lVert Df(0_{\mathbb{R}^{d}})\rVert and C1C_{1} respectively (claim 5 of Elementary Arithmetic in an Ordered Field) and adding them (claims 2 and 3 there) bounds the right-hand side of (G2) by A(1+∥x∥2)A(1+\lVert x\rVert^{2}); multiplying the first two by ∥Df(0Rd)∥\lVert Df(0_{\mathbb{R}^{d}})\rVert and d M\sqrt{d}\,M and adding bounds the right-hand side of (G3) by B(1+∥x∥2)B(1+\lVert x\rVert^{2}). This proves (G).

Step 2. Claim 1. Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), a probability measure on (Rd,B(Rd))(\mathbb{R}^{d},\mathcal{B}(\mathbb{R}^{d})) by The Second Moment of a Probability Measure on Euclidean Space and the Probability Measures with Finite Second Moment §space. We first record a general fact.

(Q) Let ρ∈P2(Rd)\rho\in\mathcal{P}_{2}(\mathbb{R}^{d}), let KK be a nonnegative real number and let h:Rd→Rh:\mathbb{R}^{d}\to\mathbb{R} be Borel with ∣h(x)∣≤K(1+∥x∥2)|h(x)|\le K(1+\lVert x\rVert^{2}) for every x∈Rdx\in\mathbb{R}^{d}. Then hh is integrable with respect to ρ\rho. Indeed, the nonnegative Borel function x↦∥x∥2x\mapsto\lVert x\rVert^{2} (Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs) has ρ\rho-integral M2(ρ)<∞M_{2}(\rho)<\infty by The Second Moment of a Probability Measure on Euclidean Space and the Probability Measures with Finite Second Moment §moment and The Second Moment of a Probability Measure on Euclidean Space and the Probability Measures with Finite Second Moment §space, so it is integrable by Integrable Function and the Lebesgue Integral; the constant KK is integrable, being bounded and Borel; hence g0(x)=K+K∥x∥2g_{0}(x)=K+K\lVert x\rVert^{2} is integrable by claim 2 of Linearity and Monotonicity of the Lebesgue Integral, and it is nonnegative. The function ∣h∣|h| is Borel by claim 4 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions and ∣h∣≤g0|h|\le g_{0}, so ∫∣h∣ dρ≤∫g0 dρ<∞\int|h|\,d\rho\le\int g_{0}\,d\rho<\infty by the monotonicity in claim 1 of Linearity and Monotonicity of the Lebesgue Integral, and hh is integrable with respect to ρ\rho by Integrable Function and the Lebesgue Integral.

The function ff is Borel by Step 1, so (Q), read with ρ=μ\rho=\mu, K=AK=A and h=fh=f, and (G) show that ff is integrable with respect to μ\mu. Thus φ\varphi is defined. The gradient map x↦Df(x)x\mapsto Df(x) has the components ∂1f,…,∂df\partial_{1}f,\dots,\partial_{d}f (Gradient of a Real-Valued Function on a Euclidean Open Set), each Borel by Step 1, so it is Borel by Probability Measures on Euclidean Space and Random Vectors: Standing Notation §borel-maps; and x↦∥Df(x)∥2x\mapsto\lVert Df(x)\rVert^{2} is Borel as its composition with the Borel map x↦∥x∥2x\mapsto\lVert x\rVert^{2} (same clause and Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs). For real s,ts,t we have (s+t)2≤2s2+2t2(s+t)^{2}\le2s^{2}+2t^{2}, since 0≤(s−t)20\le(s-t)^{2}; so (G1), claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field (applied to the nonnegative numbers ∥Df(x)∥\lVert Df(x)\rVert and ∥Df(0Rd)∥+dM∥x∥\lVert Df(0_{\mathbb{R}^{d}})\rVert+dM\lVert x\rVert) and claim 5 of Elementary Arithmetic in an Ordered Field give, for every x∈Rdx\in\mathbb{R}^{d},

∥Df(x)∥2≤2∥Df(0Rd)∥2+2(dM)2∥x∥2≤KD(1+∥x∥2),KD=2∥Df(0Rd)∥2+2(dM)2.\lVert Df(x)\rVert^{2}\le2\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2}+2(dM)^{2}\lVert x\rVert^{2}\le K_{D}\bigl(1+\lVert x\rVert^{2}\bigr),\qquad K_{D}=2\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2}+2(dM)^{2}.

Here KDK_{D} is a nonnegative real number: the squares ∥Df(0Rd)∥2\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2} and (dM)2(dM)^{2} are nonnegative by claim 2 of Nonnegativity of Squares in an Ordered Field, 2=1+12=1+1 is nonnegative by claims 1 and 2 of Elementary Arithmetic in an Ordered Field, so 2∥Df(0Rd)∥22\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2} and 2(dM)22(dM)^{2} are nonnegative by claim 5 there, and their sum KDK_{D} is nonnegative by claim 2 there. The second inequality of the display holds because, as shown in (G), 1≤1+∥x∥21\le1+\lVert x\rVert^{2} and ∥x∥2≤1+∥x∥2\lVert x\rVert^{2}\le1+\lVert x\rVert^{2}; multiplying these by the nonnegative numbers 2∥Df(0Rd)∥22\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2} and 2(dM)22(dM)^{2} respectively (claim 5 of Elementary Arithmetic in an Ordered Field) and adding them (claims 2 and 3 there) bounds 2∥Df(0Rd)∥2+2(dM)2∥x∥22\lVert Df(0_{\mathbb{R}^{d}})\rVert^{2}+2(dM)^{2}\lVert x\rVert^{2} by KD(1+∥x∥2)K_{D}(1+\lVert x\rVert^{2}). By (Q), read with ρ=μ\rho=\mu, K=KDK=K_{D} and h=∥Df∥2h=\lVert Df\rVert^{2}, which is nonnegative and so equal to its absolute value, ∫Rd∥Df∥2 dμ<∞\int_{\mathbb{R}^{d}}\lVert Df\rVert^{2}\,d\mu<\infty. Hence the class of DfDf belongs to L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}) by Square-Integrable Vector Fields Against a Probability Measure on Euclidean Space, and Test Functions: Standing Notation §l2mu, and it is again written DfDf. For i,j∈[d]i,j\in[d] the entry of D2f(x)D^{2}f(x) in row ii and column jj is ∂i∂jf(x)\partial_{i}\partial_{j}f(x) by Hessian Matrix of a C^2 Function; the function ∂i∂jf\partial_{i}\partial_{j}f is Borel by Step 1 and bounded by MM by hypothesis, hence integrable with respect to μ\mu. Write Φ(μ)=∫RdD2f dμ\Phi(\mu)=\int_{\mathbb{R}^{d}}D^{2}f\,d\mu for the matrix of these integrals. By claim 1 of Equality of Mixed Second Partial Derivatives and Symmetry of the Hessian, read with n=dn=d and U=RdU=\mathbb{R}^{d}, ∂i∂jf(x)=∂j∂if(x)\partial_{i}\partial_{j}f(x)=\partial_{j}\partial_{i}f(x) for every xx, so the entries of Φ(μ)\Phi(\mu) in positions (i,j)(i,j) and (j,i)(j,i) are integrals of the same function and coincide; hence Φ(μ)∈S(d)\Phi(\mu)\in\mathcal{S}(d) by Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §symmetric. This proves claim 1.

Step 2a. Claim 3. Put λ=dM\lambda=dM, a nonnegative real number with λ⋅2−1=C1\lambda\cdot2^{-1}=C_{1}. The set Rd\mathbb{R}^{d} is convex, every point t x+(1−t) yt\,x+(1-t)\,y with x,y∈Rdx,y\in\mathbb{R}^{d} lying in Rd\mathbb{R}^{d}.

First, ff is semiconvex on Rd\mathbb{R}^{d} with constant λ\lambda. Let x,y∈Rdx,y\in\mathbb{R}^{d} and t∈Rt\in\mathbb{R} with 0≤t≤10\le t\le1, and put z=t x+(1−t) yz=t\,x+(1-t)\,y and u=x−yu=x-y. Componentwise (Sum of Points of Rn\mathbb{R}^n, Scalar Multiple of a Point of Rn\mathbb{R}^n, Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n) we have x−z=(1−t) ux-z=(1-t)\,u, y−z=(−t) uy-z=(-t)\,u, z−x=(t−1) uz-x=(t-1)\,u and z−y=t uz-y=t\,u. Hence, with p=Df(z)⋅up=Df(z)\cdot u, the second argument rules of claim 5 of the bilinearity lemma give Df(z)⋅(x−z)=(1−t) pDf(z)\cdot(x-z)=(1-t)\,p and Df(z)⋅(y−z)=−t pDf(z)\cdot(y-z)=-t\,p, and Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §homogeneity, with ∣s∣2=s2|s|^{2}=s^{2} for real ss (Properties of the Absolute Value in an Ordered Field §nonnegative), gives ∥z−x∥2=(1−t)2∥u∥2\lVert z-x\rVert^{2}=(1-t)^{2}\lVert u\rVert^{2} and ∥z−y∥2=t2∥u∥2\lVert z-y\rVert^{2}=t^{2}\lVert u\rVert^{2}. Now (T2), read with zz in place of xx and with xx, respectively yy, in place of yy, together with Properties of the Absolute Value in an Ordered Field §two-sided, gives

f(x)≥f(z)+(1−t) p−C1(1−t)2∥u∥2,f(y)≥f(z)−t p−C1t2∥u∥2.f(x)\ge f(z)+(1-t)\,p-C_{1}(1-t)^{2}\lVert u\rVert^{2},\qquad f(y)\ge f(z)-t\,p-C_{1}t^{2}\lVert u\rVert^{2}.

Multiplying the first inequality by t≥0t\ge0 and the second by 1−t≥01-t\ge0 and adding, the terms in pp cancel and t(1−t)2+(1−t)t2=t(1−t)t(1-t)^{2}+(1-t)t^{2}=t(1-t), so

f(t x+(1−t) y)≤t f(x)+(1−t) f(y)+λ2 t(1−t) ∥x−y∥2.f\bigl(t\,x+(1-t)\,y\bigr)\le t\,f(x)+(1-t)\,f(y)+\tfrac{\lambda}{2}\,t(1-t)\,\lVert x-y\rVert^{2}.

As xx, yy and tt were arbitrary, Quadratic Increment Characterisation of Semiconvexity, read with n=dn=d, C=RdC=\mathbb{R}^{d} and the constant λ\lambda, shows that ff is semiconvex on Rd\mathbb{R}^{d} with constant λ\lambda. By Semiconvex Function on a Convex Subset of Rn\mathbb{R}^n (see also Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation §convexity), the function g:Rd→Rg:\mathbb{R}^{d}\to\mathbb{R}, g(x)=f(x)+λ2∥x∥2g(x)=f(x)+\tfrac{\lambda}{2}\lVert x\rVert^{2}, is convex on Rd\mathbb{R}^{d}.

Second, gg is of class C1C^{1} with Dg(x)=Df(x)+λxDg(x)=Df(x)+\lambda x. The matrix λId\lambda I_{d} lies in S(d)\mathcal{S}(d) and satisfies z⋅((λId)z)=λ∥z∥2z\cdot((\lambda I_{d})z)=\lambda\lVert z\rVert^{2} by Vector, Entry and Comparison Bounds for the Norm of a Symmetric Real Matrix §identity, and 0Rd⋅z=∑k=1d0⋅zk=00_{\mathbb{R}^{d}}\cdot z=\sum_{k=1}^{d}0\cdot z_{k}=0 by Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n and claim 3 of Properties of Finite Sums. So Quadratic and Affine Functions of Class C2C^2, Translation, and Quadratic Perturbation of Semiconvexity §quadratic, read with n=dn=d, the matrix λId\lambda I_{d} in place of the matrix written MM there, q=0Rdq=0_{\mathbb{R}^{d}} and c=0c=0, shows that qλ(z)=λ2∥z∥2q_{\lambda}(z)=\tfrac{\lambda}{2}\lVert z\rVert^{2} defines a function of class C2C^{2} on Rd\mathbb{R}^{d} with Dqλ(z)=(λId)z+0Rd=(λId)zDq_{\lambda}(z)=(\lambda I_{d})z+0_{\mathbb{R}^{d}}=(\lambda I_{d})z (Euclidean Space Rn\mathbb{R}^n is a Real Vector Space, claim 1 there). By Matrix-Vector Product, Scalar Multiple of a Real Matrix and Identity Matrix, the iith component of (λId)z(\lambda I_{d})z is a sum over k∈[d]k\in[d] whose summands vanish for k≠ik\ne i and whose iith summand is λzi\lambda z_{i}, so it equals λzi\lambda z_{i} by claim 7 of Properties of Finite Sums; thus ∂iqλ(z)=λzi\partial_{i}q_{\lambda}(z)=\lambda z_{i} by Gradient of a Real-Valued Function on a Euclidean Open Set. By clause 2 of C^k Maps on a Euclidean Open Set (read through clause 3), qλq_{\lambda} and ff are of class C1C^{1}, so g=f+qλg=f+q_{\lambda} is of class C1C^{1} on Rd\mathbb{R}^{d} by claim 3 of Constants, Coordinate Functions, Sums and Products of CkC^k Functions on a Euclidean Open Set, with ∂ig(x)=∂if(x)+λxi\partial_{i}g(x)=\partial_{i}f(x)+\lambda x_{i} by claim 1 there; by Gradient of a Real-Valued Function on a Euclidean Open Set, Sum of Points of Rn\mathbb{R}^n and Scalar Multiple of a Point of Rn\mathbb{R}^n, Dg(x)=Df(x)+λxDg(x)=Df(x)+\lambda x for every xx.

Third, let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). By Square-Integrable Vector Fields Against a Probability Measure on Euclidean Space, and Test Functions: Standing Notation §l2mu the elements of L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}) are the classes of the square-integrable random vectors on (Rd,B(Rd),μ)(\mathbb{R}^{d},\mathcal{B}(\mathbb{R}^{d}),\mu) in the sense of The Space of Square-Integrable Random Vectors §space. The gradient map DfDf is such a random vector by Step 2, and so is id\mathrm{id} by Basic Properties of the Tangent Space: Closed Subspace, the Identity Map Belongs to It, Second-Moment Limits, and Representation of Bounded Functionals on Gradients §identity; as these are closed under sums and scalar multiples (The Space of Square-Integrable Random Vectors §space), the gradient map ∇g:x↦Dg(x)=Df(x)+λx\nabla g:x\mapsto Dg(x)=Df(x)+\lambda x satisfies ∫Rd∥∇g∥2 dμ<∞\int_{\mathbb{R}^{d}}\lVert\nabla g\rVert^{2}\,d\mu<\infty, and by The Space of Square-Integrable Random Vectors §classes its class is ∇g=Df+λ id\nabla g=Df+\lambda\,\mathrm{id} in L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}). Since gg is of class C1C^{1} and convex on Rd\mathbb{R}^{d}, The Gradient of a Convex Continuously Differentiable Function Belongs to the Tangent Space When It Is Square-Integrable §tangent gives ∇g∈Tμ\nabla g\in T_{\mu}, and id∈Tμ\mathrm{id}\in T_{\mu} by Basic Properties of the Tangent Space: Closed Subspace, the Identity Map Belongs to It, Second-Moment Limits, and Representation of Bounded Functionals on Gradients §identity. By Basic Properties of the Tangent Space: Closed Subspace, the Identity Map Belongs to It, Second-Moment Limits, and Representation of Bounded Functionals on Gradients §closed, TμT_{\mu} is a linear subspace of L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}), so it contains ∇g+(−λ) id=Df\nabla g+(-\lambda)\,\mathrm{id}=Df. As μ\mu was arbitrary, this proves claim 3.

Step 3. Integrals along a coupling. Let μ,ν∈P2(Rd)\mu,\nu\in\mathcal{P}_{2}(\mathbb{R}^{d}) and π∈Π(μ,ν)\pi\in\Pi(\mu,\nu). By Couplings of Two Probability Measures on Euclidean Space and Their Quadratic Cost §coupling, (pr1)#π=μ(\mathrm{pr}_{1})_{\#}\pi=\mu and (pr2)#π=ν(\mathrm{pr}_{2})_{\#}\pi=\nu, the projections being Borel by Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs. Hence, by Step 2 and the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pushforward, the Borel functions z↦f(x)z\mapsto f(x) and z↦f(y)z\mapsto f(y) (compositions of Borel maps, Probability Measures on Euclidean Space and Random Vectors: Standing Notation §borel-maps) are π\pi-integrable with

∫Rd+df(x) π(dz)=φ(μ),∫Rd+df(y) π(dz)=φ(ν).\int_{\mathbb{R}^{d+d}}f(x)\,\pi(dz)=\varphi(\mu),\qquad\int_{\mathbb{R}^{d+d}}f(y)\,\pi(dz)=\varphi(\nu).

Moreover I(π)=∫Rd+d∥x−y∥2 π(dz)I(\pi)=\int_{\mathbb{R}^{d+d}}\lVert x-y\rVert^{2}\,\pi(dz) by Couplings of Two Probability Measures on Euclidean Space and Their Quadratic Cost §cost, a nonnegative real number by Couplings on Euclidean Space: Product Coupling, Swap, Finiteness of the Cost, Push-Forward Couplings, Modifying One Marginal, Quantisation, Gluing over a Finitely Supported Measure, and the Lipschitz Bound §cost-finite.

Step 4. Property (a). Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) and let (μn)n∈N(\mu_{n})_{n\in\mathbb{N}} be a sequence in P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}) converging to μ\mu in the metric space (P2(Rd),W2)(\mathcal{P}_{2}(\mathbb{R}^{d}),W_{2}) of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §dimensions. By Convergent Sequence in a Metric Space, for every positive ε\varepsilon there is NN with W2(μn,μ)<εW_{2}(\mu_{n},\mu)<\varepsilon for n≥Nn\ge N; as W2(μn,μ)W_{2}(\mu_{n},\mu) is nonnegative (The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §metric), it equals ∣W2(μn,μ)−0∣|W_{2}(\mu_{n},\mu)-0| by Absolute Value in an Ordered Field, so lim⁡n→∞W2(μn,μ)=0\lim_{n\to\infty}W_{2}(\mu_{n},\mu)=0 in the sense of Limit of a Sequence of Real Numbers. The function ff is continuous (Step 1) and satisfies (G), so Convergence in the Wasserstein Distance Implies Weak Convergence and Convergence of Integrals of Continuous Functions of Quadratic Growth §quadratic, read with m=dm=d and h=fh=f, gives lim⁡n→∞φ(μn)=φ(μ)\lim_{n\to\infty}\varphi(\mu_{n})=\varphi(\mu); since dR(s,t)=∣s−t∣d_{\mathbb{R}}(s,t)=|s-t| (The Absolute Value Metric on the Real Line), this is convergence of (φ(μn))n(\varphi(\mu_{n}))_{n} to φ(μ)\varphi(\mu) in (R,dR)(\mathbb{R},d_{\mathbb{R}}) in the sense of Convergent Sequence in a Metric Space. As μ\mu and the sequence were arbitrary, Continuity Between Metric Spaces is Equivalent to Sequential Continuity §on-subset, read with X=A=P2(Rd)X=A=\mathcal{P}_{2}(\mathbb{R}^{d}) and the metric W2W_{2} (whose restriction to AA is W2W_{2} itself) and with Y=RY=\mathbb{R}, shows that φ\varphi is continuous on P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}).

Step 5. Property (b) and the gradient. Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). By Step 2, the gradient map DfDf is Borel with ∫∥Df∥2 dμ<∞\int\lVert Df\rVert^{2}\,d\mu<\infty and its class DfDf lies in L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}); by Step 2a, Df∈TμDf\in T_{\mu}. Let ν∈P2(Rd)\nu\in\mathcal{P}_{2}(\mathbb{R}^{d}) and π∈Π(μ,ν)\pi\in\Pi(\mu,\nu). By The Displacement Pairing of a Square-Integrable Vector Field Along a Coupling §pairing, applied with the representative DfDf, the function z↦Df(x)⋅(y−x)z\mapsto Df(x)\cdot(y-x) is Borel and π\pi-integrable with integral J(Df,π)\mathcal{J}(Df,\pi). With Step 3 and claim 2 of Linearity and Monotonicity of the Lebesgue Integral, the function

Rπ(z)=f(y)−f(x)−Df(x)⋅(y−x)R_{\pi}(z)=f(y)-f(x)-Df(x)\cdot(y-x)

is π\pi-integrable with ∫Rπ dπ=φ(ν)−φ(μ)−J(Df,π)\int R_{\pi}\,d\pi=\varphi(\nu)-\varphi(\mu)-\mathcal{J}(Df,\pi), and ∣∫Rπ dπ∣≤∫∣Rπ∣ dπ|\int R_{\pi}\,d\pi|\le\int|R_{\pi}|\,d\pi. The function ∣Rπ∣|R_{\pi}| is nonnegative and Borel (claim 4 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions) and ∣Rπ(z)∣≤C1∥x−y∥2|R_{\pi}(z)|\le C_{1}\lVert x-y\rVert^{2} for every zz by (T2); so the monotonicity and homogeneity in claim 1 of Linearity and Monotonicity of the Lebesgue Integral, with Step 3, give

∣φ(ν)−φ(μ)−J(Df,π)∣≤C1 I(π)for all ν∈P2(Rd) and π∈Π(μ,ν).(B1)\bigl|\varphi(\nu)-\varphi(\mu)-\mathcal{J}(Df,\pi)\bigr|\le C_{1}\,I(\pi)\qquad\text{for all }\nu\in\mathcal{P}_{2}(\mathbb{R}^{d})\text{ and }\pi\in\Pi(\mu,\nu). \tag{B1}

Now let ε∈R\varepsilon\in\mathbb{R} be positive. First put θ=ε (C1+1)−1\theta=\varepsilon\,(C_{1}+1)^{-1}; it is positive, because 0<C1+10<C_{1}+1 by claims 3 and 6 of Elementary Order Arithmetic in an Ordered Field (as 0≤C10\le C_{1}), and then claims 7 and 5 there apply. Then let ν∈P2(Rd)\nu\in\mathcal{P}_{2}(\mathbb{R}^{d}) and π∈Π(μ,ν)\pi\in\Pi(\mu,\nu) satisfy I(π)<θ2I(\pi)<\theta^{2}, and put s=I(π)s=\sqrt{I(\pi)}, so that 0≤s0\le s and s2=I(π)s^{2}=I(\pi). By claim 1 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field, s<θs<\theta. By claim 5 of Elementary Arithmetic in an Ordered Field, applied first to s≤θs\le\theta with the nonnegative factor C1sC_{1}s, and then to C1≤C1+1C_{1}\le C_{1}+1 with the nonnegative factor θs\theta s,

C1 I(π)=C1 s s≤C1 θ s≤(C1+1) θ s=ε s.C_{1}\,I(\pi)=C_{1}\,s\,s\le C_{1}\,\theta\,s\le(C_{1}+1)\,\theta\,s=\varepsilon\,s .

With (B1), ∣φ(ν)−φ(μ)−J(Df,π)∣≤εI(π)|\varphi(\nu)-\varphi(\mu)-\mathcal{J}(Df,\pi)|\le\varepsilon\sqrt{I(\pi)}. This is the condition of Differentiability of a Function on the Wasserstein Space Along Couplings, and Its Gradient §differentiable with η=Df\eta=Df, so φ\varphi is differentiable along couplings at μ\mu, and by Differentiability of a Function on the Wasserstein Space Along Couplings, and Its Gradient §gradient its gradient along couplings is ∇φ(μ)=Df\nabla\varphi(\mu)=Df, which lies in TμT_{\mu}. As μ\mu was arbitrary, property (b) holds with Q=P2(Rd)Q=\mathcal{P}_{2}(\mathbb{R}^{d}), and the gradient is as asserted in claim 2.

Step 6. Property (c). Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), let (μn)n∈N(\mu_{n})_{n\in\mathbb{N}} be a sequence in P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}) and let πn∈Π(μn,μ)\pi_{n}\in\Pi(\mu_{n},\mu) with lim⁡n→∞I(πn)=0\lim_{n\to\infty}I(\pi_{n})=0. By Step 5, ∇φ(μn)\nabla\varphi(\mu_{n}) and ∇φ(μ)\nabla\varphi(\mu) are the classes of DfDf in L2(μn;Rd)L^{2}(\mu_{n};\mathbb{R}^{d}) and in L2(μ;Rd)L^{2}(\mu;\mathbb{R}^{d}), so by The Discrepancy of Two Square-Integrable Vector Fields Along a Coupling of Their Base Measures §well-defined, computed with the representative DfDf on both sides, their discrepancy along πn\pi_{n} is the nonnegative real number

δn=∫Rd+d∥Df(x)−Df(y)∥2 πn(dz).\delta_{n}=\int_{\mathbb{R}^{d+d}}\lVert Df(x)-Df(y)\rVert^{2}\,\pi_{n}(dz).

By (T4), the monotonicity and homogeneity in claim 1 of Linearity and Monotonicity of the Lebesgue Integral, and Step 3 (read with μn\mu_{n} and μ\mu in place of μ\mu and ν\nu), δn≤(dM)2I(πn)\delta_{n}\le(dM)^{2}I(\pi_{n}). Let ε∈R\varepsilon\in\mathbb{R} be positive and put C2=(dM)2+1C_{2}=(dM)^{2}+1, positive as in Step 5. By Limit of a Sequence of Real Numbers choose NN with ∣I(πn)−0∣<ε C2−1|I(\pi_{n})-0|<\varepsilon\,C_{2}^{-1} for n≥Nn\ge N; as I(πn)≥0I(\pi_{n})\ge0 this says I(πn)<ε C2−1I(\pi_{n})<\varepsilon\,C_{2}^{-1}. For n≥Nn\ge N, by claim 5 of Elementary Arithmetic in an Ordered Field and claims 10 and 2 of Elementary Order Arithmetic in an Ordered Field,

∣δn−0∣=δn≤(dM)2I(πn)≤C2 I(πn)<C2 ε C2−1=ε.|\delta_{n}-0|=\delta_{n}\le(dM)^{2}I(\pi_{n})\le C_{2}\,I(\pi_{n})<C_{2}\,\varepsilon\,C_{2}^{-1}=\varepsilon .

So (δn)n(\delta_{n})_{n} converges to 00, which is property (c).

Step 7. The translated functional. For b∈Rdb\in\mathbb{R}^{d} the translation τb(x)=x+b\tau_{b}(x)=x+b of The Wasserstein Space and Its Lift to Square-Integrable Random Vectors: Standing Notation §constants is Borel: its llth component x↦xl+blx\mapsto x_{l}+b_{l} is the sum of a coordinate projection, Borel by claim 1 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets, and a constant, so it is Borel by claims 1 and 2 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions, and claim 2 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets applies. Consequently g∘τbg\circ\tau_{b} is Borel for every Borel g:Rd→Rg:\mathbb{R}^{d}\to\mathbb{R} (Probability Measures on Euclidean Space and Random Vectors: Standing Notation §borel-maps). Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) and a∈Rda\in\mathbb{R}^{d}. Then (τa)#μ∈P2(Rd)(\tau_{a})_{\#}\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) by Gradients of Functions with Bounded Derivatives Belong to the Tangent Space; Constants Are Tangent; the Score Identity; the Score Has Mean Zero; Translation of Tangent Fields §translation, so ff is integrable with respect to it by Step 2, and by the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pushforward the function f∘τaf\circ\tau_{a} is μ\mu-integrable and

ϕμ(a)=φ((τa)#μ)=∫Rdf(x+a) μ(dx).(P)\phi_{\mu}(a)=\varphi\bigl((\tau_{a})_{\#}\mu\bigr)=\int_{\mathbb{R}^{d}}f(x+a)\,\mu(dx). \tag{P}

Step 8. Partial derivatives of averaged translates. Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), let g:Rd→Rg:\mathbb{R}^{d}\to\mathbb{R} be of class C1C^{1} on Rd\mathbb{R}^{d}, let KK and LL be nonnegative real numbers with ∣∂kg(x)∣≤K+L∥x∥|\partial_{k}g(x)|\le K+L\lVert x\rVert for all x∈Rdx\in\mathbb{R}^{d} and k∈[d]k\in[d], and suppose that g∘τbg\circ\tau_{b} is μ\mu-integrable for every b∈Rdb\in\mathbb{R}^{d}. Put ψ(a)=∫Rdg(x+a) μ(dx)\psi(a)=\int_{\mathbb{R}^{d}}g(x+a)\,\mu(dx). We show: for every a∈Rda\in\mathbb{R}^{d} and i∈[d]i\in[d], the function x↦∂ig(x+a)x\mapsto\partial_{i}g(x+a) is μ\mu-integrable, and ∂iψ(a)\partial_{i}\psi(a) exists and equals ∫Rd∂ig(x+a) μ(dx)\int_{\mathbb{R}^{d}}\partial_{i}g(x+a)\,\mu(dx). Fix aa and ii, let eie_{i} be the standard basis vector of Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §basis, and let J=(−1,1)J=(-1,1), an open interval all of whose points are interior points by An Open Interval is an Interval All of Whose Points Are Interior. Apply Differentiation under the Integral Sign with the measure space (Rd,B(Rd),μ)(\mathbb{R}^{d},\mathcal{B}(\mathbb{R}^{d}),\mu), the interval JJ and F(t,x)=g((x+a)+tei)F(t,x)=g\bigl((x+a)+te_{i}\bigr), where (x+a)+tei=x+(a+tei)(x+a)+te_{i}=x+(a+te_{i}) by the componentwise definitions Sum of Points of Rn\mathbb{R}^n and Scalar Multiple of a Point of Rn\mathbb{R}^n. Condition (i) holds by hypothesis with b=a+teib=a+te_{i}. For condition (ii), fix xx: by claim 2 of Derivatives Along a Segment for C^1 Functions on a Euclidean Open Set, read with n=dn=d, W=RdW=\mathbb{R}^{d}, the point x+ax+a, the vector h=eih=e_{i} and the interval JJ (the point written x+τhx+\tau h there being the vector (x+a)+τei(x+a)+\tau e_{i}, by the same componentwise definitions), the function t↦F(t,x)t\mapsto F(t,x) is differentiable at every point tt of JJ with derivative ∑k=1d∂kg(x+a+tei) (ei)k\sum_{k=1}^{d}\partial_{k}g(x+a+te_{i})\,(e_{i})_{k}, which equals ∂ig(x+a+tei)\partial_{i}g(x+a+te_{i}) by claim 7 of Properties of Finite Sums, since (ei)k=0(e_{i})_{k}=0 for k≠ik\ne i and (ei)i=1(e_{i})_{i}=1. So D1F(t,x)=∂ig(x+a+tei)D_{1}F(t,x)=\partial_{i}g(x+a+te_{i}). For condition (iii), let t∈Jt\in J, so that −1<t<1-1<t<1 and hence ∣t∣<1|t|<1 by Properties of the Absolute Value in an Ordered Field §strict-two-sided. By Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §triangle (twice), Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §homogeneity and ∥ei∥=1\lVert e_{i}\rVert=1 (Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §basis), ∥x+a+tei∥≤∥x∥+∥a∥+∣t∣≤∥x∥+∥a∥+1\lVert x+a+te_{i}\rVert\le\lVert x\rVert+\lVert a\rVert+|t|\le\lVert x\rVert+\lVert a\rVert+1. So, with Ka=K+L(∥a∥+2)K_{a}=K+L(\lVert a\rVert+2), a nonnegative real number, and using ∥x∥≤1+∥x∥2\lVert x\rVert\le1+\lVert x\rVert^{2} and 1≤1+∥x∥21\le1+\lVert x\rVert^{2} (Step 1, proof of (G)) together with claims 2, 3 and 5 of Elementary Arithmetic in an Ordered Field,

∣D1F(t,x)∣≤K+L(∥x∥+∥a∥+1)≤Ka(1+∥x∥2)(t∈J, x∈Rd).|D_{1}F(t,x)|\le K+L\bigl(\lVert x\rVert+\lVert a\rVert+1\bigr)\le K_{a}\bigl(1+\lVert x\rVert^{2}\bigr)\qquad(t\in J,\ x\in\mathbb{R}^{d}).

The function x↦Ka(1+∥x∥2)x\mapsto K_{a}(1+\lVert x\rVert^{2}) is nonnegative and Borel (claims 1 and 2 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions and Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pairs), and it is μ\mu-integrable by (Q) of Step 2, read with ρ=μ\rho=\mu and K=KaK=K_{a}. The theorem gives that x↦∂ig(x+a+tei)x\mapsto\partial_{i}g(x+a+te_{i}) is integrable for every t∈Jt\in J, in particular (with t=0t=0) that x↦∂ig(x+a)x\mapsto\partial_{i}g(x+a) is, and that t↦ψ(a+tei)t\mapsto\psi(a+te_{i}) is differentiable at 00 with derivative Λ=∫∂ig(x+a) μ(dx)\Lambda=\int\partial_{i}g(x+a)\,\mu(dx). By Derivative at an Interior Point, for every positive ε\varepsilon there is a positive δ\delta such that every real hh with 0<∣h∣<δ0<|h|<\delta and h∈Jh\in J satisfies ∣h−1(ψ(a+hei)−ψ(a))−Λ∣<ε\bigl|h^{-1}(\psi(a+he_{i})-\psi(a))-\Lambda\bigr|<\varepsilon. Replacing δ\delta by the lesser of δ\delta and 11 (claim 9 of Elementary Order Arithmetic in an Ordered Field), the requirement h∈Jh\in J follows from ∣h∣<1|h|<1 by claim 9 of Properties of the Absolute Value in an Ordered Field. The point a+heia+he_{i} has iith component ai+ha_{i}+h and kkth component aka_{k} for k≠ik\ne i (Sum of Points of Rn\mathbb{R}^n, Scalar Multiple of a Point of Rn\mathbb{R}^n and Euclidean Points as Tuples of Real Numbers), so this is exactly the condition of Partial Derivative on a Euclidean Open Set, with U=RdU=\mathbb{R}^{d}, that ∂iψ(a)\partial_{i}\psi(a) exists with value Λ\Lambda.

Step 9. Continuity of averaged translates. Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}), let g:Rd→Rg:\mathbb{R}^{d}\to\mathbb{R} be continuous at every point in the Euclidean sense, and let KK be a nonnegative real number with ∣g(x)∣≤K(1+∥x∥2)|g(x)|\le K(1+\lVert x\rVert^{2}) for every xx. Then gg is Borel (as in Step 1). For a∈Rda\in\mathbb{R}^{d} put ρa=(τa)#μ\rho_{a}=(\tau_{a})_{\#}\mu, which lies in P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}) (Step 7); by (Q) of Step 2, read with ρ=ρa\rho=\rho_{a} and h=gh=g, the function gg is ρa\rho_{a}-integrable, so by the change-of-variables formula of Probability Measures on Euclidean Space and Random Vectors: Standing Notation §pushforward the Borel function g∘τag\circ\tau_{a} (Step 7) is μ\mu-integrable and

ψ(a)=∫Rdg(x+a) μ(dx)=∫Rdg dρa\psi(a)=\int_{\mathbb{R}^{d}}g(x+a)\,\mu(dx)=\int_{\mathbb{R}^{d}}g\,d\rho_{a}

is defined for every aa. We show that ψ\psi is continuous at every b∈Rdb\in\mathbb{R}^{d} in the Euclidean sense. First, W2(ρa,ρb)=∥a−b∥W_{2}(\rho_{a},\rho_{b})=\lVert a-b\rVert for all a,b∈Rda,b\in\mathbb{R}^{d}: by The Squared Wasserstein Distance to a Fixed Measure: a One-Sided Bound Along Couplings, Differentiability at a Uniquely Mapped Source, and the Translation and Centring Identities §translation, read with ν=μ\nu=\mu,

W2(ρa,ρb)2=W2(μ,μ)2+2 (a−b)⋅(m(μ)−m(μ))+∥a−b∥2=∥a−b∥2,W_{2}(\rho_{a},\rho_{b})^{2}=W_{2}(\mu,\mu)^{2}+2\,(a-b)\cdot\bigl(m(\mu)-m(\mu)\bigr)+\lVert a-b\rVert^{2}=\lVert a-b\rVert^{2},

because W2(μ,μ)=0W_{2}(\mu,\mu)=0 by The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §separation and (a−b)⋅(m(μ)−m(μ))=(a−b)⋅m(μ)−(a−b)⋅m(μ)=0(a-b)\cdot(m(\mu)-m(\mu))=(a-b)\cdot m(\mu)-(a-b)\cdot m(\mu)=0 by claim 5 of the bilinearity lemma; as W2(ρa,ρb)W_{2}(\rho_{a},\rho_{b}) and ∥a−b∥\lVert a-b\rVert are nonnegative (The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §metric and Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §square), claim 3 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field gives the assertion. By claim 1 of Euclidean Continuity Agrees with Metric Continuity for Real-Valued Functions and Continuity Between Metric Spaces is Equivalent to Sequential Continuity §criterion, read with X=A=RdX=A=\mathbb{R}^{d}, the metric dEd_{E} and Y=RY=\mathbb{R} with dRd_{\mathbb{R}}, it suffices to show that ψ(am)→ψ(b)\psi(a_{m})\to\psi(b) whenever (am)m∈N(a_{m})_{m\in\mathbb{N}} converges to bb in (Rd,dE)(\mathbb{R}^{d},d_{E}). Given such a sequence and a positive ε\varepsilon, Convergent Sequence in a Metric Space provides NN with dE(am,b)<εd_{E}(a_{m},b)<\varepsilon for m≥Nm\ge N; since dE(am,b)=∥am−b∥=W2(ρam,ρb)d_{E}(a_{m},b)=\lVert a_{m}-b\rVert=W_{2}(\rho_{a_{m}},\rho_{b}) (Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n §distance) and this number is nonnegative, it equals ∣W2(ρam,ρb)−0∣|W_{2}(\rho_{a_{m}},\rho_{b})-0| by Absolute Value in an Ordered Field, so lim⁡m→∞W2(ρam,ρb)=0\lim_{m\to\infty}W_{2}(\rho_{a_{m}},\rho_{b})=0 in the sense of Limit of a Sequence of Real Numbers. The function gg is continuous for dEd_{E} and dRd_{\mathbb{R}} by claim 1 of Euclidean Continuity Agrees with Metric Continuity for Real-Valued Functions, so Convergence in the Wasserstein Distance Implies Weak Convergence and Convergence of Integrals of Continuous Functions of Quadratic Growth §quadratic, read with m=dm=d, h=gh=g, A=KA=K, the measure ρb\rho_{b} and the sequence (ρam)m(\rho_{a_{m}})_{m}, gives lim⁡m→∞ψ(am)=ψ(b)\lim_{m\to\infty}\psi(a_{m})=\psi(b); by The Absolute Value Metric on the Real Line this is convergence in (R,dR)(\mathbb{R},d_{\mathbb{R}}), as required.

Step 10. Property (d) and the Hessian at the origin. Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). By Step 7, f∘τbf\circ\tau_{b} is μ\mu-integrable for every bb, and ϕμ\phi_{\mu} is given by (P). Step 8, read with g=fg=f, K=∥Df(0Rd)∥K=\lVert Df(0_{\mathbb{R}^{d}})\rVert and L=d ML=\sqrt{d}\,M (the bound on ∂kf\partial_{k}f being (G3)), shows that for all a∈Rda\in\mathbb{R}^{d} and i∈[d]i\in[d] the partial derivative ∂iϕμ(a)\partial_{i}\phi_{\mu}(a) exists and equals ψi(a)=∫∂if(x+a) μ(dx)\psi_{i}(a)=\int\partial_{i}f(x+a)\,\mu(dx). Fix ii. The function ∂if\partial_{i}f is of class C1C^{1} with partial derivatives ∂j∂if\partial_{j}\partial_{i}f bounded by MM (Step 1), and it is continuous at every point (Step 1) with ∣∂if(x)∣≤B(1+∥x∥2)|\partial_{i}f(x)|\le B(1+\lVert x\rVert^{2}) by (G), so each (∂if)∘τb(\partial_{i}f)\circ\tau_{b} is μ\mu-integrable by Step 9, read with g=∂ifg=\partial_{i}f and K=BK=B; so Step 8, read with g=∂ifg=\partial_{i}f, K=MK=M and L=0L=0, shows that for all aa and j∈[d]j\in[d] the partial derivative ∂jψi(a)\partial_{j}\psi_{i}(a) exists and equals ψij(a)=∫∂j∂if(x+a) μ(dx)\psi_{ij}(a)=\int\partial_{j}\partial_{i}f(x+a)\,\mu(dx). Step 9, read with g=fg=f and K=AK=A (by (G); here ψ=ϕμ\psi=\phi_{\mu} by (P)), with g=∂ifg=\partial_{i}f and K=BK=B (by (G)), and with g=∂j∂ifg=\partial_{j}\partial_{i}f and K=MK=M (continuous at every point by Step 1, and ∣∂j∂if(x)∣≤M≤M(1+∥x∥2)|\partial_{j}\partial_{i}f(x)|\le M\le M(1+\lVert x\rVert^{2}) by the hypothesis, 1≤1+∥x∥21\le1+\lVert x\rVert^{2} and claim 5 of Elementary Arithmetic in an Ordered Field), shows that ϕμ\phi_{\mu}, ψi\psi_{i} and ψij\psi_{ij} are continuous at every point. By clause 1 of C^k Maps on a Euclidean Open Set (read through clause 3), ϕμ\phi_{\mu} is of class C1C^{1}, its partial derivatives ∂iϕμ=ψi\partial_{i}\phi_{\mu}=\psi_{i} existing everywhere and being continuous, and each ψi\psi_{i} is of class C1C^{1}, its partial derivatives ψij\psi_{ij} existing everywhere and being continuous; by clause 2 there with k=1k=1, ϕμ\phi_{\mu} is of class C2C^{2} on Rd\mathbb{R}^{d}. This is property (d). In the notation of clause 4 there, ∂j∂iϕμ=ψij\partial_{j}\partial_{i}\phi_{\mu}=\psi_{ij}; so by Hessian Matrix of a C^2 Function the entry of D2ϕμ(0Rd)D^{2}\phi_{\mu}(0_{\mathbb{R}^{d}}) in row ii and column jj is ∂i∂jϕμ(0Rd)=ψji(0Rd)=∫∂i∂jf dμ\partial_{i}\partial_{j}\phi_{\mu}(0_{\mathbb{R}^{d}})=\psi_{ji}(0_{\mathbb{R}^{d}})=\int\partial_{i}\partial_{j}f\,d\mu, as x+0Rd=xx+0_{\mathbb{R}^{d}}=x (Sum of Points of Rn\mathbb{R}^n). This is the corresponding entry of Φ(μ)\Phi(\mu), so, matrices with the same entries being equal (Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §matrices),

D2ϕμ(0Rd)=Φ(μ)=∫RdD2f dμfor every μ∈P2(Rd).(H)D^{2}\phi_{\mu}(0_{\mathbb{R}^{d}})=\Phi(\mu)=\int_{\mathbb{R}^{d}}D^{2}f\,d\mu\qquad\text{for every }\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). \tag{H}

Step 11. Finite sums of null sequences. Let (cnk)n∈N(c^{k}_{n})_{n\in\mathbb{N}}, for k∈[d]k\in[d], be sequences of real numbers each converging to 00. We show that (∑k=1dcnk)n∈N\bigl(\sum_{k=1}^{d}c^{k}_{n}\bigr)_{n\in\mathbb{N}} converges to 00. Let A\mathcal{A} be the set of natural numbers mm such that either m∉[d]m\notin[d] or the sequence (∑k=1mcnk)n\bigl(\sum_{k=1}^{m}c^{k}_{n}\bigr)_{n} converges to 00. Then 1∈A1\in\mathcal{A}, since ∑k=11cnk=cn1\sum_{k=1}^{1}c^{k}_{n}=c^{1}_{n} by claim 1 of Properties of Finite Sums. Let m∈Am\in\mathcal{A} and suppose S(m)∈[d]S(m)\in[d]. Since m<S(m)m<S(m) and S(m)≤dS(m)\le d, claims 1, 4 and 5 of Properties of the Order on the Natural Numbers give m∈[d]m\in[d], so (∑k=1mcnk)n\bigl(\sum_{k=1}^{m}c^{k}_{n}\bigr)_{n} converges to 00; by the recursion in claim 1 of Properties of Finite Sums, ∑k=1S(m)cnk=∑k=1mcnk+cnS(m)\sum_{k=1}^{S(m)}c^{k}_{n}=\sum_{k=1}^{m}c^{k}_{n}+c^{S(m)}_{n}, which converges to 0+0=00+0=0 by claim 1 of Arithmetic of Limits of Real Sequences. So S(m)∈AS(m)\in\mathcal{A}, and A=N\mathcal{A}=\mathbb{N} by Principle of Induction for the Natural Numbers. Since d∈[d]d\in[d] (claim 1 of Properties of the Order on the Natural Numbers), the case m=dm=d is the assertion.

Step 12. Property (e). Let μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}). By (H), the map ρ↦D2ϕρ(0Rd)\rho\mapsto D^{2}\phi_{\rho}(0_{\mathbb{R}^{d}}) from P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}) to S(d)\mathcal{S}(d) is Φ\Phi. We show that Φ\Phi is continuous at μ\mu relative to P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}), for the metric W2W_{2} and the metric dS(d)d_{\mathcal{S}(d)} of Wasserstein Spaces, Random Vectors, Vector Fields and Symmetric Matrices in Every Dimension: Standing Notation §matrices. By Continuity Between Metric Spaces is Equivalent to Sequential Continuity §criterion, read with X=A=P2(Rd)X=A=\mathcal{P}_{2}(\mathbb{R}^{d}) and Y=S(d)Y=\mathcal{S}(d), it suffices to let (μn)n∈N(\mu_{n})_{n\in\mathbb{N}} converge to μ\mu in (P2(Rd),W2)(\mathcal{P}_{2}(\mathbb{R}^{d}),W_{2}) and to show that (Φ(μn))n(\Phi(\mu_{n}))_{n} converges to Φ(μ)\Phi(\mu) in (S(d),dS(d))(\mathcal{S}(d),d_{\mathcal{S}(d)}). As in Step 4, lim⁡n→∞W2(μn,μ)=0\lim_{n\to\infty}W_{2}(\mu_{n},\mu)=0. For i,j∈[d]i,j\in[d] the function hij=∂i∂jfh_{ij}=\partial_{i}\partial_{j}f is continuous (Step 1) and ∣hij(x)∣≤M≤M(1+∥x∥2)|h_{ij}(x)|\le M\le M(1+\lVert x\rVert^{2}) for every xx, by the hypothesis, 1≤1+∥x∥21\le1+\lVert x\rVert^{2} (Step 1, proof of (G)) and claim 5 of Elementary Arithmetic in an Ordered Field. So Convergence in the Wasserstein Distance Implies Weak Convergence and Convergence of Integrals of Continuous Functions of Quadratic Growth §quadratic, read with m=dm=d and h=hijh=h_{ij}, gives that cnij=∫hij dμn−∫hij dμc^{ij}_{n}=\int h_{ij}\,d\mu_{n}-\int h_{ij}\,d\mu satisfies ∣cnij−0∣<ε|c^{ij}_{n}-0|<\varepsilon for nn large, for every positive ε\varepsilon; as ∣∣cnij∣−0∣=∣cnij∣\bigl||c^{ij}_{n}|-0\bigr|=|c^{ij}_{n}| by claim 1 of Properties of the Absolute Value in an Ordered Field, the sequence (∣cnij∣)n(|c^{ij}_{n}|)_{n} converges to 00 (Limit of a Sequence of Real Numbers). By Step 11 applied, for each i∈[d]i\in[d], to the sequences (∣cnij∣)n(|c^{ij}_{n}|)_{n} indexed by j∈[d]j\in[d], the sequence tni=∑j=1d∣cnij∣t^{i}_{n}=\sum_{j=1}^{d}|c^{ij}_{n}| converges to 00, and by Step 11 applied to the sequences (tni)n(t^{i}_{n})_{n} indexed by i∈[d]i\in[d], the sequence sn=∑i=1dtnis_{n}=\sum_{i=1}^{d}t^{i}_{n} converges to 00. The matrix En=Φ(μn)−Φ(μ)E_{n}=\Phi(\mu_{n})-\Phi(\mu) lies in S(d)\mathcal{S}(d) by Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §symmetric and has entries cnijc^{ij}_{n} by Difference of Real Matrices, so Vector, Entry and Comparison Bounds for the Norm of a Symmetric Real Matrix §entry-sum gives ∥En∥≤sn\lVert E_{n}\rVert\le s_{n}. Let ε\varepsilon be positive and choose NN with ∣sn−0∣<ε|s_{n}-0|<\varepsilon for n≥Nn\ge N; for such nn, by claim 3 of Properties of the Absolute Value in an Ordered Field and claim 2 of Elementary Order Arithmetic in an Ordered Field,

dS(d)(Φ(μn),Φ(μ))=∥En∥≤sn≤∣sn∣<ε.d_{\mathcal{S}(d)}\bigl(\Phi(\mu_{n}),\Phi(\mu)\bigr)=\lVert E_{n}\rVert\le s_{n}\le|s_{n}|<\varepsilon .

So (Φ(μn))n(\Phi(\mu_{n}))_{n} converges to Φ(μ)\Phi(\mu) (Convergent Sequence in a Metric Space), and Φ\Phi is continuous at μ\mu. Now let ε\varepsilon be positive; by Continuous Map Between Metric Spaces there is a positive θ\theta such that every ν∈P2(Rd)\nu\in\mathcal{P}_{2}(\mathbb{R}^{d}) with W2(μ,ν)<θW_{2}(\mu,\nu)<\theta satisfies dS(d)(Φ(ν),Φ(μ))<εd_{\mathcal{S}(d)}(\Phi(\nu),\Phi(\mu))<\varepsilon. Since W2(ν,μ)=W2(μ,ν)W_{2}(\nu,\mu)=W_{2}(\mu,\nu) by The Quadratic Wasserstein Distance is a Metric on the Wasserstein Space §symmetry, and Φ(ν)=D2ϕν(0Rd)\Phi(\nu)=D^{2}\phi_{\nu}(0_{\mathbb{R}^{d}}), Φ(μ)=D2ϕμ(0Rd)\Phi(\mu)=D^{2}\phi_{\mu}(0_{\mathbb{R}^{d}}) by (H), this θ\theta is as required in property (e).

Step 13. Conclusion. By Steps 4, 5, 6, 10 and 12, φ\varphi has properties (a) to (e) of Intrinsic Test Functions on the Wasserstein Space and Their Translation Hessians §test with Q=P2(Rd)Q=\mathcal{P}_{2}(\mathbb{R}^{d}), so it is an intrinsic test function on P2(Rd)\mathcal{P}_{2}(\mathbb{R}^{d}). For μ∈P2(Rd)\mu\in\mathcal{P}_{2}(\mathbb{R}^{d}) its gradient along couplings is ∇φ(μ)=Df\nabla\varphi(\mu)=Df by Step 5, and by Intrinsic Test Functions on the Wasserstein Space and Their Translation Hessians §hessian and (H) its translation Hessian is Hφ(μ)=D2ϕμ(0Rd)=∫RdD2f dμH_{\varphi}(\mu)=D^{2}\phi_{\mu}(0_{\mathbb{R}^{d}})=\int_{\mathbb{R}^{d}}D^{2}f\,d\mu. This proves claim 2. Claim 1 was proved in Step 2 (with the bounds (G1) and (G2) of Step 1) and claim 3 in Step 2a. ■\blacksquare

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…