Preliminaries. We call The Gaussian Smoothing Weight: Normalization, Derivatives, Exponential Tilting, Moments, and First-Order Remainder the weight lemma and Weighted Cauchy-Schwarz Inequality on a Measure Space and the Symmetrised Score Functional: Bounds and Averaging the averaging lemma. Integrals of nonnegative functions are handled with claim 1 of Linearity and Monotonicity of the Lebesgue Integral (linearity, monotonicity), integrable functions with claim 2 there and Integrable Function and the Lebesgue Integral; the monotone convergence theorem (MCT) and the dominated convergence theorem (DCT) are used on the measure spaces (S,2S,c), (Rd,B(Rd),λd), (R,R,ρ) and the product (Rd×R,B(Rd)⊗R,λd⊗ρ); on the last, Tonelli and Fubini Theorems (Tonelli) applies, both factors being σ-finite. Sums, products, absolute values and pointwise limits of measurable real functions are measurable by Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions. Write d(⋅,⋅) for the Euclidean distance; d(θ−x,θ′−x)=d(θ,θ′) for all θ,θ′,x, so translates of sequentially continuous functions are sequentially continuous, and sequentially continuous functions on Rd are measurable by claim 3(a) of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets.
(P1) Countable sums. Since S is countable, there is a sequence (xk)k∈N in S whose set of values is S (a constant sequence if S is a single point; otherwise enumerate, repeating values if S is finite); put Fk={x1,…,xk}, a nondecreasing sequence of finite sets with union S, so that every finite subset of S is contained in some Fk. For h:S→[0,∞] the finite partial sums ∑x∈Fkh(x)=∫h1Fkdc are nondecreasing in k and cofinal among all finite partial sums, hence ∑x∈Sh(x)=supk∑x∈Fkh(x); for c-integrable real h, DCT with the dominating function ∣h∣ gives ∫hdc=limk∑x∈Fkh(x). Consequently a function on R (or on Rd×R) of the form r↦∑x∈Sh(x,r) with each h(x,⋅) measurable and nonnegative (resp. with h(⋅,r) c-integrable for every r) is measurable, as a supremum (measurable by the MCT, which asserts measurability of the supremum) resp. a pointwise limit (claim 5 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions) of the measurable finite sums ∑x∈Fkh(x,⋅); and for such nonnegative h, MCT on (R,ρ) applied to the finite partial sums gives ∫∑x∈Sh(x,r)ρ(dr)=∑x∈S∫h(x,r)ρ(dr), and likewise on (Rd,λd) and on the product.
(P2) Reindexing along a move. Fix j and let σj:S→S, σj(x)=x+aj, which is injective with image Sj+={y∈S:y−aj∈S}. Let H:S→[0,∞) vanish off Sj+. For a finite F⊆S, reindexing along the bijection σj:F→σj(F) (claim 2 of Properties of a Sum over a Finite Index Set) gives ∑x∈FH(x+aj)=∑y∈σj(F)H(y); conversely, for a finite F′⊆S, dropping the vanishing terms off Sj+ (claims 3 and 4 of Peeling, Splitting, and Interchange for Sums over a Finite Index Set) gives ∑y∈F′H(y)=∑y∈F′∩Sj+H(y)=∑x∈σj−1(F′)H(x+aj). So the two families of finite partial sums coincide, and
x∈S∑H(x+aj)=y∈S∑H(y).(R)
(P3) Translations in θ. For b∈Rd the map Tb(θ,r)=(θ−b,r) is measurable on the product: the preimage of a rectangle A×B (A∈B(Rd), B∈R) is (A+b)×B, with A+b Borel by claim 1 of Translation and Reflection Invariance of Lebesgue Measure on Rn, and such rectangles generate the product σ-algebra. For measurable F≥0 on the product, Tonelli and claim 2 of Translation and Reflection Invariance of Lebesgue Measure on Rn applied to each section give ∫F∘Tbd(λd⊗ρ)=∫Fd(λd⊗ρ), and ∫RdF(θ−b,r)λd(dθ)=∫RdF(θ,r)λd(dθ) for every r. In particular ∫φη(θ−x)λd(dθ)=1 (claim 1 of the weight lemma).
(P4) Cauchy-Schwarz on S. For α:S→R and β:S→[0,∞) with ∑xβ(x)<∞, α=0 where β=0, and ∑xα(x)2/β(x)<∞ (terms with β(x)=0 read as 0), claim 1 of the averaging lemma on (S,c) gives that α is c-integrable and (∑xα(x))2≤(∑xβ(x))(∑xα(x)2/β(x)).
(P5) Sequential continuity implies continuity. Let G:Rd→R be sequentially continuous and θ∈Rd. If G were not continuous at θ, there would be ε>0 such that for every natural k some θk has d(θk,θ)<1/k and ∣G(θk)−G(θ)∣≥ε (using Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field to pass between squared and unsquared inequalities); then d(θk,θ)→0 while G(θk)→G(θ), a contradiction.
(P6) Vanishing off R+. If r∈/R+ then ∑xp(x)f(x,r)=0, so f(x,r)=0 for every x∈S (each p(x)>0); hence every function below of the form ∑xp(x)f(x,r)(⋯) vanishes at such r, in particular g, gj, gˉ, ∂ig, A1 and Bj.
Step 1: claim 1. S is nonempty, since otherwise the sum of p over Rd would be 0 rather than 1. By (K2) and ∑xp(x)=1, fˉ(r)≤∑xp(x)M(r)=M(r)<∞ for every r. For each x, (θ,r)↦p(x)φη(θ−x)f(x,r) is measurable on the product, being the product of the compositions of the measurable maps θ↦φη(θ−x) and r↦f(x,r) with the coordinate projections (whose preimages are rectangles); it is nonnegative and at most cηp(x)f(x,r) (claim 1 of the weight lemma). By (P1), fˉ is R-measurable, g is measurable on the product, and R+={fˉ>0}∈R; monotonicity gives 0≤g≤cηfˉ(r)<∞, so g is finite. For each x and j, the maps r↦p(x)f(x,r) and r↦pj(x)fj(x,r) are R-measurable (the latter is either 0 or p(x−aj)f(x−aj,⋅)), so r↦Φw(p(x)f(x,r),p1(x)f1(x,r),…,pn(x)fn(x,r)) is measurable by claim 2(a) of the averaging lemma and Sequentially Continuous Functions of Measurable Euclidean Maps are Measurable, and Jsym is well defined. For fixed r, MCT on (Rd,λd) applied to the finite partial sums, together with (P3) and linearity, gives ∫g(θ,r)λd(dθ)=supk∑x∈Fkp(x)f(x,r)=fˉ(r). Tonelli and (P1) then give ∫gd(λd⊗ρ)=∫fˉdρ=∑xp(x)∫f(x,r)ρ(dr)=∑xp(x)=1 by (K1) and the definition of a probability mass function (whose sum over Rd equals its sum over S, all other terms vanishing). Positivity: g(θ,r)>0 if and only if some summand is positive, if and only if f(x,r)>0 for some x (as p>0 on S and φη>0), if and only if fˉ(r)>0. For gj=g∘Taj the same statements follow from (P3) (measurability, invariance of the θ-integral) and from gj(θ,r)>0⟺g(θ−aj,r)>0⟺r∈R+; for gˉ, a convex combination of g,g1,…,gn, they follow by linearity, and gˉ>0 exactly where g>0.
Step 2: claim 2. Fix r∈R and i. Differentiation under the sum. Fix θ∈Rd, let I=(θi−1,θi+1), and for t∈I let θ[t] be the point with ith coordinate t and the other coordinates those of θ. Define F:I×S→R by F(t,x)=p(x)f(x,r)φη(θ[t]−x). We verify the hypotheses of Differentiation under the Integral Sign on (S,2S,c): (i) for each t, ∣F(t,⋅)∣≤cηp(⋅)f(⋅,r), which is c-integrable with integral cηfˉ(r)<∞; (ii) for each x and t0∈I, the translate τx(θ′)=φη(θ′−x) has, at θ[t0], exactly the difference quotients of φη at θ[t0]−x in the ith variable, so by claim 2 of the weight lemma and Partial Derivative on a Euclidean Open Set its ith partial derivative at θ[t0] exists and equals ∂iφη(θ[t0]−x); unwinding that definition (the point obtained from θ[t0] by increasing the ith coordinate by h is θ[t0+h], which lies in the domain Rd, and t0+h∈I for ∣h∣ small) says verbatim that t↦τx(θ[t]) is differentiable at t0 with derivative ∂iφη(θ[t0]−x), whence D1F(t0,x)=p(x)f(x,r)∂iφη(θ[t0]−x) by the constant-multiple rule (claim 2 of Sum, Constant Multiple, and Product Rules for One-Dimensional Derivatives); (iii) ∣D1F(t,x)∣≤cη(2η)−1/2p(x)f(x,r) by claim 2 of the weight lemma, a c-integrable bound. Hence t↦∫F(t,x)c(dx)=g(θ[t],r) is differentiable on I with derivative ∑xp(x)f(x,r)∂iφη(θ[t]−x), the summand being c-integrable. This function of t is the slice function of g(⋅,r) at θ in the ith variable with admissible radius 1 (claim 2 of Slice Function and the Partial Derivative, with I the interval so named there and Rd the open set), so ∂ig(θ,r) exists and equals the displayed formula at t=θi. The bound ∣∂ig(θ,r)∣≤cη(2η)−1/2fˉ(r) follows from (iii) and monotonicity.
Continuity. Let θk→θ in Rd. For each x, φη(θk−x)→φη(θ−x) and ∂iφη(θk−x)→∂iφη(θ−x) by sequential continuity (claims 1 and 2 of the weight lemma), with the dominating functions cηp(x)f(x,r) and cη(2η)−1/2p(x)f(x,r); DCT on (S,c) gives g(θk,r)→g(θ,r) and ∂ig(θk,r)→∂ig(θ,r). So g(⋅,r) and ∂ig(⋅,r) are sequentially continuous, hence continuous at every point by (P5). For r∈R+, g(⋅,r)>0 by claim 1, and clauses 1 and 3 of C^k Maps on a Euclidean Open Set make g(⋅,r) of class C1 on Rd.
Measurability and integrability of ∂ig. By (P1) (integrable case), ∂ig is the pointwise limit of the finite sums ∑x∈Fkp(x)∂iφη(θ−x)f(x,r), each measurable on the product as in Step 1, hence measurable. Next, with ei the ith unit vector, claim 2 of the weight lemma gives ∣∂iφη(z)∣=∣Zei(z)∣φη(z) with Zei(z)=zi/η and κei=1/η, so by claim 4 there, ∫Zei2φηdλd=1/η, and (P4)-type Cauchy-Schwarz (claim 1 of the averaging lemma on (Rd,λd) with β=φη) gives ∫∣Zei∣φηdλd≤(∫φη)1/2(∫Zei2φη)1/2=η−1/2; moreover ∣zk∣∣∂iφη(z)∣=η∣Zek(z)Zei(z)∣φη(z)≤2η(Zek2+Zei2)φη(z), whose integral is at most 1. Since ∣(θ−x)k+xk∣≤∣(θ−x)k∣+∣xk∣ and ∣xk∣≤∥x∥, (P3) yields for every x
∫(1+k=1∑d∣θk∣)∣∂iφη(θ−x)∣λd(dθ)=∫(1+k=1∑d∣zk+xk∣)∣∂iφη(z)∣λd(dz)≤η−1/2+d+dη−1/2∥x∥=:C1+C2∥x∥.
By monotonicity, ∣∂ig(θ,r)∣≤∑xp(x)f(x,r)∣∂iφη(θ−x)∣, so by Tonelli, (P1) and (K1),
∫(1+k∑∣θk∣)∣∂ig∣d(λd⊗ρ)≤x∑p(x)∫f(x,r)ρ(dr)(C1+C2∥x∥)=C1+C2x∑p(x)∥x∥<∞
by the first-moment condition. Finally, let h(v)=1/v for v>0 and h(0)=0; as in the proof of claim 1 of the averaging lemma, h∘g is measurable (a pointwise limit of g/(g2+1/k)), so 1Rd×R+(∂ig)2/g=(∂ig)2(h∘g) is measurable, the two sides agreeing also off Rd×R+ by (P6) and claim 1. For r∈R+ and any θ, apply (P4) with α(x)=p(x)f(x,r)∂iφη(θ−x) and β(x)=p(x)f(x,r)φη(θ−x) (so ∑xβ=g(θ,r)>0, α=0 where β=0, and α2/β=p(x)f(x,r)Zei(θ−x)2φη(θ−x) where β>0):
g(θ,r)∂ig(θ,r)2≤x∑p(x)f(x,r)Zei(θ−x)2φη(θ−x),
provided the right side is finite, and trivially otherwise. Integrating with Tonelli, (P1), (P3) and (K1), ∫1Rd×R+(∂ig)2/gd(λd⊗ρ)≤∑xp(x)⋅1⋅∫Zei2φηdλd=1/η.
Step 3: claim 3. Decomposition. By linearity of the c-integral, ∂ug(θ,r)=∑xp(x)f(x,r)∑i=1dui∂iφη(θ−x), and since u=∑jwjaj, the definition of Raj in claim 5 of the weight lemma gives ∑iui∂iφη(z)=∑jwj(Raj(z)+φη(z)−φη(z−aj)). Each Raj is bounded (by 2cη+cη(2η)−1/2∑i∣(aj)i∣), so all the resulting summands are c-integrable, and
∂ug=A1+j=1∑nwjBj,A1(θ,r)=j=1∑nwj(g(θ,r)−gj(θ,r)),Bj(θ,r)=x∑p(x)f(x,r)Raj(θ−x),
because ∑xp(x)f(x,r)φη(θ−x−aj)=g(θ−aj,r)=gj(θ,r) by definition. A1 is measurable by Step 1, and Bj by (P1) (Raj is sequentially continuous, hence measurable, by claim 5 of the weight lemma).
Reindexing gj. Fix (θ,r) and j, and put H(y)=φη(θ−y)pj(y)fj(y,r) for y∈S; H vanishes off Sj+ (there pj(y)=p(y−aj)=0), and for x∈S, H(x+aj)=φη(θ−x−aj)p(x)f(x,r) since (x+aj)−aj=x∈S. By (R),
gj(θ,r)=x∈S∑H(x+aj)=y∈S∑φη(θ−y)pj(y)fj(y,r).
The main term. Fix r∈R+ and θ. On (S,c) put ℓ0(y)=φη(θ−y)p(y)f(y,r) and ℓj(y)=φη(θ−y)pj(y)fj(y,r), nonnegative with finite integrals ∫ℓ0dc=g(θ,r) and ∫ℓjdc=gj(θ,r) (by the reindexing). Since gˉ(θ,r)=D(g,g1,…,gn)(θ,r)>0 and A1=Nw(g,g1,…,gn) in the notation of the averaging lemma, claim 3 there followed by claim 2(c) (homogeneity, with the factor φη(θ−y)>0) gives
gˉ(θ,r)A1(θ,r)2=Φw(g,g1,…,gn)(θ,r)≤y∈S∑φη(θ−y)Φw(p(y)f(y,r),p1(y)f1(y,r),…,pn(y)fn(y,r)).
For each y, r↦Φw(p(y)f(y,r),…) is R-measurable by claim 3 of the averaging lemma (its arguments are measurable in r), so the right side is a measurable nonnegative function on the product by (P1). Integrating over θ first, with (P3) and ∫φη(θ−y)λd(dθ)=1, then over r, using Tonelli and (P1),
∫1Rd×R+gˉA12d(λd⊗ρ)≤y∈S∑∫RΦw(p(y)f(y,r),p1(y)f1(y,r),…,pn(y)fn(y,r))ρ(dr)=Jsym,
where 1Rd×R+A12/gˉ=A12(h∘gˉ) is measurable as in Step 2.
The remainder terms. Fix j, r∈R+ and θ. Since gˉ≥21g>0, Bj2/gˉ≤2Bj2/g. Apply (P4) with α(x)=p(x)f(x,r)Raj(θ−x) and β(x)=p(x)f(x,r)φη(θ−x): Bj(θ,r)2/g(θ,r)≤∑xp(x)f(x,r)Raj(θ−x)2/φη(θ−x) (trivially if the right side is infinite). Integrating with Tonelli, (P1), (P3) and claim 5 of the weight lemma (∫Raj2/φηdλd=exp(κj)−1−κj) and (K1),
∫1Rd×R+gˉBj2d(λd⊗ρ)≤2x∑p(x)(exp(κj)−1−κj)=2(exp(κj)−1−κj).
Conclusion. By claim 3 of Image Measures, Measures with Densities, and Change of Variables, ν(E)=∫1E1Rd×R+gˉd(λd⊗ρ) is a measure on the product σ-algebra with ν(Rd×R)=∫gˉd(λd⊗ρ)=1 (as gˉ vanishes off Rd×R+ by (P6)), so it makes the product a probability space, and ∫F2dν=∫F21Rd×R+gˉd(λd⊗ρ) for measurable F. For a measurable real A on the product put FA=A(h∘gˉ), measurable, equal to A/gˉ on Rd×R+ and to 0 elsewhere; then ∫FA2dν=∫1Rd×R+A2/gˉd(λd⊗ρ). Whenever this is finite, FA is square-integrable under ν with mean-square norm ∥FA∥2 equal to its square root; FA+A′=FA+FA′ and FcA=cFA, so the triangle inequality (claim 2 of Cauchy-Schwarz and Triangle Inequalities for the Mean-Square Norm, extended to finitely many summands by induction) and the homogeneity ∥cF∥2=∣c∣∥F∥2 (immediate from Square-Integrable Random Variables and the Mean-Square Inner Product) apply. If Jsym=∞ the claimed inequality holds trivially. Otherwise FA1 and every FBj are square-integrable by the two bounds above, hence so is F∂ug=FA1+∑jwjFBj, and
(∫1Rd×R+gˉ(∂ug)2d(λd⊗ρ))1/2=∥F∂ug∥2≤∥FA1∥2+j=1∑n∣wj∣∥FBj∥2≤(Jsym)1/2+j=1∑n∣wj∣(2(exp(κj)−1−κj))1/2,
the square root being increasing on [0,∞) (Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field) and (2t)1/2=21/2t1/2 for t≥0 (the right side is nonnegative with square 2t). This is claim 3; the measurability of 1Rd×R+(∂ug)2/gˉ=(∂ug)2(h∘gˉ) was noted above. ■