Let m ≥ 1 m\ge1 m ≥ 1 be a natural number , let R m \mathbb{R}^m R m be Euclidean space with the Euclidean norm ∥ ⋅ ∥ \lVert\cdot\rVert ∥ ⋅ ∥ , the dot product z ⋅ w z\cdot w z ⋅ w , and the Euclidean distance d d d , and let λ m \lambda_m λ m be Lebesgue measure on the Borel σ \sigma σ -algebra B ( R m ) \mathcal{B}(\mathbb{R}^m) B ( R m ) . Let exp \exp exp be the exponential function . A function f : R m → R f:\mathbb{R}^m\to\mathbb{R} f : R m → R is called measurable if it is measurable with respect to B ( R m ) \mathcal{B}(\mathbb{R}^m) B ( R m ) and the Borel σ \sigma σ -algebra of the real line, and sequentially continuous if f ( z k ) → f ( z ) f(z^k)\to f(z) f ( z k ) → f ( z ) whenever ( z k ) k ∈ N (z^k)_{k\in\mathbb{N}} ( z k ) k ∈ N is a sequence in R m \mathbb{R}^m R m and z ∈ R m z\in\mathbb{R}^m z ∈ R m with d ( z k , z ) → 0 d(z^k,z)\to0 d ( z k , z ) → 0 , convergence being that of Limit of a Sequence of Real Numbers , as in claim 3 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets . Integrals of [ 0 , ∞ ] [0,\infty] [ 0 , ∞ ] -valued measurable functions are those of Lebesgue Integral of a Nonnegative Measurable Function , integrable means integrable with respect to λ m \lambda_m λ m , and partial derivatives are taken on the open set U = R m U=\mathbb{R}^m U = R m (open, since it contains every ball about any of its points). Sums and scalar multiples of points of R m \mathbb{R}^m R m are those of Sum of Points of R n \mathbb{R}^n R n and Scalar Multiple of a Point of R n \mathbb{R}^n R n , so that R m \mathbb{R}^m R m is a real vector space with negative − z = 0 − z -z=0-z − z = 0 − z . For a real t ≥ 0 t\ge0 t ≥ 0 , t 1 / 2 = t t^{1/2}=\sqrt{t} t 1/2 = t denotes the nonnegative square root , and t − 1 / 2 = 1 / t 1 / 2 t^{-1/2}=1/t^{1/2} t − 1/2 = 1/ t 1/2 for t > 0 t>0 t > 0 .
Let η \eta η be a real number with 0 < η ≤ 1 0<\eta\le1 0 < η ≤ 1 and define ψ η : R m → R \psi_\eta:\mathbb{R}^m\to\mathbb{R} ψ η : R m → R by
ψ η ( z ) = exp ( − ∥ z ∥ 2 2 η ) . \psi_\eta(z)=\exp\Bigl(-\frac{\lVert z\rVert^{2}}{2\eta}\Bigr). ψ η ( z ) = exp ( − 2 η ∥ z ∥ 2 ) .
1. (Normalization) ψ η \psi_\eta ψ η is sequentially continuous and measurable, 0 < ψ η ( z ) ≤ 1 0<\psi_\eta(z)\le1 0 < ψ η ( z ) ≤ 1 for every z z z , and 0 < ∫ R m ψ η d λ m < ∞ 0<\int_{\mathbb{R}^m}\psi_\eta\,d\lambda_m<\infty 0 < ∫ R m ψ η d λ m < ∞ . Consequently there is exactly one real number c η > 0 c_\eta>0 c η > 0 with ∫ R m c η ψ η d λ m = 1 \int_{\mathbb{R}^m}c_\eta\psi_\eta\,d\lambda_m=1 ∫ R m c η ψ η d λ m = 1 . The Gaussian smoothing weight φ η = c η ψ η \varphi_\eta=c_\eta\psi_\eta φ η = c η ψ η is sequentially continuous and measurable, satisfies 0 < φ η ( z ) ≤ c η 0<\varphi_\eta(z)\le c_\eta 0 < φ η ( z ) ≤ c η and φ η ( − z ) = φ η ( z ) \varphi_\eta(-z)=\varphi_\eta(z) φ η ( − z ) = φ η ( z ) for every z z z , and for every a ∈ R m a\in\mathbb{R}^m a ∈ R m the map z ↦ φ η ( z − a ) z\mapsto\varphi_\eta(z-a) z ↦ φ η ( z − a ) is measurable with
∫ R m φ η ( z − a ) d λ m ( z ) = 1. \int_{\mathbb{R}^m}\varphi_\eta(z-a)\,d\lambda_m(z)=1. ∫ R m φ η ( z − a ) d λ m ( z ) = 1.
2. (Partial derivatives) For every i ∈ { 1 , … , m } i\in\{1,\dots,m\} i ∈ { 1 , … , m } and every z = ( z 1 , … , z m ) ∈ R m z=(z_1,\dots,z_m)\in\mathbb{R}^m z = ( z 1 , … , z m ) ∈ R m the partial derivative of φ η \varphi_\eta φ η with respect to the i i i th variable exists at z z z and
∂ i φ η ( z ) = − z i η φ η ( z ) . \partial_i\varphi_\eta(z)=-\frac{z_i}{\eta}\,\varphi_\eta(z). ∂ i φ η ( z ) = − η z i φ η ( z ) .
The function ∂ i φ η \partial_i\varphi_\eta ∂ i φ η is sequentially continuous and ∣ ∂ i φ η ( z ) ∣ ≤ c η ( 2 η ) − 1 / 2 |\partial_i\varphi_\eta(z)|\le c_\eta\,(2\eta)^{-1/2} ∣ ∂ i φ η ( z ) ∣ ≤ c η ( 2 η ) − 1/2 for every z z z .
3. (Exponential tilting) Let a ∈ R m a\in\mathbb{R}^m a ∈ R m and put Z a ( z ) = a ⋅ z / η Z_a(z)=a\cdot z/\eta Z a ( z ) = a ⋅ z / η for z ∈ R m z\in\mathbb{R}^m z ∈ R m and κ a = ∥ a ∥ 2 / η \kappa_a=\lVert a\rVert^{2}/\eta κ a = ∥ a ∥ 2 / η . Then for every z ∈ R m z\in\mathbb{R}^m z ∈ R m
φ η ( z ) exp ( Z a ( z ) ) = exp ( κ a / 2 ) φ η ( z − a ) , \varphi_\eta(z)\,\exp\bigl(Z_a(z)\bigr)=\exp(\kappa_a/2)\,\varphi_\eta(z-a), φ η ( z ) exp ( Z a ( z ) ) = exp ( κ a /2 ) φ η ( z − a ) ,
the functions φ η exp ( Z a ) \varphi_\eta\exp(Z_a) φ η exp ( Z a ) and z ↦ φ η ( z − a ) 2 / φ η ( z ) z\mapsto\varphi_\eta(z-a)^{2}/\varphi_\eta(z) z ↦ φ η ( z − a ) 2 / φ η ( z ) are measurable, and
∫ R m φ η exp ( Z a ) d λ m = exp ( κ a / 2 ) , ∫ R m φ η ( z − a ) 2 φ η ( z ) d λ m ( z ) = exp ( κ a ) . \int_{\mathbb{R}^m}\varphi_\eta\exp(Z_a)\,d\lambda_m=\exp(\kappa_a/2),\qquad\int_{\mathbb{R}^m}\frac{\varphi_\eta(z-a)^{2}}{\varphi_\eta(z)}\,d\lambda_m(z)=\exp(\kappa_a). ∫ R m φ η exp ( Z a ) d λ m = exp ( κ a /2 ) , ∫ R m φ η ( z ) φ η ( z − a ) 2 d λ m ( z ) = exp ( κ a ) .
4. (Moments) With a a a , Z a Z_a Z a and κ a \kappa_a κ a as in claim 3, the functions Z a φ η Z_a\varphi_\eta Z a φ η , Z a 2 φ η Z_a^{2}\varphi_\eta Z a 2 φ η and Z a exp ( Z a ) φ η Z_a\exp(Z_a)\varphi_\eta Z a exp ( Z a ) φ η are integrable, and
∫ R m Z a φ η d λ m = 0 , ∫ R m Z a 2 φ η d λ m = κ a , ∫ R m Z a exp ( Z a ) φ η d λ m = κ a exp ( κ a / 2 ) . \int_{\mathbb{R}^m}Z_a\varphi_\eta\,d\lambda_m=0,\qquad\int_{\mathbb{R}^m}Z_a^{2}\varphi_\eta\,d\lambda_m=\kappa_a,\qquad\int_{\mathbb{R}^m}Z_a\exp(Z_a)\varphi_\eta\,d\lambda_m=\kappa_a\exp(\kappa_a/2). ∫ R m Z a φ η d λ m = 0 , ∫ R m Z a 2 φ η d λ m = κ a , ∫ R m Z a exp ( Z a ) φ η d λ m = κ a exp ( κ a /2 ) .
5. (First-order remainder) With a = ( a 1 , … , a m ) a=(a_1,\dots,a_m) a = ( a 1 , … , a m ) , Z a Z_a Z a and κ a \kappa_a κ a as in claim 3, define R a : R m → R R_a:\mathbb{R}^m\to\mathbb{R} R a : R m → R by
R a ( z ) = φ η ( z − a ) − φ η ( z ) + ∑ i = 1 m a i ∂ i φ η ( z ) . R_a(z)=\varphi_\eta(z-a)-\varphi_\eta(z)+\sum_{i=1}^{m}a_i\,\partial_i\varphi_\eta(z). R a ( z ) = φ η ( z − a ) − φ η ( z ) + i = 1 ∑ m a i ∂ i φ η ( z ) .
Then R a R_a R a is sequentially continuous, R a ( z ) = φ η ( z ) ( exp ( Z a ( z ) − κ a / 2 ) − 1 − Z a ( z ) ) R_a(z)=\varphi_\eta(z)\bigl(\exp(Z_a(z)-\kappa_a/2)-1-Z_a(z)\bigr) R a ( z ) = φ η ( z ) ( exp ( Z a ( z ) − κ a /2 ) − 1 − Z a ( z ) ) for every z z z , the function R a 2 / φ η R_a^{2}/\varphi_\eta R a 2 / φ η is integrable, and
∫ R m R a ( z ) 2 φ η ( z ) d λ m ( z ) = exp ( κ a ) − 1 − κ a ≤ κ a 2 2 exp ( κ a ) . \int_{\mathbb{R}^m}\frac{R_a(z)^{2}}{\varphi_\eta(z)}\,d\lambda_m(z)=\exp(\kappa_a)-1-\kappa_a\le\frac{\kappa_a^{2}}{2}\exp(\kappa_a). ∫ R m φ η ( z ) R a ( z ) 2 d λ m ( z ) = exp ( κ a ) − 1 − κ a ≤ 2 κ a 2 exp ( κ a ) .