Each result cited is universally quantified over the data in its own statement. Elementary ordered-field arithmetic and order, the properties of the absolute value and of finite sums are used without further comment, as provided by The Real Numbers: Standing Notation and Background §background .
Preliminaries. By The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §pair , D Σ ⊆ D ⊆ P ρ a \mathcal{D}_{\Sigma}\subseteq\mathcal{D}\subseteq\mathcal{P}^{a}_{\rho} D Σ ⊆ D ⊆ P ρ a . For every k ∈ N k\in\mathbb{N} k ∈ N , a k > 0 a_{k}>0 a k > 0 , since a a a is a weight sequence , and c k > 0 c_{k}>0 c k > 0 , since c c c is a variance sequence (A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation §gaussian ). The bound W W W of the Wick couplings satisfies 0 ≤ ∣ w 1 ∣ c 1 ≤ W 0\le|w_{1}|\,c_{1}\le W 0 ≤ ∣ w 1 ∣ c 1 ≤ W by The Wick-Square Corrector and the Score-Paired Wick-Square Cost Relative to a Diagonal Gaussian Measure on a Hilbert Space §couplings , so W ≥ 0 W\ge0 W ≥ 0 . For k ∈ N k\in\mathbb{N} k ∈ N put
s k = β a k c k , t k = 2 θ w k c k β , E k = s k + λ 0 + t k . s_{k}=\frac{\beta a_{k}}{c_{k}},\qquad t_{k}=\frac{2\theta\,w_{k}c_{k}}{\beta},\qquad E_{k}=s_{k}+\lambda_{0}+t_{k}. s k = c k β a k , t k = β 2 θ w k c k , E k = s k + λ 0 + t k .
Then s k > 0 s_{k}>0 s k > 0 , E k ≥ ε 0 > 0 E_{k}\ge\varepsilon_{0}>0 E k ≥ ε 0 > 0 by hypothesis, t k ≤ ∣ t k ∣ = 2 θ ∣ w k ∣ c k / β ≤ 2 θ W / β t_{k}\le|t_{k}|=2\theta|w_{k}|c_{k}/\beta\le2\theta W/\beta t k ≤ ∣ t k ∣ = 2 θ ∣ w k ∣ c k / β ≤ 2 θ W / β , and, dividing c k ≤ κ a k c_{k}\le\kappa a_{k} c k ≤ κ a k by the positive number κ c k \kappa c_{k} κ c k , s k ≥ β / κ s_{k}\ge\beta/\kappa s k ≥ β / κ .
Clause 1. Fix k ∈ N k\in\mathbb{N} k ∈ N . For b ∈ R b\in\mathbb{R} b ∈ R put z ( b ) = 1 + θ c k b / β z(b)=1+\theta c_{k}b/\beta z ( b ) = 1 + θ c k b / β . The map b ↦ z ( b ) b\mapsto z(b) b ↦ z ( b ) is a bijection of R \mathbb{R} R onto itself, with inverse z ↦ β ( z − 1 ) / ( θ c k ) z\mapsto\beta(z-1)/(\theta c_{k}) z ↦ β ( z − 1 ) / ( θ c k ) , and
β c k + θ b = β c k z ( b ) ( b ∈ R ) . (1) \frac{\beta}{c_{k}}+\theta\,b=\frac{\beta}{c_{k}}\,z(b)\qquad(b\in\mathbb{R}).\tag{1} c k β + θ b = c k β z ( b ) ( b ∈ R ) . ( 1 )
Let b ∈ R b\in\mathbb{R} b ∈ R and y = θ c k b / β = z ( b ) − 1 y=\theta c_{k}b/\beta=z(b)-1 y = θ c k b / β = z ( b ) − 1 , so that θ a k b = s k y \theta a_{k}b=s_{k}y θ a k b = s k y . Multiplying the four quantities θ a k 2 b 2 \frac{\theta a_{k}}{2}b^{2} 2 θ a k b 2 , λ 0 2 b \frac{\lambda_{0}}{2}b 2 λ 0 b , β a k c k b \frac{\beta a_{k}}{c_{k}}b c k β a k b and w k w_{k} w k by 2 θ c k / β 2\theta c_{k}/\beta 2 θ c k / β gives s k y 2 s_{k}y^{2} s k y 2 , λ 0 y \lambda_{0}y λ 0 y , 2 θ a k b = 2 s k y 2\theta a_{k}b=2s_{k}y 2 θ a k b = 2 s k y and t k t_{k} t k respectively; since s k ( y 2 + 2 y ) = s k ( z ( b ) 2 − 1 ) s_{k}(y^{2}+2y)=s_{k}(z(b)^{2}-1) s k ( y 2 + 2 y ) = s k ( z ( b ) 2 − 1 ) and λ 0 y = λ 0 z ( b ) − λ 0 \lambda_{0}y=\lambda_{0}z(b)-\lambda_{0} λ 0 y = λ 0 z ( b ) − λ 0 ,
2 θ c k β ( θ a k 2 b 2 + ( λ 0 2 + β a k c k ) b − w k ) = s k z ( b ) 2 + λ 0 z ( b ) − E k . (2) \frac{2\theta c_{k}}{\beta}\Bigl(\frac{\theta a_{k}}{2}\,b^{2}+\Bigl(\frac{\lambda_{0}}{2}+\frac{\beta a_{k}}{c_{k}}\Bigr)b-w_{k}\Bigr)=s_{k}\,z(b)^{2}+\lambda_{0}\,z(b)-E_{k}.\tag{2} β 2 θ c k ( 2 θ a k b 2 + ( 2 λ 0 + c k β a k ) b − w k ) = s k z ( b ) 2 + λ 0 z ( b ) − E k . ( 2 )
As 2 θ c k / β ≠ 0 2\theta c_{k}/\beta\ne0 2 θ c k / β = 0 and β / c k > 0 \beta/c_{k}>0 β / c k > 0 , (1) and (2) show that b b b satisfies the two conditions of clause 1 if and only if z = z ( b ) z=z(b) z = z ( b ) satisfies
s k z 2 + λ 0 z = E k and z > 0. (3) s_{k}z^{2}+\lambda_{0}z=E_{k}\qquad\text{and}\qquad z>0.\tag{3} s k z 2 + λ 0 z = E k and z > 0. ( 3 )
So, the map b ↦ z ( b ) b\mapsto z(b) b ↦ z ( b ) being a bijection, it suffices to show that (3) has exactly one solution z ∈ R z\in\mathbb{R} z ∈ R .
Put Δ k = λ 0 2 + 4 s k E k \Delta_{k}=\lambda_{0}^{2}+4s_{k}E_{k} Δ k = λ 0 2 + 4 s k E k . Since s k E k > 0 s_{k}E_{k}>0 s k E k > 0 , Δ k > λ 0 2 ≥ 0 \Delta_{k}>\lambda_{0}^{2}\ge0 Δ k > λ 0 2 ≥ 0 , so Δ k \Delta_{k} Δ k has a unique nonnegative square root Δ k \sqrt{\Delta_{k}} Δ k ; as 0 ≤ λ 0 0\le\lambda_{0} 0 ≤ λ 0 , 0 ≤ Δ k 0\le\sqrt{\Delta_{k}} 0 ≤ Δ k and λ 0 2 < ( Δ k ) 2 \lambda_{0}^{2}<(\sqrt{\Delta_{k}})^{2} λ 0 2 < ( Δ k ) 2 , the monotonicity of squares of nonnegative numbers gives λ 0 < Δ k \lambda_{0}<\sqrt{\Delta_{k}} λ 0 < Δ k . For every z ∈ R z\in\mathbb{R} z ∈ R ,
( 2 s k z + λ 0 ) 2 = 4 s k ( s k z 2 + λ 0 z ) + λ 0 2 , (2s_{k}z+\lambda_{0})^{2}=4s_{k}\bigl(s_{k}z^{2}+\lambda_{0}z\bigr)+\lambda_{0}^{2}, ( 2 s k z + λ 0 ) 2 = 4 s k ( s k z 2 + λ 0 z ) + λ 0 2 ,
so, 4 s k 4s_{k} 4 s k being nonzero, s k z 2 + λ 0 z = E k s_{k}z^{2}+\lambda_{0}z=E_{k} s k z 2 + λ 0 z = E k holds if and only if ( 2 s k z + λ 0 ) 2 = Δ k (2s_{k}z+\lambda_{0})^{2}=\Delta_{k} ( 2 s k z + λ 0 ) 2 = Δ k . Existence: z k = ( Δ k − λ 0 ) / ( 2 s k ) z_{k}=(\sqrt{\Delta_{k}}-\lambda_{0})/(2s_{k}) z k = ( Δ k − λ 0 ) / ( 2 s k ) is positive and satisfies 2 s k z k + λ 0 = Δ k 2s_{k}z_{k}+\lambda_{0}=\sqrt{\Delta_{k}} 2 s k z k + λ 0 = Δ k , whose square is Δ k \Delta_{k} Δ k ; so z k z_{k} z k solves (3). Uniqueness: if z z z solves (3), then 2 s k z + λ 0 > 0 2s_{k}z+\lambda_{0}>0 2 s k z + λ 0 > 0 and its square is Δ k \Delta_{k} Δ k , so 2 s k z + λ 0 = Δ k 2s_{k}z+\lambda_{0}=\sqrt{\Delta_{k}} 2 s k z + λ 0 = Δ k by the uniqueness of the nonnegative square root, that is z = z k z=z_{k} z = z k . Hence b k = β ( z k − 1 ) / ( θ c k ) b_{k}=\beta(z_{k}-1)/(\theta c_{k}) b k = β ( z k − 1 ) / ( θ c k ) is the unique real number with the two properties of clause 1, and z ( b k ) = z k z(b_{k})=z_{k} z ( b k ) = z k .
The bound. By (3), s k ( z k 2 − 1 ) + λ 0 ( z k − 1 ) = E k − s k − λ 0 = t k s_{k}(z_{k}^{2}-1)+\lambda_{0}(z_{k}-1)=E_{k}-s_{k}-\lambda_{0}=t_{k} s k ( z k 2 − 1 ) + λ 0 ( z k − 1 ) = E k − s k − λ 0 = t k , that is
( z k − 1 ) ( s k ( z k + 1 ) + λ 0 ) = t k . (4) (z_{k}-1)\bigl(s_{k}(z_{k}+1)+\lambda_{0}\bigr)=t_{k}.\tag{4} ( z k − 1 ) ( s k ( z k + 1 ) + λ 0 ) = t k . ( 4 )
Since z k > 0 z_{k}>0 z k > 0 and λ 0 > 0 \lambda_{0}>0 λ 0 > 0 , s k ( z k + 1 ) + λ 0 > s k > 0 s_{k}(z_{k}+1)+\lambda_{0}>s_{k}>0 s k ( z k + 1 ) + λ 0 > s k > 0 , so (4) gives ∣ z k − 1 ∣ = ∣ t k ∣ / ( s k ( z k + 1 ) + λ 0 ) ≤ ∣ t k ∣ / s k |z_{k}-1|=|t_{k}|/(s_{k}(z_{k}+1)+\lambda_{0})\le|t_{k}|/s_{k} ∣ z k − 1∣ = ∣ t k ∣/ ( s k ( z k + 1 ) + λ 0 ) ≤ ∣ t k ∣/ s k . Therefore
∣ b k ∣ = β ∣ z k − 1 ∣ θ c k ≤ β ∣ t k ∣ θ c k s k = 2 ∣ w k ∣ c k β a k . |b_{k}|=\frac{\beta\,|z_{k}-1|}{\theta c_{k}}\le\frac{\beta\,|t_{k}|}{\theta c_{k}s_{k}}=\frac{2|w_{k}|\,c_{k}}{\beta a_{k}} . ∣ b k ∣ = θ c k β ∣ z k − 1∣ ≤ θ c k s k β ∣ t k ∣ = β a k 2∣ w k ∣ c k .
Admissibility. For every k k k , ∣ b k ∣ a k ≤ 2 ∣ w k ∣ c k / β ≤ 2 W / β |b_{k}|\,a_{k}\le2|w_{k}|c_{k}/\beta\le2W/\beta ∣ b k ∣ a k ≤ 2∣ w k ∣ c k / β ≤ 2 W / β , that is
a k ∣ b k ∣ ≤ 2 W β , (5) a_{k}|b_{k}|\le\frac{2W}{\beta},\tag{5} a k ∣ b k ∣ ≤ β 2 W , ( 5 )
and 0 ≤ 2 W / β 0\le2W/\beta 0 ≤ 2 W / β . Moreover 0 ≤ ∣ b k ∣ c k ≤ 2 β ∣ w k ∣ c k 2 / a k 0\le|b_{k}|\,c_{k}\le\frac{2}{\beta}\,|w_{k}|\,c_{k}^{2}/a_{k} 0 ≤ ∣ b k ∣ c k ≤ β 2 ∣ w k ∣ c k 2 / a k ; the series ∑ k ∣ w k ∣ c k 2 / a k \sum_{k}|w_{k}|c_{k}^{2}/a_{k} ∑ k ∣ w k ∣ c k 2 / a k converges by The Wick-Square Corrector and the Score-Paired Wick-Square Cost Relative to a Diagonal Gaussian Measure on a Hilbert Space §couplings , so ∑ k 2 β ∣ w k ∣ c k 2 / a k \sum_{k}\frac{2}{\beta}|w_{k}|c_{k}^{2}/a_{k} ∑ k β 2 ∣ w k ∣ c k 2 / a k converges by Elementary Properties of Series of Real Numbers §linearity , and ∑ k ∣ b k ∣ c k \sum_{k}|b_{k}|c_{k} ∑ k ∣ b k ∣ c k converges by the comparison test Series of Nonnegative Real Numbers, Comparison, and the Geometric Series §comparison . Thus b b b is admissible with bound 2 W / β 2W/\beta 2 W / β .
Clause 2. By Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §scaling , applied with b b b and the real number θ / β \theta/\beta θ / β , the sequence d = ( θ b k / β ) k ∈ N d=(\theta b_{k}/\beta)_{k\in\mathbb{N}} d = ( θ b k / β ) k ∈ N is admissible. By (1) with b = b k b=b_{k} b = b k and z ( b k ) = z k z(b_{k})=z_{k} z ( b k ) = z k ,
c k − 1 + d k = 1 β ( β c k + θ b k ) = z k c k > 0 , so c k ′ = c k z k ( k ∈ N ) . c_{k}^{-1}+d_{k}=\frac{1}{\beta}\Bigl(\frac{\beta}{c_{k}}+\theta b_{k}\Bigr)=\frac{z_{k}}{c_{k}}>0,\qquad\text{so}\qquad c'_{k}=\frac{c_{k}}{z_{k}}\qquad(k\in\mathbb{N}). c k − 1 + d k = β 1 ( c k β + θ b k ) = c k z k > 0 , so c k ′ = z k c k ( k ∈ N ) .
The sequence c ′ c' c ′ is the sequence of Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile for this d d d , so it is a variance sequence by Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §variances .
The bound c k ′ ≤ κ ′ a k c'_{k}\le\kappa'a_{k} c k ′ ≤ κ ′ a k . Fix k k k and put σ k = s k z k = β a k z k / c k = β a k / c k ′ > 0 \sigma_{k}=s_{k}z_{k}=\beta a_{k}z_{k}/c_{k}=\beta a_{k}/c'_{k}>0 σ k = s k z k = β a k z k / c k = β a k / c k ′ > 0 . Multiplying the equation in (3) by s k s_{k} s k gives
σ k 2 + λ 0 σ k = s k E k . (6) \sigma_{k}^{2}+\lambda_{0}\sigma_{k}=s_{k}E_{k}.\tag{6} σ k 2 + λ 0 σ k = s k E k . ( 6 )
Put T k = s k + θ W / β > 0 T_{k}=s_{k}+\theta W/\beta>0 T k = s k + θ W / β > 0 . Expanding,
T k 2 + λ 0 T k − s k E k = s k ( 2 θ W β − t k ) + θ 2 W 2 β 2 + λ 0 θ W β ≥ 0 , T_{k}^{2}+\lambda_{0}T_{k}-s_{k}E_{k}=s_{k}\Bigl(\frac{2\theta W}{\beta}-t_{k}\Bigr)+\frac{\theta^{2}W^{2}}{\beta^{2}}+\frac{\lambda_{0}\theta W}{\beta}\ge0, T k 2 + λ 0 T k − s k E k = s k ( β 2 θ W − t k ) + β 2 θ 2 W 2 + β λ 0 θ W ≥ 0 ,
since t k ≤ 2 θ W / β t_{k}\le2\theta W/\beta t k ≤ 2 θ W / β and W ≥ 0 W\ge0 W ≥ 0 . If σ k > T k \sigma_{k}>T_{k} σ k > T k , then, as T k > 0 T_{k}>0 T k > 0 , σ k 2 > T k 2 \sigma_{k}^{2}>T_{k}^{2} σ k 2 > T k 2 and λ 0 σ k > λ 0 T k \lambda_{0}\sigma_{k}>\lambda_{0}T_{k} λ 0 σ k > λ 0 T k , so σ k 2 + λ 0 σ k > T k 2 + λ 0 T k ≥ s k E k \sigma_{k}^{2}+\lambda_{0}\sigma_{k}>T_{k}^{2}+\lambda_{0}T_{k}\ge s_{k}E_{k} σ k 2 + λ 0 σ k > T k 2 + λ 0 T k ≥ s k E k , contradicting (6). Hence σ k ≤ T k \sigma_{k}\le T_{k} σ k ≤ T k . Put K = λ 0 + θ W / β > 0 K=\lambda_{0}+\theta W/\beta>0 K = λ 0 + θ W / β > 0 ; then 0 < σ k + λ 0 ≤ s k + K 0<\sigma_{k}+\lambda_{0}\le s_{k}+K 0 < σ k + λ 0 ≤ s k + K , and (6) with E k ≥ ε 0 E_{k}\ge\varepsilon_{0} E k ≥ ε 0 gives
σ k = s k E k σ k + λ 0 ≥ ε 0 s k s k + K . \sigma_{k}=\frac{s_{k}E_{k}}{\sigma_{k}+\lambda_{0}}\ge\frac{\varepsilon_{0}\,s_{k}}{s_{k}+K}. σ k = σ k + λ 0 s k E k ≥ s k + K ε 0 s k .
Since s k ≥ β / κ s_{k}\ge\beta/\kappa s k ≥ β / κ ,
s k s k + K − β / κ β / κ + K = K ( s k − β / κ ) ( s k + K ) ( β / κ + K ) ≥ 0 , β / κ β / κ + K = β β + κ λ 0 + κ θ W β − 1 . \frac{s_{k}}{s_{k}+K}-\frac{\beta/\kappa}{\beta/\kappa+K}=\frac{K\,(s_{k}-\beta/\kappa)}{(s_{k}+K)(\beta/\kappa+K)}\ge0,\qquad\frac{\beta/\kappa}{\beta/\kappa+K}=\frac{\beta}{\beta+\kappa\lambda_{0}+\kappa\theta W\beta^{-1}} . s k + K s k − β / κ + K β / κ = ( s k + K ) ( β / κ + K ) K ( s k − β / κ ) ≥ 0 , β / κ + K β / κ = β + κ λ 0 + κ θ W β − 1 β .
Hence σ k ≥ ε 0 β / ( β + κ λ 0 + κ θ W β − 1 ) \sigma_{k}\ge\varepsilon_{0}\beta/(\beta+\kappa\lambda_{0}+\kappa\theta W\beta^{-1}) σ k ≥ ε 0 β / ( β + κ λ 0 + κ θ W β − 1 ) , and
c k ′ = β a k σ k ≤ β + κ λ 0 + κ θ W β − 1 ε 0 a k = κ ′ a k . c'_{k}=\frac{\beta a_{k}}{\sigma_{k}}\le\frac{\beta+\kappa\lambda_{0}+\kappa\theta W\beta^{-1}}{\varepsilon_{0}}\,a_{k}=\kappa'a_{k}. c k ′ = σ k β a k ≤ ε 0 β + κ λ 0 + κ θ W β − 1 a k = κ ′ a k .
The number κ ′ \kappa' κ ′ is positive, since β > 0 \beta>0 β > 0 , κ λ 0 > 0 \kappa\lambda_{0}>0 κ λ 0 > 0 , κ θ W β − 1 ≥ 0 \kappa\theta W\beta^{-1}\ge0 κ θ W β − 1 ≥ 0 (as W ≥ 0 W\ge0 W ≥ 0 ) and ε 0 > 0 \varepsilon_{0}>0 ε 0 > 0 .
Clause 3. By clause 1, b b b is admissible, and D ⊆ P ρ a \mathcal{D}\subseteq\mathcal{P}^{a}_{\rho} D ⊆ P ρ a . So Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §test , applied with Q = D Q=\mathcal{D} Q = D , shows that Φ 0 = Φ b \Phi_{0}=\Phi_{b} Φ 0 = Φ b is a noise intrinsic test function on D \mathcal{D} D with ∇ Φ 0 ( ν ) = V b ( ν ) \nabla\Phi_{0}(\nu)=V_{b}(\nu) ∇ Φ 0 ( ν ) = V b ( ν ) for every ν ∈ D \nu\in\mathcal{D} ν ∈ D .
Clause 4. Multiplying the equation of clause 1 by c k c_{k} c k gives w k c k = θ 2 a k c k b k 2 + λ 0 2 c k b k + β a k b k w_{k}c_{k}=\frac{\theta}{2}a_{k}c_{k}b_{k}^{2}+\frac{\lambda_{0}}{2}c_{k}b_{k}+\beta a_{k}b_{k} w k c k = 2 θ a k c k b k 2 + 2 λ 0 c k b k + β a k b k , so
β a k b k − w k c k = − θ 2 ( a k b k ) ( c k b k ) − λ 0 2 c k b k , (7) \beta a_{k}b_{k}-w_{k}c_{k}=-\frac{\theta}{2}\,(a_{k}b_{k})(c_{k}b_{k})-\frac{\lambda_{0}}{2}\,c_{k}b_{k},\tag{7} β a k b k − w k c k = − 2 θ ( a k b k ) ( c k b k ) − 2 λ 0 c k b k , ( 7 )
and by (5)
∣ β a k b k − w k c k ∣ ≤ θ 2 ( a k ∣ b k ∣ ) c k ∣ b k ∣ + λ 0 2 c k ∣ b k ∣ ≤ ( θ W β + λ 0 2 ) c k ∣ b k ∣ . \bigl|\beta a_{k}b_{k}-w_{k}c_{k}\bigr|\le\frac{\theta}{2}\,(a_{k}|b_{k}|)\,c_{k}|b_{k}|+\frac{\lambda_{0}}{2}\,c_{k}|b_{k}|\le\Bigl(\frac{\theta W}{\beta}+\frac{\lambda_{0}}{2}\Bigr)c_{k}|b_{k}| . β a k b k − w k c k ≤ 2 θ ( a k ∣ b k ∣ ) c k ∣ b k ∣ + 2 λ 0 c k ∣ b k ∣ ≤ ( β θ W + 2 λ 0 ) c k ∣ b k ∣.
The series ∑ k ∣ b k ∣ c k \sum_{k}|b_{k}|c_{k} ∑ k ∣ b k ∣ c k converges (clause 1), hence so does ∑ k ( θ W β + λ 0 2 ) c k ∣ b k ∣ \sum_{k}\bigl(\frac{\theta W}{\beta}+\frac{\lambda_{0}}{2}\bigr)c_{k}|b_{k}| ∑ k ( β θ W + 2 λ 0 ) c k ∣ b k ∣ by Elementary Properties of Series of Real Numbers §linearity , and An Absolutely Convergent Series of Real Numbers Converges §dominated shows that ∑ k ( β a k b k − w k c k ) \sum_{k}(\beta a_{k}b_{k}-w_{k}c_{k}) ∑ k ( β a k b k − w k c k ) converges absolutely. It therefore converges by An Absolutely Convergent Series of Real Numbers Converges §convergence , and its sum e e e is a real number.
Clause 5. The sequence d d d of clause 2 is admissible with c k − 1 + d k > 0 c_{k}^{-1}+d_{k}>0 c k − 1 + d k > 0 for every k k k , its sequence c ′ c' c ′ is the sequence of dressed variances, and κ ′ \kappa' κ ′ is positive with c k ′ ≤ κ ′ a k c'_{k}\le\kappa'a_{k} c k ′ ≤ κ ′ a k (clause 2); so Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile applies with this d d d and with this κ ′ \kappa' κ ′ as the fixed constant, and its pair ( D ′ , D Σ ′ , E ′ , Σ ′ ) (\mathcal{D}',\mathcal{D}'_{\Sigma},\mathcal{E}',\Sigma') ( D ′ , D Σ ′ , E ′ , Σ ′ ) is the one of clause 5. By Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §space , P γ c ′ a = P ρ a \mathcal{P}^{a}_{\gamma_{c'}}=\mathcal{P}^{a}_{\rho} P γ c ′ a = P ρ a ; by Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §domains , D ′ = D \mathcal{D}'=\mathcal{D} D ′ = D and D Σ ′ = D Σ \mathcal{D}'_{\Sigma}=\mathcal{D}_{\Sigma} D Σ ′ = D Σ ; by Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §logsum , ∑ k log ( c k ′ / c k ) \sum_{k}\log(c'_{k}/c_{k}) ∑ k log ( c k ′ / c k ) converges absolutely. By Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §scaling (with b b b and θ / β \theta/\beta θ / β ), Φ d ( μ ) = θ β Φ b ( μ ) \Phi_{d}(\mu)=\frac{\theta}{\beta}\Phi_{b}(\mu) Φ d ( μ ) = β θ Φ b ( μ ) and V d ( μ ) = θ β V b ( μ ) V_{d}(\mu)=\frac{\theta}{\beta}V_{b}(\mu) V d ( μ ) = β θ V b ( μ ) for μ ∈ P ρ a \mu\in\mathcal{P}^{a}_{\rho} μ ∈ P ρ a , so β Φ d ( μ ) = θ Φ 0 ( μ ) \beta\,\Phi_{d}(\mu)=\theta\,\Phi_{0}(\mu) β Φ d ( μ ) = θ Φ 0 ( μ ) and β V d ( μ ) = θ V b ( μ ) \beta\,V_{d}(\mu)=\theta\,V_{b}(\mu) β V d ( μ ) = θ V b ( μ ) . Hence Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §penalty gives, for μ ∈ D \mu\in\mathcal{D} μ ∈ D ,
E ′ ( μ ) = E ( μ ) + β Φ d ( μ ) + β 2 ∑ k = 1 ∞ log c k ′ c k = E ( μ ) + θ Φ 0 ( μ ) + β 2 ∑ k = 1 ∞ log c k ′ c k , \mathcal{E}'(\mu)=\mathcal{E}(\mu)+\beta\,\Phi_{d}(\mu)+\frac{\beta}{2}\sum_{k=1}^{\infty}\log\frac{c'_{k}}{c_{k}}=\mathcal{E}(\mu)+\theta\,\Phi_{0}(\mu)+\frac{\beta}{2}\sum_{k=1}^{\infty}\log\frac{c'_{k}}{c_{k}}, E ′ ( μ ) = E ( μ ) + β Φ d ( μ ) + 2 β k = 1 ∑ ∞ log c k c k ′ = E ( μ ) + θ Φ 0 ( μ ) + 2 β k = 1 ∑ ∞ log c k c k ′ ,
and Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §score gives, for ν ∈ D Σ ⊆ D \nu\in\mathcal{D}_{\Sigma}\subseteq\mathcal{D} ν ∈ D Σ ⊆ D , using clause 3,
Σ ′ ( ν ) = Σ ( ν ) + β V d ( ν ) = Σ ( ν ) + θ V b ( ν ) = Σ ( ν ) + θ ∇ Φ 0 ( ν ) . \Sigma'(\nu)=\Sigma(\nu)+\beta\,V_{d}(\nu)=\Sigma(\nu)+\theta\,V_{b}(\nu)=\Sigma(\nu)+\theta\,\nabla\Phi_{0}(\nu). Σ ′ ( ν ) = Σ ( ν ) + β V d ( ν ) = Σ ( ν ) + θ V b ( ν ) = Σ ( ν ) + θ ∇ Φ 0 ( ν ) .
Clause 6. Let ( ν , q ) ∈ V a ( D Σ ) (\nu,q)\in\mathcal{V}^{a}(\mathcal{D}_{\Sigma}) ( ν , q ) ∈ V a ( D Σ ) and r ∈ R r\in\mathbb{R} r ∈ R ; thus ν ∈ D Σ \nu\in\mathcal{D}_{\Sigma} ν ∈ D Σ and q ∈ L 2 ( ν ; X a ) q\in L^{2}(\nu;X^{a}) q ∈ L 2 ( ν ; X a ) by The Bundle of Noise Fields over a Set of Measures, First-Order Equation Operators on the Noise Wasserstein Space, and Their Delta-Shifts §bundle . Since D Σ ′ = D Σ \mathcal{D}'_{\Sigma}=\mathcal{D}_{\Sigma} D Σ ′ = D Σ (clause 5) and the bundle over a set depends only on that set, ( ν , q ) ∈ V a ( D Σ ′ ) (\nu,q)\in\mathcal{V}^{a}(\mathcal{D}'_{\Sigma}) ( ν , q ) ∈ V a ( D Σ ′ ) , so F ′ ( ν , r , q ) F'(\nu,r,q) F ′ ( ν , r , q ) is defined. Write V = V b ( ν ) = ∇ Φ 0 ( ν ) V=V_{b}(\nu)=\nabla\Phi_{0}(\nu) V = V b ( ν ) = ∇ Φ 0 ( ν ) (clause 3, as ν ∈ D \nu\in\mathcal{D} ν ∈ D ), Z = Z ν a Z=Z^{a}_{\nu} Z = Z ν a for the noise score field of ν \nu ν relative to γ c \gamma_{c} γ c and Z ′ Z' Z ′ for that relative to γ c ′ \gamma_{c'} γ c ′ . By Viscosity Subsolutions, Supersolutions and Solutions on the Noise Wasserstein Space Relative to a Noise Penalty Pair and a Profile §shifted and the second formula of The Hamilton-Jacobi Equation with Gaussian Score Drift and a Score-Paired Wick-Square Cost on a Hilbert Space §operator ,
F Φ 0 ( ν , r , q ) = F ( ν , r + Φ 0 ( ν ) , q + V ) = λ 0 r + λ 0 Φ 0 ( ν ) + θ 2 ∥ q + V ∥ ν 2 + β ⟨ Z , q + V ⟩ ν − G w ( ν ) − g ( ν ) . (8) F^{\Phi_{0}}(\nu,r,q)=F\bigl(\nu,r+\Phi_{0}(\nu),q+V\bigr)=\lambda_{0}r+\lambda_{0}\Phi_{0}(\nu)+\frac{\theta}{2}\lVert q+V\rVert_{\nu}^{2}+\beta\langle Z,q+V\rangle_{\nu}-G_{w}(\nu)-g(\nu).\tag{8} F Φ 0 ( ν , r , q ) = F ( ν , r + Φ 0 ( ν ) , q + V ) = λ 0 r + λ 0 Φ 0 ( ν ) + 2 θ ∥ q + V ∥ ν 2 + β ⟨ Z , q + V ⟩ ν − G w ( ν ) − g ( ν ) . ( 8 )
The space L 2 ( ν ; X a ) L^{2}(\nu;X^{a}) L 2 ( ν ; X a ) is a real Hilbert space, with ∥ η ∥ ν 2 = ⟨ η , η ⟩ ν \lVert\eta\rVert_{\nu}^{2}=\langle\eta,\eta\rangle_{\nu} ∥ η ∥ ν 2 = ⟨ η , η ⟩ ν for its elements η \eta η , by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §fields , The Space of Square-Integrable Maps from a Measure Space into a Hilbert Space with an Orthonormal Basis §operations and The Space of Square-Integrable Hilbert-Valued Maps is a Real Hilbert Space: Coordinates and Synthesis §hilbert ; by bilinearity and symmetry of the inner product,
θ 2 ∥ q + V ∥ ν 2 + β ⟨ Z , q + V ⟩ ν = θ 2 ∥ q ∥ ν 2 + β ⟨ Z , q ⟩ ν + θ ⟨ V , q ⟩ ν + θ 2 ∥ V ∥ ν 2 + β ⟨ Z , V ⟩ ν . \frac{\theta}{2}\lVert q+V\rVert_{\nu}^{2}+\beta\langle Z,q+V\rangle_{\nu}=\frac{\theta}{2}\lVert q\rVert_{\nu}^{2}+\beta\langle Z,q\rangle_{\nu}+\theta\langle V,q\rangle_{\nu}+\frac{\theta}{2}\lVert V\rVert_{\nu}^{2}+\beta\langle Z,V\rangle_{\nu}. 2 θ ∥ q + V ∥ ν 2 + β ⟨ Z , q + V ⟩ ν = 2 θ ∥ q ∥ ν 2 + β ⟨ Z , q ⟩ ν + θ ⟨ V , q ⟩ ν + 2 θ ∥ V ∥ ν 2 + β ⟨ Z , V ⟩ ν .
By Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §score , applied with the d d d of clause 2, Z ′ = Z + V d ( ν ) = Z + θ β V Z'=Z+V_{d}(\nu)=Z+\frac{\theta}{\beta}V Z ′ = Z + V d ( ν ) = Z + β θ V (clause 5), so β ⟨ Z ′ , q ⟩ ν = β ⟨ Z , q ⟩ ν + θ ⟨ V , q ⟩ ν \beta\langle Z',q\rangle_{\nu}=\beta\langle Z,q\rangle_{\nu}+\theta\langle V,q\rangle_{\nu} β ⟨ Z ′ , q ⟩ ν = β ⟨ Z , q ⟩ ν + θ ⟨ V , q ⟩ ν . Substituting into (8),
F Φ 0 ( ν , r , q ) = λ 0 r + θ 2 ∥ q ∥ ν 2 + β ⟨ Z ′ , q ⟩ ν + R ( ν ) − g ( ν ) , R ( ν ) = λ 0 Φ 0 ( ν ) + θ 2 ∥ V ∥ ν 2 + β ⟨ Z , V ⟩ ν − G w ( ν ) . (9) F^{\Phi_{0}}(\nu,r,q)=\lambda_{0}r+\frac{\theta}{2}\lVert q\rVert_{\nu}^{2}+\beta\langle Z',q\rangle_{\nu}+R(\nu)-g(\nu),\qquad R(\nu)=\lambda_{0}\Phi_{0}(\nu)+\frac{\theta}{2}\lVert V\rVert_{\nu}^{2}+\beta\langle Z,V\rangle_{\nu}-G_{w}(\nu).\tag{9} F Φ 0 ( ν , r , q ) = λ 0 r + 2 θ ∥ q ∥ ν 2 + β ⟨ Z ′ , q ⟩ ν + R ( ν ) − g ( ν ) , R ( ν ) = λ 0 Φ 0 ( ν ) + 2 θ ∥ V ∥ ν 2 + β ⟨ Z , V ⟩ ν − G w ( ν ) . ( 9 )
We show R ( ν ) = − e R(\nu)=-e R ( ν ) = − e . For k ∈ N k\in\mathbb{N} k ∈ N let m k = ∫ X x k 2 ν ( d x ) m_{k}=\int_{X}x_{k}^{2}\,\nu(dx) m k = ∫ X x k 2 ν ( d x ) , a real number by the preamble of Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions , as ν ∈ P ρ a \nu\in\mathcal{P}^{a}_{\rho} ν ∈ P ρ a . We use four convergent series.
(i) By Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §profile , ∑ k b k m k \sum_{k}b_{k}m_{k} ∑ k b k m k converges absolutely, hence converges by An Absolutely Convergent Series of Real Numbers Converges §convergence , and Φ 0 ( ν ) = 1 2 ∑ k b k m k \Phi_{0}(\nu)=\frac12\sum_{k}b_{k}m_{k} Φ 0 ( ν ) = 2 1 ∑ k b k m k ; so λ 0 Φ 0 ( ν ) = ∑ k λ 0 2 b k m k \lambda_{0}\Phi_{0}(\nu)=\sum_{k}\frac{\lambda_{0}}{2}b_{k}m_{k} λ 0 Φ 0 ( ν ) = ∑ k 2 λ 0 b k m k by Elementary Properties of Series of Real Numbers §linearity .
(ii) By Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §field , ∥ V ∥ ν 2 = ∑ k a k b k 2 m k \lVert V\rVert_{\nu}^{2}=\sum_{k}a_{k}b_{k}^{2}m_{k} ∥ V ∥ ν 2 = ∑ k a k b k 2 m k . (This series converges: by Diagonal Quadratic Profiles on the Noise Wasserstein Space: Moment Bounds, a Lipschitz Estimate, the Gradient Field, and Noise Intrinsic Test Functions §moments , applied with the nonnegative sequence ( a k b k 2 ) k ∈ N (a_{k}b_{k}^{2})_{k\in\mathbb{N}} ( a k b k 2 ) k ∈ N in place of t t t and M = ( 2 W / β ) 2 M=(2W/\beta)^{2} M = ( 2 W / β ) 2 ; indeed a k ⋅ a k b k 2 ≤ ( 2 W / β ) 2 a_{k}\cdot a_{k}b_{k}^{2}\le(2W/\beta)^{2} a k ⋅ a k b k 2 ≤ ( 2 W / β ) 2 and 0 ≤ a k b k 2 c k ≤ 2 W β ∣ b k ∣ c k 0\le a_{k}b_{k}^{2}c_{k}\le\frac{2W}{\beta}|b_{k}|c_{k} 0 ≤ a k b k 2 c k ≤ β 2 W ∣ b k ∣ c k by (5), so ∑ k a k b k 2 c k \sum_{k}a_{k}b_{k}^{2}c_{k} ∑ k a k b k 2 c k converges by Elementary Properties of Series of Real Numbers §linearity and Series of Nonnegative Real Numbers, Comparison, and the Geometric Series §comparison .) So θ 2 ∥ V ∥ ν 2 = ∑ k θ 2 a k b k 2 m k \frac{\theta}{2}\lVert V\rVert_{\nu}^{2}=\sum_{k}\frac{\theta}{2}a_{k}b_{k}^{2}m_{k} 2 θ ∥ V ∥ ν 2 = ∑ k 2 θ a k b k 2 m k by Elementary Properties of Series of Real Numbers §linearity .
(iii) The measure ν ∈ D Σ \nu\in\mathcal{D}_{\Sigma} ν ∈ D Σ lies in P ρ a \mathcal{P}^{a}_{\rho} P ρ a and has a relative score with respect to γ c \gamma_{c} γ c and finite Fisher information relative to γ c \gamma_{c} γ c with weights a a a , by The Gaussian Entropy Pair on the Noise Wasserstein Space: Relative Entropy and the Noise Score Field §score-domain . So The Gaussian Relative Score Paired with the Gradient Field of a Diagonal Quadratic Profile §pairing gives ⟨ Z , V ⟩ ν = ∑ k a k b k ( m k c k − 1 ) \langle Z,V\rangle_{\nu}=\sum_{k}a_{k}b_{k}\bigl(\frac{m_{k}}{c_{k}}-1\bigr) ⟨ Z , V ⟩ ν = ∑ k a k b k ( c k m k − 1 ) , and β ⟨ Z , V ⟩ ν = ∑ k ( β a k c k b k m k − β a k b k ) \beta\langle Z,V\rangle_{\nu}=\sum_{k}\bigl(\frac{\beta a_{k}}{c_{k}}b_{k}m_{k}-\beta a_{k}b_{k}\bigr) β ⟨ Z , V ⟩ ν = ∑ k ( c k β a k b k m k − β a k b k ) by Elementary Properties of Series of Real Numbers §linearity .
(iv) By The Score-Paired Wick-Square Cost is the Wick-Ordered Series, and Cutoff Counterterms Are Forced up to a Convergent Constant §series , G w ( ν ) = ∑ k w k ( m k − c k ) G_{w}(\nu)=\sum_{k}w_{k}(m_{k}-c_{k}) G w ( ν ) = ∑ k w k ( m k − c k ) , so − G w ( ν ) = ∑ k ( w k c k − w k m k ) -G_{w}(\nu)=\sum_{k}(w_{k}c_{k}-w_{k}m_{k}) − G w ( ν ) = ∑ k ( w k c k − w k m k ) by Elementary Properties of Series of Real Numbers §linearity .
By Elementary Properties of Series of Real Numbers §linearity , the termwise sum of the four series in (i) to (iv) converges with sum R ( ν ) R(\nu) R ( ν ) . Its k k k -th term is
m k ( θ a k 2 b k 2 + ( λ 0 2 + β a k c k ) b k − w k ) − ( β a k b k − w k c k ) = − ( β a k b k − w k c k ) , m_{k}\Bigl(\frac{\theta a_{k}}{2}\,b_{k}^{2}+\Bigl(\frac{\lambda_{0}}{2}+\frac{\beta a_{k}}{c_{k}}\Bigr)b_{k}-w_{k}\Bigr)-\bigl(\beta a_{k}b_{k}-w_{k}c_{k}\bigr)=-\bigl(\beta a_{k}b_{k}-w_{k}c_{k}\bigr), m k ( 2 θ a k b k 2 + ( 2 λ 0 + c k β a k ) b k − w k ) − ( β a k b k − w k c k ) = − ( β a k b k − w k c k ) ,
the bracket vanishing by clause 1. On the other hand the series ∑ k ( β a k b k − w k c k ) \sum_{k}(\beta a_{k}b_{k}-w_{k}c_{k}) ∑ k ( β a k b k − w k c k ) converges with sum e e e (clause 4), so ∑ k ( − ( β a k b k − w k c k ) ) = − e \sum_{k}\bigl(-(\beta a_{k}b_{k}-w_{k}c_{k})\bigr)=-e ∑ k ( − ( β a k b k − w k c k ) ) = − e by Elementary Properties of Series of Real Numbers §linearity . Hence R ( ν ) = − e R(\nu)=-e R ( ν ) = − e , and (9) becomes
F Φ 0 ( ν , r , q ) = λ 0 r + θ 2 ∥ q ∥ ν 2 + β ⟨ Z ′ , q ⟩ ν − ( g ( ν ) + e ) . F^{\Phi_{0}}(\nu,r,q)=\lambda_{0}r+\frac{\theta}{2}\lVert q\rVert_{\nu}^{2}+\beta\langle Z',q\rangle_{\nu}-\bigl(g(\nu)+e\bigr). F Φ 0 ( ν , r , q ) = λ 0 r + 2 θ ∥ q ∥ ν 2 + β ⟨ Z ′ , q ⟩ ν − ( g ( ν ) + e ) .
By The Hamilton-Jacobi Equation with Gaussian Score Drift on a Hilbert Space §operator , read with c ′ c' c ′ in place of c c c (a variance sequence with c k ′ ≤ κ ′ a k c'_{k}\le\kappa'a_{k} c k ′ ≤ κ ′ a k , by clause 2), the pair ( D ′ , D Σ ′ , E ′ , Σ ′ ) (\mathcal{D}',\mathcal{D}'_{\Sigma},\mathcal{E}',\Sigma') ( D ′ , D Σ ′ , E ′ , Σ ′ ) , temperature β \beta β , discount λ 0 \lambda_{0} λ 0 , control cost θ \theta θ and running cost ν ↦ g ( ν ) + e \nu\mapsto g(\nu)+e ν ↦ g ( ν ) + e on D ′ = D \mathcal{D}'=\mathcal{D} D ′ = D , whose score field at ν \nu ν is Z ′ Z' Z ′ , the right-hand side is F ′ ( ν , r , q ) F'(\nu,r,q) F ′ ( ν , r , q ) .
Clause 7. By clause 2, c ′ c' c ′ is a variance sequence and κ ′ \kappa' κ ′ is positive with c k ′ ≤ κ ′ a k c'_{k}\le\kappa'a_{k} c k ′ ≤ κ ′ a k for every k k k , so The Gaussian Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain , read with c ′ c' c ′ in place of c c c and κ ′ \kappa' κ ′ in place of κ \kappa κ , applies to the pair P ′ = ( D ′ , D Σ ′ , E ′ , Σ ′ ) P'=(\mathcal{D}',\mathcal{D}'_{\Sigma},\mathcal{E}',\Sigma') P ′ = ( D ′ , D Σ ′ , E ′ , Σ ′ ) of clause 5. By The Gaussian Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair , P ′ P' P ′ is a noise penalty pair on P γ c ′ a \mathcal{P}^{a}_{\gamma_{c'}} P γ c ′ a , and by The Gaussian Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §nonnegative , 0 ≤ E ′ ( μ ) 0\le\mathcal{E}'(\mu) 0 ≤ E ′ ( μ ) for every μ ∈ D ′ \mu\in\mathcal{D}' μ ∈ D ′ , that is for every μ ∈ D \mu\in\mathcal{D} μ ∈ D , as D ′ = D \mathcal{D}'=\mathcal{D} D ′ = D (clause 5). We check the requirements of Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §pair for P ′ P' P ′ on P ρ a \mathcal{P}^{a}_{\rho} P ρ a , ρ = γ c \rho=\gamma_{c} ρ = γ c . By clause 5 (that is, by Changing the Variances of a Diagonal Gaussian Reference by a Diagonal Quadratic: the Same Measures and Domains, with Penalty and Score Shifted by a Diagonal Quadratic Profile §space ), P γ c ′ a = P ρ a \mathcal{P}^{a}_{\gamma_{c'}}=\mathcal{P}^{a}_{\rho} P γ c ′ a = P ρ a , so D Σ ′ ⊆ D ′ ⊆ P ρ a \mathcal{D}'_{\Sigma}\subseteq\mathcal{D}'\subseteq\mathcal{P}^{a}_{\rho} D Σ ′ ⊆ D ′ ⊆ P ρ a . The requirement Σ ′ ( μ ) ∈ T μ a \Sigma'(\mu)\in T^{a}_{\mu} Σ ′ ( μ ) ∈ T μ a for μ ∈ D Σ ′ \mu\in\mathcal{D}'_{\Sigma} μ ∈ D Σ ′ and the conditions Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §nonempty , Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §variation and Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §dense involve only the sets D Σ ′ ⊆ D ′ \mathcal{D}'_{\Sigma}\subseteq\mathcal{D}' D Σ ′ ⊆ D ′ , the functions E ′ \mathcal{E}' E ′ and Σ ′ \Sigma' Σ ′ , the spaces L 2 ( μ ; X a ) L^{2}(\mu;X^{a}) L 2 ( μ ; X a ) of Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §fields and the noise tangent spaces T μ a T^{a}_{\mu} T μ a of The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §tangent , which are defined for every μ ∈ P ( X ) \mu\in\mathcal{P}(X) μ ∈ P ( X ) , the noise gradients ∇ a ψ \nabla_{a}\psi ∇ a ψ of bounded C 2 C^{2} C 2 cylindrical functions (The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient ), which are maps on X X X , push-forwards of members of D Σ ′ \mathcal{D}'_{\Sigma} D Σ ′ , and the values W a ( ν , μ ) W_{a}(\nu,\mu) W a ( ν , μ ) of the metric W a W_{a} W a for members ν , μ \nu,\mu ν , μ of D ′ \mathcal{D}' D ′ , which The Noise Wasserstein Distance §distance defines from μ \mu μ , ν \nu ν and their couplings of finite noise cost; none of them refers to the reference measure except through the set P γ c ′ a = P ρ a \mathcal{P}^{a}_{\gamma_{c'}}=\mathcal{P}^{a}_{\rho} P γ c ′ a = P ρ a . So these requirements hold for P ′ P' P ′ on P ρ a \mathcal{P}^{a}_{\rho} P ρ a , because they hold for P ′ P' P ′ on P γ c ′ a \mathcal{P}^{a}_{\gamma_{c'}} P γ c ′ a . Finally, condition Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §bound relative to ρ \rho ρ holds with the nonnegative constant C = 0 C=0 C = 0 : for every μ ∈ D ′ \mu\in\mathcal{D}' μ ∈ D ′ , W a ( μ , ρ ) W_{a}(\mu,\rho) W a ( μ , ρ ) is a real number, as μ ∈ P ρ a \mu\in\mathcal{P}^{a}_{\rho} μ ∈ P ρ a , and − 0 ⋅ ( 1 + W a ( μ , ρ ) 2 ) = 0 ≤ E ′ ( μ ) -0\cdot\bigl(1+W_{a}(\mu,\rho)^{2}\bigr)=0\le\mathcal{E}'(\mu) − 0 ⋅ ( 1 + W a ( μ , ρ ) 2 ) = 0 ≤ E ′ ( μ ) . Hence P ′ P' P ′ is a noise penalty pair on P ρ a \mathcal{P}^{a}_{\rho} P ρ a in the setting read with ρ = γ c \rho=\gamma_{c} ρ = γ c .