Throughout, ∥ ⋅ ∥ 2 \lVert\cdot\rVert_{2} ∥ ⋅ ∥ 2 , the triangle inequality, and Cauchy-Schwarz are from Square-Integrable Random Variables and the Mean-Square Inner Product and Cauchy-Schwarz and Triangle Inequalities for the Mean-Square Norm ; uniqueness of mean-square limits (if ∥ Z n − V ∥ 2 → 0 \lVert Z_n-V\rVert_2\to0 ∥ Z n − V ∥ 2 → 0 and ∥ Z n − V ′ ∥ 2 → 0 \lVert Z_n-V'\rVert_2\to0 ∥ Z n − V ′ ∥ 2 → 0 then V = V ′ V=V' V = V ′ almost surely) follows from these and the null-equivalence of Square-Integrable Random Variables and the Mean-Square Inner Product . Bilinearity of the covariance in each argument follows from its formula Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] \operatorname{Cov}(X,Y)=\mathbb{E}[XY]-\mathbb{E}[X]\mathbb{E}[Y] Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] there together with the bilinearity of the mean-square inner product recorded in Square-Integrable Random Variables and the Mean-Square Inner Product ; for centered random variables, Cov ( X , Y ) = E [ X Y ] \operatorname{Cov}(X,Y)=\mathbb{E}[XY] Cov ( X , Y ) = E [ X Y ] . Fix t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] ; for t = 0 t=0 t = 0 every asserted identity reads 0 = 0 0=0 0 = 0 by the degenerate-interval conventions of Mean-Square Riemann Integral of a Family of Random Variables , so assume t > 0 t>0 t > 0 . For n ≥ 1 n\ge1 n ≥ 1 put x i = i t / n x_i=it/n x i = i t / n (0 ≤ i ≤ n 0\le i\le n 0 ≤ i ≤ n ), and let ω n \omega_n ω n be a bound for ∣ f ( u ) − f ( v ) ∣ |f(u)-f(v)| ∣ f ( u ) − f ( v ) ∣ over u , v ∈ [ 0 , T ] u,v\in[0,T] u , v ∈ [ 0 , T ] with ∣ u − v ∣ ≤ t / n |u-v|\le t/n ∣ u − v ∣ ≤ t / n ; by Continuity on a Closed Interval Implies Uniform Continuity we may choose ω n → 0 \omega_n\to0 ω n → 0 . Both parts rest on the Abel summation identity : for any random variables U x 0 , U x 1 , … , U x n U_{x_0},U_{x_1},\dots,U_{x_n} U x 0 , U x 1 , … , U x n ,
∑ i = 1 n f ( x i − 1 ) ( U x i − U x i − 1 ) + ∑ i = 1 n ( f ( x i ) − f ( x i − 1 ) ) U x i = f ( t ) U x n − f ( 0 ) U x 0 , \sum_{i=1}^{n}f(x_{i-1})\,(U_{x_i}-U_{x_{i-1}})+\sum_{i=1}^{n}\bigl(f(x_i)-f(x_{i-1})\bigr)U_{x_i}=f(t)U_{x_n}-f(0)U_{x_0}, i = 1 ∑ n f ( x i − 1 ) ( U x i − U x i − 1 ) + i = 1 ∑ n ( f ( x i ) − f ( x i − 1 ) ) U x i = f ( t ) U x n − f ( 0 ) U x 0 ,
which holds pointwise on Ω \Omega Ω because the left-hand side telescopes to ∑ i ( f ( x i ) U x i − f ( x i − 1 ) U x i − 1 ) \sum_i\bigl(f(x_i)U_{x_i}-f(x_{i-1})U_{x_{i-1}}\bigr) ∑ i ( f ( x i ) U x i − f ( x i − 1 ) U x i − 1 ) .
Part 1. All the random variables below lie in the centered jointly Gaussian family of claims 2 and 3 of Wiener Integrals of Continuous Functions are Jointly Gaussian (Wiener integrals and values of B B B ; expectations vanish and covariances are given by claim 2 there), so all second moments of their linear combinations are computed by bilinearity of the covariance from those covariance formulas, together with Additivity of the Riemann Integral on Adjacent Intervals for splitting Riemann integrals over adjacent intervals.
Mean-square continuity of V V V . For 0 ≤ s ≤ s ′ ≤ T 0\le s\le s'\le T 0 ≤ s ≤ s ′ ≤ T : E [ ( V s ′ − V s ) 2 ] = ∫ 0 s ′ k 2 − 2 ∫ 0 s k 2 + ∫ 0 s k 2 = ∫ s s ′ k ( u ) 2 d u ≤ ( s ′ − s ) max [ 0 , T ] k 2 \mathbb{E}[(V_{s'}-V_s)^2]=\int_0^{s'}k^2-2\int_0^{s}k^2+\int_0^{s}k^2=\int_s^{s'}k(u)^2\,du\le(s'-s)\max_{[0,T]}k^2 E [( V s ′ − V s ) 2 ] = ∫ 0 s ′ k 2 − 2 ∫ 0 s k 2 + ∫ 0 s k 2 = ∫ s s ′ k ( u ) 2 d u ≤ ( s ′ − s ) max [ 0 , T ] k 2 (the maximum exists by Extreme Value Theorem on a Compact Interval ; monotonicity of the integral via Agreement of the Riemann and Lebesgue Integrals for Continuous Functions on a Closed Interval and Linearity and Monotonicity of the Lebesgue Integral ). This also covers s = 0 s=0 s = 0 since V 0 = 0 V_0=0 V 0 = 0 , and degenerate cases by the conventions of Mean-Square Riemann Integral of a Family of Random Variables . Mean-square continuity follows; the existence assertions in the statement then follow from claim 2 of Basic Properties of the Mean-Square Riemann Integral and Existence and Uniqueness of the Mean-Square Riemann Integral for Mean-Square Continuous Families , as indicated there.
Step (a). Let D n = ∑ i = 1 n f ( x i − 1 ) ( V x i − V x i − 1 ) − ∫ 0 t f ( u ) k ( u ) d B u D_n=\sum_{i=1}^{n}f(x_{i-1})(V_{x_i}-V_{x_{i-1}})-\int_0^t f(u)k(u)\,dB_u D n = ∑ i = 1 n f ( x i − 1 ) ( V x i − V x i − 1 ) − ∫ 0 t f ( u ) k ( u ) d B u . Expanding E [ D n 2 ] \mathbb{E}[D_n^2] E [ D n 2 ] by bilinearity and the covariance formulas: for i ≠ j i\ne j i = j the increments are uncorrelated, Cov ( V x i − V x i − 1 , V x j − V x j − 1 ) = 0 \operatorname{Cov}(V_{x_i}-V_{x_{i-1}},V_{x_j}-V_{x_{j-1}})=0 Cov ( V x i − V x i − 1 , V x j − V x j − 1 ) = 0 (evaluate the four min \min min terms); Cov ( V x i − V x i − 1 , V x i − V x i − 1 ) = ∫ x i − 1 x i k 2 \operatorname{Cov}(V_{x_i}-V_{x_{i-1}},V_{x_i}-V_{x_{i-1}})=\int_{x_{i-1}}^{x_i}k^2 Cov ( V x i − V x i − 1 , V x i − V x i − 1 ) = ∫ x i − 1 x i k 2 ; and Cov ( V x i − V x i − 1 , ∫ 0 t f k d B ) = ∫ 0 x i f k 2 − ∫ 0 x i − 1 f k 2 = ∫ x i − 1 x i f k 2 \operatorname{Cov}\bigl(V_{x_i}-V_{x_{i-1}},\int_0^tfk\,dB\bigr)=\int_0^{x_i}fk^2-\int_0^{x_{i-1}}fk^2=\int_{x_{i-1}}^{x_i}fk^2 Cov ( V x i − V x i − 1 , ∫ 0 t f k d B ) = ∫ 0 x i f k 2 − ∫ 0 x i − 1 f k 2 = ∫ x i − 1 x i f k 2 . Hence
E [ D n 2 ] = ∑ i = 1 n ( f ( x i − 1 ) 2 ∫ x i − 1 x i k 2 − 2 f ( x i − 1 ) ∫ x i − 1 x i f k 2 ) + ∫ 0 t f 2 k 2 = ∑ i = 1 n ∫ x i − 1 x i ( f ( x i − 1 ) − f ( u ) ) 2 k ( u ) 2 d u ≤ ω n 2 ∫ 0 t k 2 → 0. \mathbb{E}[D_n^2]=\sum_{i=1}^{n}\Bigl(f(x_{i-1})^2\int_{x_{i-1}}^{x_i}k^2-2f(x_{i-1})\int_{x_{i-1}}^{x_i}fk^2\Bigr)+\int_0^tf^2k^2=\sum_{i=1}^{n}\int_{x_{i-1}}^{x_i}\bigl(f(x_{i-1})-f(u)\bigr)^2k(u)^2\,du\le\omega_n^2\int_0^tk^2\to0 . E [ D n 2 ] = i = 1 ∑ n ( f ( x i − 1 ) 2 ∫ x i − 1 x i k 2 − 2 f ( x i − 1 ) ∫ x i − 1 x i f k 2 ) + ∫ 0 t f 2 k 2 = i = 1 ∑ n ∫ x i − 1 x i ( f ( x i − 1 ) − f ( u ) ) 2 k ( u ) 2 d u ≤ ω n 2 ∫ 0 t k 2 → 0.
Step (b). We show ∥ ∑ i = 1 n ( f ( x i ) − f ( x i − 1 ) ) V x i − ∫ 0 t g ( u ) V u d u ∥ 2 → 0 \bigl\lVert\sum_{i=1}^{n}(f(x_i)-f(x_{i-1}))V_{x_i}-\int_0^tg(u)V_u\,du\bigr\rVert_2\to0 ∑ i = 1 n ( f ( x i ) − f ( x i − 1 )) V x i − ∫ 0 t g ( u ) V u d u 2 → 0 . Using f ( x i ) − f ( x i − 1 ) = ∫ x i − 1 x i g ( u ) d u f(x_i)-f(x_{i-1})=\int_{x_{i-1}}^{x_i}g(u)\,du f ( x i ) − f ( x i − 1 ) = ∫ x i − 1 x i g ( u ) d u (hypothesis on f , g f,g f , g and Additivity of the Riemann Integral on Adjacent Intervals ) and claim 2 of Basic Properties of the Mean-Square Riemann Integral , the i i i -th summand equals ∫ x i − 1 x i g ( u ) V x i d u \int_{x_{i-1}}^{x_i}g(u)V_{x_i}\,du ∫ x i − 1 x i g ( u ) V x i d u (a mean-square Riemann integral of the family ( g ( u ) V x i ) u (g(u)V_{x_i})_{u} ( g ( u ) V x i ) u ), while claim 5 of Basic Properties of the Mean-Square Riemann Integral , applied inductively over the division points x 1 , … , x n − 1 x_1,\dots,x_{n-1} x 1 , … , x n − 1 , splits ∫ 0 t g ( u ) V u d u = ∑ i ∫ x i − 1 x i g ( u ) V u d u \int_0^tg(u)V_u\,du=\sum_i\int_{x_{i-1}}^{x_i}g(u)V_u\,du ∫ 0 t g ( u ) V u d u = ∑ i ∫ x i − 1 x i g ( u ) V u d u . By linearity (claim 1 there; the family ( g ( u ) ( V x i − V u ) ) u (g(u)(V_{x_i}-V_u))_u ( g ( u ) ( V x i − V u ) ) u is mean-square continuous by claims 1 and 2 there) the difference is ∑ i ∫ x i − 1 x i g ( u ) ( V x i − V u ) d u \sum_i\int_{x_{i-1}}^{x_i}g(u)(V_{x_i}-V_u)\,du ∑ i ∫ x i − 1 x i g ( u ) ( V x i − V u ) d u , and by the norm bound (claim 4 there),
∥ ∑ i ∫ x i − 1 x i g ( u ) ( V x i − V u ) d u ∥ 2 ≤ ∑ i ∫ x i − 1 x i ∣ g ( u ) ∣ ∥ V x i − V u ∥ 2 d u ≤ t ( max [ 0 , T ] ∣ g ∣ ) ω ~ n , \Bigl\lVert\sum_i\int_{x_{i-1}}^{x_i}g(u)(V_{x_i}-V_u)\,du\Bigr\rVert_2\le\sum_i\int_{x_{i-1}}^{x_i}|g(u)|\,\lVert V_{x_i}-V_u\rVert_2\,du\le t\,\Bigl(\max_{[0,T]}|g|\Bigr)\,\widetilde{\omega}_n, i ∑ ∫ x i − 1 x i g ( u ) ( V x i − V u ) d u 2 ≤ i ∑ ∫ x i − 1 x i ∣ g ( u ) ∣ ∥ V x i − V u ∥ 2 d u ≤ t ( [ 0 , T ] max ∣ g ∣ ) ω n ,
where max [ 0 , T ] ∣ g ∣ \max_{[0,T]}|g| max [ 0 , T ] ∣ g ∣ exists by Extreme Value Theorem on a Compact Interval and
ω ~ n = max 1 ≤ i ≤ n sup u ∈ [ x i − 1 , x i ] ∥ V x i − V u ∥ 2 ≤ ( ( t / n ) max [ 0 , T ] k 2 ) 1 / 2 → 0 \widetilde{\omega}_n=\max_{1\le i\le n}\ \sup_{u\in[x_{i-1},x_i]}\lVert V_{x_i}-V_u\rVert_2\le\Bigl((t/n)\max_{[0,T]}k^2\Bigr)^{1/2}\to0 ω n = 1 ≤ i ≤ n max u ∈ [ x i − 1 , x i ] sup ∥ V x i − V u ∥ 2 ≤ ( ( t / n ) [ 0 , T ] max k 2 ) 1/2 → 0
by the mean-square continuity estimate above.
By the Abel identity with U = V U=V U = V (note V x 0 = V 0 = 0 V_{x_0}=V_0=0 V x 0 = V 0 = 0 ), ∑ i f ( x i − 1 ) ( V x i − V x i − 1 ) = f ( t ) V t − ∑ i ( f ( x i ) − f ( x i − 1 ) ) V x i \sum_if(x_{i-1})(V_{x_i}-V_{x_{i-1}})=f(t)V_t-\sum_i(f(x_i)-f(x_{i-1}))V_{x_i} ∑ i f ( x i − 1 ) ( V x i − V x i − 1 ) = f ( t ) V t − ∑ i ( f ( x i ) − f ( x i − 1 )) V x i . The left side converges in mean square to ∫ 0 t f k d B \int_0^tfk\,dB ∫ 0 t f k d B by step (a); the right side converges to f ( t ) V t − ∫ 0 t g V u d u f(t)V_t-\int_0^tgV_u\,du f ( t ) V t − ∫ 0 t g V u d u by step (b). Uniqueness of mean-square limits gives the identity of part 1, for every version of the integrals involved (each version is a limit of the same sequences). The special case k ≡ 1 k\equiv1 k ≡ 1 follows since V t = B t V_t=B_t V t = B t almost surely by claim 1 of Wiener Integrals of Continuous Functions are Jointly Gaussian for t > 0 t>0 t > 0 and by property (i) of Standard Brownian Motion (B 0 = 0 B_0=0 B 0 = 0 almost surely) for t = 0 t=0 t = 0 ; covariances and mean-square limits are unaffected by almost-sure replacement.
Part 2. ( Y t ) (Y_t) ( Y t ) is mean-square continuous by claim 6 of Basic Properties of the Mean-Square Riemann Integral , and the product families in the statement are mean-square continuous by claim 2 there. By the Abel identity with U = Y U=Y U = Y (Y 0 = 0 Y_0=0 Y 0 = 0 ):
∑ i = 1 n f ( x i − 1 ) ( Y x i − Y x i − 1 ) + ∑ i = 1 n ( f ( x i ) − f ( x i − 1 ) ) Y x i = f ( t ) Y t . \sum_{i=1}^{n}f(x_{i-1})(Y_{x_i}-Y_{x_{i-1}})+\sum_{i=1}^{n}(f(x_i)-f(x_{i-1}))Y_{x_i}=f(t)Y_t . i = 1 ∑ n f ( x i − 1 ) ( Y x i − Y x i − 1 ) + i = 1 ∑ n ( f ( x i ) − f ( x i − 1 )) Y x i = f ( t ) Y t .
First sum. By claim 5 of Basic Properties of the Mean-Square Riemann Integral (applied on [ 0 , x i ] [0,x_i] [ 0 , x i ] with intermediate point x i − 1 x_{i-1} x i − 1 ), Y x i − Y x i − 1 = ∫ x i − 1 x i H u d u Y_{x_i}-Y_{x_{i-1}}=\int_{x_{i-1}}^{x_i}H_u\,du Y x i − Y x i − 1 = ∫ x i − 1 x i H u d u almost surely, so by claims 1 and 2 there the first sum equals ∑ i ∫ x i − 1 x i f ( x i − 1 ) H u d u \sum_i\int_{x_{i-1}}^{x_i}f(x_{i-1})H_u\,du ∑ i ∫ x i − 1 x i f ( x i − 1 ) H u d u almost surely, and
∥ ∑ i ∫ x i − 1 x i f ( x i − 1 ) H u d u − ∫ 0 t f ( u ) H u d u ∥ 2 = ∥ ∑ i ∫ x i − 1 x i ( f ( x i − 1 ) − f ( u ) ) H u d u ∥ 2 ≤ ω n ∫ 0 t ∥ H u ∥ 2 d u → 0 , \Bigl\lVert\sum_i\int_{x_{i-1}}^{x_i}f(x_{i-1})H_u\,du-\int_0^tf(u)H_u\,du\Bigr\rVert_2=\Bigl\lVert\sum_i\int_{x_{i-1}}^{x_i}\bigl(f(x_{i-1})-f(u)\bigr)H_u\,du\Bigr\rVert_2\le\omega_n\int_0^t\lVert H_u\rVert_2\,du\to0, i ∑ ∫ x i − 1 x i f ( x i − 1 ) H u d u − ∫ 0 t f ( u ) H u d u 2 = i ∑ ∫ x i − 1 x i ( f ( x i − 1 ) − f ( u ) ) H u d u 2 ≤ ω n ∫ 0 t ∥ H u ∥ 2 d u → 0 ,
using claim 4 and the inductive application of claim 5 there. Second sum. Exactly as step (b) of part 1, with Y Y Y in place of V V V and, in place of the explicit modulus, the uniform mean-square continuity of ( Y u ) (Y_u) ( Y u ) from Uniform Mean-Square Continuity on a Compact Interval : the second sum converges in mean square to ∫ 0 t g ( u ) Y u d u \int_0^tg(u)Y_u\,du ∫ 0 t g ( u ) Y u d u . Passing to the mean-square limit in the displayed identity and using uniqueness of mean-square limits yields ∫ 0 t f ( u ) H u d u + ∫ 0 t g ( u ) Y u d u = f ( t ) Y t \int_0^tf(u)H_u\,du+\int_0^tg(u)Y_u\,du=f(t)Y_t ∫ 0 t f ( u ) H u d u + ∫ 0 t g ( u ) Y u d u = f ( t ) Y t almost surely, for every choice of versions. ■ \blacksquare ■