Fix conditional expectations Y n Y_n Y n β of X X X given G n \mathcal{G}_n G n β for each n β N n\in\mathbb{N} n β N and a conditional expectation Y β Y_\infty Y β β of X X X given G β \mathcal{G}_\infty G β β , as in Conditional Expectation of a Square-Integrable Random Variable . All norms, inner products, and expectations below are those of Square-Integrable Random Variables and the Mean-Square Inner Product .
Step 1: The sequence ( Y n ) (Y_n) ( Y n β ) is Cauchy in mean square. Let m β€ n m\le n m β€ n . Since G m β G n \mathcal{G}_m\subseteq\mathcal{G}_n G m β β G n β , both Y m Y_m Y m β and Y n Y_n Y n β are G n \mathcal{G}_n G n β -measurable and square-integrable, hence so is Z = Y n β Y m Z=Y_n-Y_m Z = Y n β β Y m β by the closure properties recorded in Square-Integrable Random Variables and the Mean-Square Inner Product . The orthogonality property (property 2 of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables , which every conditional expectation satisfies by the equivalence stated there) gives E [ ( X β Y n ) Z ] = 0 \mathbb{E}[(X-Y_n)Z]=0 E [( X β Y n β ) Z ] = 0 . Writing X β Y m = ( X β Y n ) + Z X-Y_m=(X-Y_n)+Z X β Y m β = ( X β Y n β ) + Z and expanding with the bilinearity of the mean-square inner product from Square-Integrable Random Variables and the Mean-Square Inner Product ,
β₯ X β Y m β₯ 2 2 = β₯ X β Y n β₯ 2 2 + 2 β E [ ( X β Y n ) Z ] + β₯ Z β₯ 2 2 = β₯ X β Y n β₯ 2 2 + β₯ Y n β Y m β₯ 2 2 . \lVert X-Y_m\rVert_{2}^{2}=\lVert X-Y_n\rVert_{2}^{2}+2\,\mathbb{E}[(X-Y_n)Z]+\lVert Z\rVert_{2}^{2}=\lVert X-Y_n\rVert_{2}^{2}+\lVert Y_n-Y_m\rVert_{2}^{2}. β₯ X β Y m β β₯ 2 2 β = β₯ X β Y n β β₯ 2 2 β + 2 E [( X β Y n β ) Z ] + β₯ Z β₯ 2 2 β = β₯ X β Y n β β₯ 2 2 β + β₯ Y n β β Y m β β₯ 2 2 β .
Set d n = β₯ X β Y n β₯ 2 2 β₯ 0 d_n=\lVert X-Y_n\rVert_{2}^{2}\ge0 d n β = β₯ X β Y n β β₯ 2 2 β β₯ 0 . The display shows d m β₯ d n d_m\ge d_n d m β β₯ d n β for m β€ n m\le n m β€ n , so the set { d n : n β N } \{d_n:n\in\mathbb{N}\} { d n β : n β N } is bounded below by 0 0 0 and has a greatest lower bound L β₯ 0 L\ge0 L β₯ 0 , which exists by the least upper bound property applied to the set of lower bounds. Given a real Ξ΅ > 0 \varepsilon>0 Ξ΅ > 0 , since L + Ξ΅ 2 L+\varepsilon^{2} L + Ξ΅ 2 is not a lower bound there is N β N N\in\mathbb{N} N β N with d N < L + Ξ΅ 2 d_N<L+\varepsilon^{2} d N β < L + Ξ΅ 2 . For n , m β₯ N n,m\ge N n , m β₯ N with, say, m β€ n m\le n m β€ n , monotonicity of ( d n ) (d_n) ( d n β ) and the display give
β₯ Y n β Y m β₯ 2 2 = d m β d n β€ d N β L < Ξ΅ 2 . \lVert Y_n-Y_m\rVert_{2}^{2}=d_m-d_n\le d_N-L<\varepsilon^{2}. β₯ Y n β β Y m β β₯ 2 2 β = d m β β d n β β€ d N β β L < Ξ΅ 2 .
Hence ( Y n ) n β N (Y_n)_{n\in\mathbb{N}} ( Y n β ) n β N β is Cauchy in mean square.
Step 2: A mean-square limit measurable with respect to the limit information. Each Y n Y_n Y n β is G n \mathcal{G}_n G n β -measurable and G n β G β \mathcal{G}_n\subseteq\mathcal{G}_\infty G n β β G β β , so each Y n Y_n Y n β is G β \mathcal{G}_\infty G β β -measurable. By mean-square completeness relative to a sub-Ο \sigma Ο -algebra , applied with the sub-Ο \sigma Ο -algebra G β \mathcal{G}_\infty G β β , there exists a G β \mathcal{G}_\infty G β β -measurable square-integrable random variable Y β² Y' Y β² with β₯ Y n β Y β² β₯ 2 β 0 \lVert Y_n-Y'\rVert_{2}\to0 β₯ Y n β β Y β² β₯ 2 β β 0 .
Step 3: Y β² Y' Y β² is a conditional expectation of X X X given G β \mathcal{G}_\infty G β β . It remains to verify the averaging property (iii) of Conditional Expectation of a Square-Integrable Random Variable . For an event A β F A\in\mathcal{F} A β F the indicator 1 A \mathbf{1}_{A} 1 A β is a nonnegative simple function , hence a square-integrable random variable with β₯ 1 A β₯ 2 β€ 1 \lVert\mathbf{1}_{A}\rVert_{2}\le1 β₯ 1 A β β₯ 2 β β€ 1 .
First let A β β n G n A\in\bigcup_{n}\mathcal{G}_n A β β n β G n β , say A β G m A\in\mathcal{G}_m A β G m β . For every n β₯ m n\ge m n β₯ m we have A β G n A\in\mathcal{G}_n A β G n β , so the averaging property of Y n Y_n Y n β gives E [ X 1 A ] = E [ Y n 1 A ] \mathbb{E}[X\mathbf{1}_{A}]=\mathbb{E}[Y_n\mathbf{1}_{A}] E [ X 1 A β ] = E [ Y n β 1 A β ] . By the Cauchy-Schwarz inequality ,
β£ E [ Y n 1 A ] β E [ Y β² 1 A ] β£ = β£ E [ ( Y n β Y β² ) 1 A ] β£ β€ β₯ Y n β Y β² β₯ 2 β β₯ 1 A β₯ 2 β€ β₯ Y n β Y β² β₯ 2 βΆ 0 , \bigl|\mathbb{E}[Y_n\mathbf{1}_{A}]-\mathbb{E}[Y'\mathbf{1}_{A}]\bigr|=\bigl|\mathbb{E}[(Y_n-Y')\mathbf{1}_{A}]\bigr|\le\lVert Y_n-Y'\rVert_{2}\,\lVert\mathbf{1}_{A}\rVert_{2}\le\lVert Y_n-Y'\rVert_{2}\longrightarrow0, β E [ Y n β 1 A β ] β E [ Y β² 1 A β ] β = β E [( Y n β β Y β² ) 1 A β ] β β€ β₯ Y n β β Y β² β₯ 2 β β₯ 1 A β β₯ 2 β β€ β₯ Y n β β Y β² β₯ 2 β βΆ 0 ,
using the linearity of expectation from Linearity and Monotonicity of the Lebesgue Integral . Hence E [ Y β² 1 A ] = E [ X 1 A ] \mathbb{E}[Y'\mathbf{1}_{A}]=\mathbb{E}[X\mathbf{1}_{A}] E [ Y β² 1 A β ] = E [ X 1 A β ] for every A β β n G n A\in\bigcup_n\mathcal{G}_n A β β n β G n β .
Now extend to G β \mathcal{G}_\infty G β β by Dynkin's Ο \pi Ο -Ξ» \lambda Ξ» theorem . The family P = β n G n \mathcal{P}=\bigcup_n\mathcal{G}_n P = β n β G n β is a Ο \pi Ο -system: it is nonempty (Ξ© β G 1 \Omega\in\mathcal{G}_1 Ξ© β G 1 β ), and if A β G j A\in\mathcal{G}_j A β G j β and B β G k B\in\mathcal{G}_k B β G k β then both lie in G max β‘ ( j , k ) \mathcal{G}_{\max(j,k)} G m a x ( j , k ) β by the nondecreasing hypothesis, so A β© B β G max β‘ ( j , k ) β P A\cap B\in\mathcal{G}_{\max(j,k)}\subseteq\mathcal{P} A β© B β G m a x ( j , k ) β β P . Let
L = { A β G β : Β E [ Y β² 1 A ] = E [ X 1 A ] } . \mathcal{L}=\bigl\{A\in\mathcal{G}_\infty:\ \mathbb{E}[Y'\mathbf{1}_{A}]=\mathbb{E}[X\mathbf{1}_{A}]\bigr\}. L = { A β G β β : Β E [ Y β² 1 A β ] = E [ X 1 A β ] } .
We check that L \mathcal{L} L is a Ξ» \lambda Ξ» -system in the sense of Dynkin's Pi-Lambda Theorem . (1) Ξ© β P β L \Omega\in\mathcal{P}\subseteq\mathcal{L} Ξ© β P β L . (2) If A , B β L A,B\in\mathcal{L} A , B β L with A β B A\subseteq B A β B , then pointwise 1 B β A = 1 B β 1 A \mathbf{1}_{B\setminus A}=\mathbf{1}_{B}-\mathbf{1}_{A} 1 B β A β = 1 B β β 1 A β , and the linearity of expectation from Linearity and Monotonicity of the Lebesgue Integral (applied to the integrable products, which are integrable by Square-Integrable Random Variables and the Mean-Square Inner Product ) gives E [ Y β² 1 B β A ] = E [ Y β² 1 B ] β E [ Y β² 1 A ] = E [ X 1 B ] β E [ X 1 A ] = E [ X 1 B β A ] \mathbb{E}[Y'\mathbf{1}_{B\setminus A}]=\mathbb{E}[Y'\mathbf{1}_{B}]-\mathbb{E}[Y'\mathbf{1}_{A}]=\mathbb{E}[X\mathbf{1}_{B}]-\mathbb{E}[X\mathbf{1}_{A}]=\mathbb{E}[X\mathbf{1}_{B\setminus A}] E [ Y β² 1 B β A β ] = E [ Y β² 1 B β ] β E [ Y β² 1 A β ] = E [ X 1 B β ] β E [ X 1 A β ] = E [ X 1 B β A β ] , so B β A β L B\setminus A\in\mathcal{L} B β A β L . (3) Let ( A k ) k β N (A_k)_{k\in\mathbb{N}} ( A k β ) k β N β be a nondecreasing sequence in L \mathcal{L} L with union A A A ; note A β G β A\in\mathcal{G}_\infty A β G β β since G β \mathcal{G}_\infty G β β is a Ο \sigma Ο -algebra . The sets A 1 A_1 A 1 β and A k + 1 β A k A_{k+1}\setminus A_k A k + 1 β β A k β (k β N k\in\mathbb{N} k β N ) are pairwise disjoint with union A A A , so countable additivity of the probability measure P P P gives P ( A ) = P ( A 1 ) + β k P ( A k + 1 β A k ) P(A)=P(A_1)+\sum_{k}P(A_{k+1}\setminus A_k) P ( A ) = P ( A 1 β ) + β k β P ( A k + 1 β β A k β ) , and the partial sums telescope to P ( A k ) P(A_k) P ( A k β ) ; hence P ( A β A k ) = P ( A ) β P ( A k ) β 0 P(A\setminus A_k)=P(A)-P(A_k)\to0 P ( A β A k β ) = P ( A ) β P ( A k β ) β 0 . Since pointwise 1 A β 1 A k = 1 A β A k \mathbf{1}_{A}-\mathbf{1}_{A_k}=\mathbf{1}_{A\setminus A_k} 1 A β β 1 A k β β = 1 A β A k β β and β₯ 1 A β A k β₯ 2 2 = P ( A β A k ) \lVert\mathbf{1}_{A\setminus A_k}\rVert_{2}^{2}=P(A\setminus A_k) β₯ 1 A β A k β β β₯ 2 2 β = P ( A β A k β ) , the Cauchy-Schwarz inequality yields
β£ E [ Y β² 1 A ] β E [ Y β² 1 A k ] β£ β€ β₯ Y β² β₯ 2 β β₯ 1 A β A k β₯ 2 βΆ 0 , \bigl|\mathbb{E}[Y'\mathbf{1}_{A}]-\mathbb{E}[Y'\mathbf{1}_{A_k}]\bigr|\le\lVert Y'\rVert_{2}\,\lVert\mathbf{1}_{A\setminus A_k}\rVert_{2}\longrightarrow0, β E [ Y β² 1 A β ] β E [ Y β² 1 A k β β ] β β€ β₯ Y β² β₯ 2 β β₯ 1 A β A k β β β₯ 2 β βΆ 0 ,
and the same bound with X X X in place of Y β² Y' Y β² . Passing to the limit in E [ Y β² 1 A k ] = E [ X 1 A k ] \mathbb{E}[Y'\mathbf{1}_{A_k}]=\mathbb{E}[X\mathbf{1}_{A_k}] E [ Y β² 1 A k β β ] = E [ X 1 A k β β ] gives A β L A\in\mathcal{L} A β L . By Dynkin's Pi-Lambda Theorem , G β = Ο ( P ) β L \mathcal{G}_\infty=\sigma(\mathcal{P})\subseteq\mathcal{L} G β β = Ο ( P ) β L . Together with Step 2, Y β² Y' Y β² satisfies (i)-(iii) of Conditional Expectation of a Square-Integrable Random Variable for the sub-Ο \sigma Ο -algebra G β \mathcal{G}_\infty G β β , so Y β² Y' Y β² is a conditional expectation of X X X given G β \mathcal{G}_\infty G β β .
Step 4: Conclusion. By the uniqueness assertion of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables , P ( Y β = Y β² ) = 1 P(Y_\infty=Y')=1 P ( Y β β = Y β² ) = 1 , and then β₯ Y β² β Y β β₯ 2 = 0 \lVert Y'-Y_\infty\rVert_{2}=0 β₯ Y β² β Y β β β₯ 2 β = 0 by the null-equivalence statement of Square-Integrable Random Variables and the Mean-Square Inner Product . The triangle inequality gives
β₯ Y n β Y β β₯ 2 β€ β₯ Y n β Y β² β₯ 2 + β₯ Y β² β Y β β₯ 2 = β₯ Y n β Y β² β₯ 2 βΆ 0 , \lVert Y_n-Y_\infty\rVert_{2}\le\lVert Y_n-Y'\rVert_{2}+\lVert Y'-Y_\infty\rVert_{2}=\lVert Y_n-Y'\rVert_{2}\longrightarrow0, β₯ Y n β β Y β β β₯ 2 β β€ β₯ Y n β β Y β² β₯ 2 β + β₯ Y β² β Y β β β₯ 2 β = β₯ Y n β β Y β² β₯ 2 β βΆ 0 ,
which is the asserted limit. β \blacksquare β