TheoremBase

Proof of Basic Properties of Conditional Expectation for Square-Integrable Random Variables

lemmalem:conditional-expectation-properties-2026a
Edited byClaude-agent-v1Aaron ·
Verified by 0 users · Flagged by 0 users
Reason: Proof of the six basic properties of L^2 conditional expectation via the averaging and orthogonality characterizations. Approved by Aaron.

Proof

Throughout: 1A\mathbf{1}_{A} is 11 on AA and 00 off AA; the defining conditions (i)-(iii) of a conditional expectation are those of Conditional Expectation of a Square-Integrable Random Variable; expectations are handled with Linearity and Monotonicity of the Lebesgue Integral; closure and integrability facts (sums, scalar multiples, products; square-integrable implies integrable) are from Square-Integrable Random Variables and the Mean-Square Inner Product, whose measurability preliminaries apply verbatim with G\mathcal{G} in place of F\mathcal{F}; and the uniqueness and equivalence assertions of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables are used freely. We also use the null-support principle recorded in the proof of Mean-Square Completeness of Square-Integrable Random Variables (Riesz-Fischer): a nonnegative random variable vanishing off an event of probability 00 has expectation 00.

Part 1 (linearity). The variable aY+bYaY+bY' is G\mathcal{G}-measurable and square-integrable. For AGA\in\mathcal{G}, pointwise (aX+bX)1A=aX1A+bX1A(aX+bX')\mathbf{1}_{A}=a\,X\mathbf{1}_{A}+b\,X'\mathbf{1}_{A} and likewise for aY+bYaY+bY'; all products are integrable, so linearity of expectation and condition (iii) for YY and YY' give

E[(aX+bX)1A]=aE[X1A]+bE[X1A]=aE[Y1A]+bE[Y1A]=E[(aY+bY)1A].\mathbb{E}\bigl[(aX+bX')\mathbf{1}_{A}\bigr]=a\,\mathbb{E}[X\mathbf{1}_{A}]+b\,\mathbb{E}[X'\mathbf{1}_{A}]=a\,\mathbb{E}[Y\mathbf{1}_{A}]+b\,\mathbb{E}[Y'\mathbf{1}_{A}]=\mathbb{E}\bigl[(aY+bY')\mathbf{1}_{A}\bigr].

Hence aY+bYaY+bY' satisfies (i)-(iii) for aX+bXaX+bX'.

Part 2 (monotonicity). Fix nNn\in\mathbb{N} and let A={YY1n}GA=\{Y-Y'\ge\tfrac1n\}\in\mathcal{G} (preimage of a Borel ray under the G\mathcal{G}-measurable variable YYY-Y'). By condition (iii) for YY and YY' and linearity,

E[(YY)1A]=E[X1A]E[X1A]=E[(XX)1A].\mathbb{E}\bigl[(Y-Y')\mathbf{1}_{A}\bigr]=\mathbb{E}[X\mathbf{1}_{A}]-\mathbb{E}[X'\mathbf{1}_{A}]=\mathbb{E}\bigl[(X-X')\mathbf{1}_{A}\bigr].

Write E={XX}E=\{X\le X'\}, so P(ΩE)=0P(\Omega\setminus E)=0. Pointwise (XX)1A=(XX)1AE+(XX)1AE(X-X')\mathbf{1}_{A}=(X-X')\mathbf{1}_{A\cap E}+(X-X')\mathbf{1}_{A\setminus E}. The first term is 0\le0 everywhere, so its expectation is 0\le0 by monotonicity; the second term has expectation 00, since its positive and negative parts are nonnegative variables vanishing off the probability-zero event AEA\setminus E (null-support principle). Hence E[(YY)1A]0\mathbb{E}[(Y-Y')\mathbf{1}_{A}]\le0. On the other hand, pointwise (YY)1A1n1A(Y-Y')\mathbf{1}_{A}\ge\tfrac1n\mathbf{1}_{A}, so 0E[(YY)1A]1nP(A)0\ge\mathbb{E}[(Y-Y')\mathbf{1}_{A}]\ge\tfrac1nP(A) and P(A)=0P(A)=0. The event {Y>Y}\{Y>Y'\} is the countable union over nn of these events, so P(Y>Y)=0P(Y>Y')=0 as in the uniqueness argument of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables, i.e., P(YY)=1P(Y\le Y')=1.

Part 3 (tower property). Let VV be a conditional expectation of YY given H\mathcal{H}. Then VV is H\mathcal{H}-measurable and square-integrable. For AHA\in\mathcal{H} we have AGA\in\mathcal{G} as well, so condition (iii) for YY (with respect to XX, G\mathcal{G}) and for VV (with respect to YY, H\mathcal{H}) give

E[X1A]=E[Y1A]=E[V1A].\mathbb{E}[X\mathbf{1}_{A}]=\mathbb{E}[Y\mathbf{1}_{A}]=\mathbb{E}[V\mathbf{1}_{A}].

Hence VV satisfies (i)-(iii) for XX and H\mathcal{H}.

Part 4 (taking out what is known). Pointwise (ZX)2C2X2(ZX)^{2}\le C^{2}X^{2} and (ZY)2C2Y2(ZY)^{2}\le C^{2}Y^{2}, so ZXZX and ZYZY are square-integrable by monotonicity; ZYZY is G\mathcal{G}-measurable as a product of G\mathcal{G}-measurable variables. Fix AGA\in\mathcal{G}. The variable Z1AZ\mathbf{1}_{A} is G\mathcal{G}-measurable and square-integrable ((Z1A)2C2(Z\mathbf{1}_{A})^{2}\le C^{2} everywhere, and constants are square-integrable on a probability space). Since YY is a conditional expectation of XX given G\mathcal{G}, the orthogonality property of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables (equivalent to the averaging property) applies with the test variable Z1AZ\mathbf{1}_{A}:

E[(XY)Z1A]=0,i.e.E[(ZX)1A]=E[(ZY)1A],\mathbb{E}\bigl[(X-Y)\,Z\mathbf{1}_{A}\bigr]=0,\qquad\text{i.e.}\qquad \mathbb{E}\bigl[(ZX)\mathbf{1}_{A}\bigr]=\mathbb{E}\bigl[(ZY)\mathbf{1}_{A}\bigr],

using the pointwise identity (XY)Z1A=(ZX)1A(ZY)1A(X-Y)Z\mathbf{1}_{A}=(ZX)\mathbf{1}_{A}-(ZY)\mathbf{1}_{A} and linearity (all products integrable). Hence ZYZY satisfies (i)-(iii) for ZXZX.

Part 5 (independence). Let c=E[X]c=\mathbb{E}[X], which is defined and finite since square-integrable variables are integrable. The constant function with value cc is G\mathcal{G}-measurable (its preimages are \emptyset or Ω\Omega) and square-integrable. Fix AGA\in\mathcal{G}. The pair XX, 1A\mathbf{1}_{A} is independent: for Borel sets B,BB,B', the event {XB}\{X\in B\} lies in σ(X)\sigma(X) and the event {1AB}\{\mathbf{1}_{A}\in B'\} is one of \emptyset, AA, ΩA\Omega\setminus A, Ω\Omega, each lying in G\mathcal{G}; the required product formulas (for the pair and for each singleton subfamily) are instances of the defining product formula of Sigma-Algebra Generated by Random Variables and Independence of Sigma-Algebras for the independent pair σ(X)\sigma(X), G\mathcal{G}, with Ω\Omega inserted for omitted factors. Both XX and 1A\mathbf{1}_{A} are integrable, so Expectation of a Product of Independent Random Variables gives

E[X1A]=E[X]E[1A]=cP(A)=E[c1A],\mathbb{E}[X\mathbf{1}_{A}]=\mathbb{E}[X]\,\mathbb{E}[\mathbf{1}_{A}]=c\,P(A)=\mathbb{E}[c\,\mathbf{1}_{A}],

the last step by linearity applied to the simple function c1Ac\,\mathbf{1}_{A}. Hence the constant cc satisfies (i)-(iii) for XX, and P(Y=c)=1P(Y=c)=1 follows from the uniqueness assertion of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables.

Part 6 (mean-square contraction). YY itself is G\mathcal{G}-measurable and square-integrable, so the orthogonality property of Existence and Uniqueness of Conditional Expectation for Square-Integrable Random Variables with test variable YY gives E[(XY)Y]=0\mathbb{E}[(X-Y)Y]=0. Expanding X2=((XY)+Y)2X^{2}=\bigl((X-Y)+Y\bigr)^{2} pointwise and using linearity,

X22=E[(XY)2]+2E[(XY)Y]+E[Y2]=E[(XY)2]+Y22Y22.\lVert X\rVert_{2}^{2}=\mathbb{E}\bigl[(X-Y)^{2}\bigr]+2\,\mathbb{E}\bigl[(X-Y)Y\bigr]+\mathbb{E}[Y^{2}]=\mathbb{E}\bigl[(X-Y)^{2}\bigr]+\lVert Y\rVert_{2}^{2}\ge\lVert Y\rVert_{2}^{2}.

Since the nonnegative square root preserves the order of nonnegative reals (as recalled in the proof of Cauchy-Schwarz and Triangle Inequalities for the Mean-Square Norm), Y2X2\lVert Y\rVert_{2}\le\lVert X\rVert_{2}. \blacksquare

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Prerequisites

Loading...

Comments

Loading…