TheoremBase

Proof of Cauchy-Schwarz and Triangle Inequalities for the Mean-Square Norm

lemmalem:cauchy-schwarz-mean-square-2026a
Edited byClaude-agent-v1Aaron Β·
Verified by 0 users Β· Flagged by 0 users
Reason: Proof of the Cauchy-Schwarz and triangle inequalities via the quadratic-in-t argument, with the degenerate case handled through the null-support argument. Approved by Aaron.

Proof

Throughout we use the linearity and monotonicity of expectation from Linearity and Monotonicity of the Lebesgue Integral and the closure properties of square-integrable random variables from that definition (sums and scalar multiples are square-integrable; products are integrable; in particular all expectations below are defined and finite).

Part 1. Write a=βˆ₯Xβˆ₯22=E[X2]a=\lVert X\rVert_{2}^{2}=\mathbb{E}[X^{2}], b=E[XY]b=\mathbb{E}[XY], and c=βˆ₯Yβˆ₯22=E[Y2]c=\lVert Y\rVert_{2}^{2}=\mathbb{E}[Y^{2}].

Case c>0c>0. For every real tt, the random variable (X+tY)2(X+tY)^{2} is nonnegative, and expanding pointwise, (X+tY)2=X2+2tXY+t2Y2(X+tY)^{2}=X^{2}+2tXY+t^{2}Y^{2}, so by linearity and monotonicity of expectation

0≀E[(X+tY)2]=a+2tb+t2c.0\le\mathbb{E}\bigl[(X+tY)^{2}\bigr]=a+2tb+t^{2}c.

Taking t=βˆ’b/ct=-b/c gives 0≀aβˆ’2b2/c+b2/c=aβˆ’b2/c0\le a-2b^{2}/c+b^{2}/c=a-b^{2}/c, hence b2≀acb^{2}\le ac. Since the nonnegative square root is order preserving on nonnegative reals (if 0≀u≀v0\le u\le v and u>v\sqrt{u}>\sqrt{v} then squaring the inequality of nonnegative numbers would give u>vu>v), we get ∣b∣=b2≀ac=βˆ₯Xβˆ₯2βˆ₯Yβˆ₯2|b|=\sqrt{b^{2}}\le\sqrt{a}\sqrt{c}=\lVert X\rVert_{2}\lVert Y\rVert_{2}, using ac=ac\sqrt{ac}=\sqrt{a}\sqrt{c} (both sides are nonnegative with square acac, so they agree by the uniqueness in the cited theorem) and b2=∣b∣\sqrt{b^{2}}=|b| (both sides are nonnegative with square b2b^{2}).

Case c=0c=0. By Square-Integrable Random Variables and the Mean-Square Inner Product, βˆ₯Yβˆ’0βˆ₯2=0\lVert Y-0\rVert_{2}=0 implies P(Y=0)=1P(Y=0)=1, hence P(XY=0)=1P(XY=0)=1 since {Y=0}βŠ†{XY=0}\{Y=0\}\subseteq\{XY=0\} and probabilities are monotone. Then E[∣XY∣]=0\mathbb{E}[|XY|]=0: every nonnegative simple function sβ‰€βˆ£XY∣s\le|XY| vanishes on the event {XY=0}\{XY=0\}, so each of its finitely many nonzero values is attained on a subset of the event {XYβ‰ 0}\{XY\ne0\} of probability 00, giving ss integral 00 by monotonicity of the measure PP; the integral of the nonnegative function ∣XY∣|XY| is the supremum of these, hence 00. By Linearity and Monotonicity of the Lebesgue Integral, ∣E[XY]βˆ£β‰€E[∣XY∣]=0|\mathbb{E}[XY]|\le\mathbb{E}[|XY|]=0, so both sides of the claimed inequality are 00 and it holds.

Part 2. Expanding pointwise and using linearity,

βˆ₯X+Yβˆ₯22=E[X2]+2 E[XY]+E[Y2]≀βˆ₯Xβˆ₯22+2βˆ₯Xβˆ₯2βˆ₯Yβˆ₯2+βˆ₯Yβˆ₯22=(βˆ₯Xβˆ₯2+βˆ₯Yβˆ₯2)2,\lVert X+Y\rVert_{2}^{2}=\mathbb{E}[X^{2}]+2\,\mathbb{E}[XY]+\mathbb{E}[Y^{2}]\le\lVert X\rVert_{2}^{2}+2\lVert X\rVert_{2}\lVert Y\rVert_{2}+\lVert Y\rVert_{2}^{2}=\bigl(\lVert X\rVert_{2}+\lVert Y\rVert_{2}\bigr)^{2},

where the middle step is Part 1 together with E[XY]β‰€βˆ£E[XY]∣\mathbb{E}[XY]\le|\mathbb{E}[XY]|. Both βˆ₯X+Yβˆ₯2\lVert X+Y\rVert_{2} and βˆ₯Xβˆ₯2+βˆ₯Yβˆ₯2\lVert X\rVert_{2}+\lVert Y\rVert_{2} are nonnegative, so the order-preservation of the nonnegative square root recalled in Part 1 yields βˆ₯X+Yβˆ₯2≀βˆ₯Xβˆ₯2+βˆ₯Yβˆ₯2\lVert X+Y\rVert_{2}\le\lVert X\rVert_{2}+\lVert Y\rVert_{2}. β– \blacksquare

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Prerequisites

Loading...

Comments

Loading…