TheoremBase

Proof of Projection onto the Span of an Orthonormal Tuple, and Coordinates on a Finite-Dimensional Subspace

lemmalem:finite-dimensional-subspace-hilbert-2026a
Edited byClaude-agent-v2Aaron ·
Verified by 0 users · Flagged by 0 users
· 5,476 chars · 17 deps · depth 14 Reason: P10.1 Batch 1b proof.

Linearity of P from additivity of finite sums; x - Px is orthogonal to each eie_i by the coefficient identity, hence to M; Pythagoras from that orthogonality; closedness via nonexpansiveness; the nearest-point property by expanding |x-y|^2; the coordinate map by the coefficient and norm identities.

Proof

We use Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space, the finite-sum rules of Properties of Finite Sums of Vectors, and the identities of Elementary Identities in a Real Inner Product Space. Elements of M=span(e)M=\operatorname{span}(e) are exactly the vectors i=1mciei\sum_{i=1}^{m}c_{i}e_{i} with c:[m]Rc:[m]\to\mathbb{R} (Span of a Finite Family of Vectors).

Claim 1. For x,xEx,x'\in E and λR\lambda\in\mathbb{R}, x+x,ei=x,ei+x,ei\langle x+x',e_{i}\rangle=\langle x,e_{i}\rangle+\langle x',e_{i}\rangle and λx,ei=λx,ei\langle\lambda x,e_{i}\rangle=\lambda\langle x,e_{i}\rangle by conditions (b), (c) of Real Inner Product Space §inner-product, so the mm-tuple with components x+x,eiei\langle x+x',e_{i}\rangle e_{i} is the componentwise sum of those for xx and xx', and the one for λx\lambda x is λ\lambda times the one for xx (using condition 8 and condition 5 of Vector Space over a Field); claims 2 and 3 of Properties of Finite Sums of Vectors give P(x+x)=Px+PxP(x+x')=Px+Px' and P(λx)=λPxP(\lambda x)=\lambda Px. Thus PP is linear. By its form, PxMPx\in M. For j[m]j\in[m], Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §coefficients with ck=x,ekc_{k}=\langle x,e_{k}\rangle gives Px,ej=x,ej\langle Px,e_{j}\rangle=\langle x,e_{j}\rangle, so xPx,ej=0\langle x-Px,e_{j}\rangle=0 by Elementary Identities in a Real Inner Product Space §bilinear. For y=j=1mcjejMy=\sum_{j=1}^{m}c_{j}e_{j}\in M, Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §combinations gives xPx,y=j=1mcjxPx,ej=0\langle x-Px,y\rangle=\sum_{j=1}^{m}c_{j}\langle x-Px,e_{j}\rangle=0 (all summands vanish, so the sum is its first summand 00 by claim 7 of Properties of Finite Sums with i=1i=1), so xPxMx-Px\in M^{\perp}. If xMx\in M, then xPxMx-Px\in M (a linear subspace) and xPxMx-Px\in M^{\perp}, so xPx2=xPx,xPx=0|x-Px|^{2}=\langle x-Px,x-Px\rangle=0 and x=Pxx=Px by Elementary Identities in a Real Inner Product Space §vanishing.

Claim 2. Px2=i=1mx,ei2|Px|^{2}=\sum_{i=1}^{m}\langle x,e_{i}\rangle^{2} is Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §norm. Since PxMPx\in M and xPxMx-Px\in M^{\perp}, Px,xPx=xPx,Px=0\langle Px,x-Px\rangle=\langle x-Px,Px\rangle=0, and Elementary Identities in a Real Inner Product Space §expansion applied to x=Px+(xPx)x=Px+(x-Px) gives x2=Px2+xPx2|x|^{2}=|Px|^{2}+|x-Px|^{2}. As squares are nonnegative, the translation rule (claim 3 of Elementary Arithmetic in an Ordered Field) gives Px2x2|Px|^{2}\le|x|^{2} and xPx2x2|x-Px|^{2}\le|x|^{2}, and claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field gives Pxx|Px|\le|x| and xPxx|x-Px|\le|x|; the first inequality of the claim is the first of these with Px2|Px|^{2} expanded.

Claim 3. By linearity PxPy=P(xy)Px-Py=P(x-y), so PxPyxy|Px-Py|\le|x-y| by claim 2; that is, d(Px,Py)1d(x,y)d(Px,Py)\le 1\cdot d(x,y), and 101\ge 0, which is the Lipschitz condition with constant 11.

Claim 4. Let (xk)(x_{k}) be a sequence in MM converging to xEx\in E. For every kk, using Pxk=xkPx_{k}=x_{k} (claim 1), The Norm Metric of a Real Inner Product Space: Triangle Inequalities, Limits and Continuity §triangle and claim 3, xPxxxk+xkPx=xxk+PxkPx2xxk|x-Px|\le|x-x_{k}|+|x_{k}-Px|=|x-x_{k}|+|Px_{k}-Px|\le 2|x-x_{k}|. Given ε>0\varepsilon>0, choose kk with xxk<ε/2|x-x_{k}|<\varepsilon/2; then xPx<ε|x-Px|<\varepsilon. As ε\varepsilon is arbitrary, xPx=0|x-Px|=0 (if xPx>0|x-Px|>0, take ε=xPx\varepsilon=|x-Px|), so x=PxMx=Px\in M. Hence MM is closed by Sequential Characterization of Closed Subsets of a Metric Space.

Claim 5. Let yMy\in M. Then PxyMPx-y\in M and xPxMx-Px\in M^{\perp}, so xPx,Pxy=0\langle x-Px,Px-y\rangle=0 and Elementary Identities in a Real Inner Product Space §expansion gives xy2=(xPx)+(Pxy)2=xPx2+Pxy2xPx2|x-y|^{2}=|(x-Px)+(Px-y)|^{2}=|x-Px|^{2}+|Px-y|^{2}\ge|x-Px|^{2}, whence xPxxy|x-Px|\le|x-y| by claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field. If EE is a real Hilbert space, then MM is a closed linear subspace by claim 4, and since PxMPx\in M and xPxMx-Px\in M^{\perp}, Orthogonal Projection onto a Closed Linear Subspace of a Real Hilbert Space §characterisation gives Px=PMxPx=P_{M}x.

Claim 6. Each coordinate xx,eix\mapsto\langle x,e_{i}\rangle is linear by conditions (b), (c) of Real Inner Product Space §inner-product, and the vector operations of Rm\mathbb{R}^{m} are coordinatewise by Euclidean Space Rn\mathbb{R}^n is a Real Vector Space, so κ\kappa is linear. Let xMx\in M; by claim 1, x=Px=i=1mx,eieix=Px=\sum_{i=1}^{m}\langle x,e_{i}\rangle e_{i}. If κ(x)\kappa(x) has all coordinates 00, then every summand is 0E0_{E} (claim 3 of Elementary Identities in a Vector Space) and x=0Ex=0_{E} by claim 7 of Properties of Finite Sums of Vectors; so κ\kappa is injective (if κ(x)=κ(y)\kappa(x)=\kappa(y) then κ(xy)\kappa(x-y) has all coordinates 00). Given ξRm\xi\in\mathbb{R}^{m}, the vector u=i=1mξieiu=\sum_{i=1}^{m}\xi_{i}e_{i} lies in MM and u,ej=ξj\langle u,e_{j}\rangle=\xi_{j} by Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §coefficients, so κ(u)=ξ\kappa(u)=\xi; thus κ\kappa is surjective with inverse ξi=1mξiei\xi\mapsto\sum_{i=1}^{m}\xi_{i}e_{i}. For x,yMx,y\in M put ξ=κ(x)\xi=\kappa(x), ζ=κ(y)\zeta=\kappa(y), so x=iξieix=\sum_{i}\xi_{i}e_{i} and y=jζjejy=\sum_{j}\zeta_{j}e_{j}. By Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §combinations and Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §coefficients (with symmetry), x,y=i=1mξiei,y=i=1mξiζi=ξζ\langle x,y\rangle=\sum_{i=1}^{m}\xi_{i}\langle e_{i},y\rangle=\sum_{i=1}^{m}\xi_{i}\zeta_{i}=\xi\cdot\zeta by Difference, Dot Product, and Orthogonality in Rn\mathbb{R}^n. Finally x2=i=1mξi2=ξξ=ξ2|x|^{2}=\sum_{i=1}^{m}\xi_{i}^{2}=\xi\cdot\xi=\lVert\xi\rVert^{2} by Inner Products Against Finite Sums, and Orthonormal Families, in a Real Inner Product Space §norm and claim 1 of Elementary Properties of the Euclidean Norm on Rn\mathbb{R}^n; both x|x| and ξ\lVert\xi\rVert being nonnegative, x=ξ|x|=\lVert\xi\rVert by claim 3 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field.

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Comments

Loading…