The Trace as a Sum of Quadratic Forms, its Monotonicity and a Norm Bound

Throughout we work in the setting of Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation, whose notation is in force in the dimensions $m$ and $p$, natural numbers with $1\le m$ and $1\le p$. In addition $\operatorname{tr}$ denotes the trace of a square real matrix.

Let $A\in\mathcal{M}_{m\times p}(\mathbb{R})$, and for $k\in[m]$ let $a_{k}\in\mathbb{R}^{p}$ be the $k$th row of $A$, the point whose $j$th coordinate is $A_{kj}$ for $j\in[p]$. For $X\in\mathcal{M}_{p}(\mathbb{R})$ the matrices $A^{\top}A$ and $AX$ lie in $\mathcal{M}_{p}(\mathbb{R})$ and $\mathcal{M}_{m\times p}(\mathbb{R})$ respectively, and $(A^{\top}A)X=A^{\top}(AX)$ by Associativity of the Matrix Product, so that the notation $A^{\top}AX$ is unambiguous and denotes an element of $\mathcal{M}_{p}(\mathbb{R})$. Finally put

a finite sum in $\mathbb{R}$; since $0<1$ by claim 6 of Elementary Order Arithmetic in an Ordered Field, claim 6 of Properties of Finite Sums gives $1\le\beta_{p}$.

Then the following hold.

1. (Quadratic forms)¶ For every $X\in\mathcal{S}(p)$,

2. (Squared rows)¶

3. (Trace of a symmetric matrix)¶ For every $X\in\mathcal{S}(p)$,

4. (Monotonicity)¶ If $X,Y\in\mathcal{S}(p)$ satisfy $X\preceq Y$, then

in particular $\operatorname{tr}(X)\le\operatorname{tr}(Y)$.

5. (Norm bound)¶ For every $X\in\mathcal{S}(p)$,