Each result cited below is universally quantified over the data in its own statement. The following facts are used throughout.
(Alg) By Cyclic Tracial Operator Algebras and Their Traces §star-algebra, A⊆L(H) contains I and is closed under sums, scalar multiples, products and adjoints.
(Adj) Let S,T∈L(H) and c∈C. By Bounded Linear Maps between Complex Inner Product Spaces: the Least Bound, Operations, the Underlying Real Structure, Adjoints, Completeness and the Quadratic-Form Bound §adjoint, S has an adjoint S∗∈L(H), with ⟨S∗η,ξ⟩=⟨η,Sξ⟩ (Adjoint of a Linear Map between Complex Inner Product Spaces §adjoint). By Bounded Linear Maps between Complex Inner Product Spaces: the Least Bound, Operations, the Underlying Real Structure, Adjoints, Completeness and the Quadratic-Form Bound §adjoint-calculus and Bounded Linear Maps between Complex Inner Product Spaces: the Least Bound, Operations, the Underlying Real Structure, Adjoints, Completeness and the Quadratic-Form Bound §adjoint-unique, (S∗)∗=S, so ⟨Sη,ξ⟩=⟨η,S∗ξ⟩; moreover (S+T)∗=S∗+T∗, (cS)∗=cS∗, (ST)∗=T∗S∗, I∗=I, and ⟨ξ,S∗Sξ⟩=∥Sξ∥2.
(Dense) Put D=AΩ. We have SΩ+TΩ=(S+T)Ω, c(SΩ)=(cS)Ω and 0=(0I)Ω. By (Alg), D is therefore a linear subspace of H, and it is dense in H by Cyclic Tracial Operator Algebras and Their Traces §cyclic.
Proof of clause 1 (Trace). Recall τ(S)=⟨Ω,SΩ⟩ (Cyclic Tracial Operator Algebras and Their Traces §trace). Linearity of τ follows from conditions 2 and 3 of Complex Inner Product Space: τ(S+T)=⟨Ω,SΩ+TΩ⟩=τ(S)+τ(T) and τ(cS)=cτ(S). Next, τ(I)=⟨Ω,Ω⟩=∥Ω∥2=1 by Cyclic Tracial Operator Algebras and Their Traces §cyclic. The identity τ(ST)=τ(TS) is Cyclic Tracial Operator Algebras and Their Traces §tracial. By condition 1 of Complex Inner Product Space and (Adj), τ(S∗)=⟨Ω,S∗Ω⟩=⟨S∗Ω,Ω⟩=⟨Ω,SΩ⟩=τ(S). By (Adj), τ(S∗S)=⟨Ω,S∗SΩ⟩=∥SΩ∥2. Since S∗∈A, the last identity applied to S∗, together with (S∗)∗=S and traciality, gives
∥S∗Ω∥2=τ(SS∗)=τ(S∗S)=∥SΩ∥2.
Both norms are nonnegative, so ∥S∗Ω∥=∥SΩ∥ by Existence and Uniqueness of the Nonnegative Square Root.
Proof of clause 2 (Separation). Let S∈A with SΩ=0, and let T,U∈A. By (Adj), (Alg) and traciality,
⟨UΩ,S(TΩ)⟩=⟨Ω,U∗STΩ⟩=τ((U∗S)T)=τ(T(U∗S))=⟨Ω,TU∗(SΩ)⟩=0,
since the linear map TU∗ sends 0 to 0. Thus ⟨η,Sξ⟩=⟨η,0ξ⟩ for all ξ,η in the dense linear subspace D. By Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §equality, applied with K=H and E=D, S=0.
Now let T∈A′ with TΩ=0. For S∈A, T(SΩ)=S(TΩ)=S0=0 by The Commutant of a Set of Bounded Operators on a Complex Hilbert Space §commutant. So T and 0, both in L(H), agree on D, and T=0 by the final sentence of Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §equality.
Finally, if S∈A and τ(S∗S)=0, then ∥SΩ∥2=0 by clause 1. Hence SΩ=0 by condition 4 of Complex Inner Product Space, and S=0 by the first part.
Proof of clause 3 (Conjugation). The map on D. Define J0:D→H by J0(SΩ)=S∗Ω for S∈A. This is well defined. If S,S′∈A satisfy SΩ=S′Ω, then (S−S′)Ω=0 with S−S′∈A, so clause 1 gives ∥(S−S′)∗Ω∥=∥(S−S′)Ω∥=0. By (Adj), (S−S′)∗=S∗−S′∗, hence S∗Ω=S′∗Ω. For S,T∈A and c∈C, (Adj) gives
J0(SΩ+TΩ)=(S+T)∗Ω=J0(SΩ)+J0(TΩ),J0(cSΩ)=(cS)∗Ω=cJ0(SΩ),
and ∥J0(SΩ)∥=∥SΩ∥ by clause 1. By Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §conjugate-linear, applied with K=H and C=1, there is a unique continuous J:H→H extending J0. It is additive, satisfies J(cξ)=cJξ, and satisfies ∥Jξ∥=∥ξ∥ for all ξ∈H. By construction J(SΩ)=S∗Ω for S∈A.
Involution. For ξ,η∈H and c∈C, J(J(ξ+η))=J(Jξ+Jη)=J(Jξ)+J(Jη) and J(J(cξ))=J(cJξ)=cJ(Jξ), by claim 1 of Properties of Complex Conjugation and Modulus. Also ∥J(Jξ)∥=∥ξ∥. So J∘J is linear with bound 1 and lies in L(H) (Bounded Linear Maps between Complex Normed Spaces and the Operator Norm §bounded). For S∈A we have S∗∈A, so J(J(SΩ))=J(S∗Ω)=(S∗)∗Ω=SΩ. So J∘J and I agree on D, and J∘J=I by Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §equality.
The inner product identity. For S,T∈A, (Adj), (Alg) and traciality give
⟨J(SΩ),J(TΩ)⟩=⟨S∗Ω,T∗Ω⟩=⟨Ω,ST∗Ω⟩=τ(ST∗)=τ(T∗S)=⟨TΩ,SΩ⟩.
We extend this identity to all of H by continuity. First, if ak→a and bk→b in H, then ⟨ak,bk⟩→⟨a,b⟩ in C. Indeed, sesquilinearity (conditions 2 and 3 of Complex Inner Product Space, claims 1 and 2 of Elementary Properties of a Complex Inner Product) gives ⟨ak,bk⟩−⟨a,b⟩=⟨ak−a,bk−b⟩+⟨ak−a,b⟩+⟨a,bk−b⟩. So by claim 1 of The Induced Norm is a Norm, and Induces a Metric and claim 7 of Properties of Complex Conjugation and Modulus,
∣⟨ak,bk⟩−⟨a,b⟩∣≤∥ak−a∥∥bk−b∥+∥ak−a∥∥b∥+∥a∥∥bk−b∥.
Given ε>0, put M=∥a∥+∥b∥+1. Once ∥ak−a∥ and ∥bk−b∥ are below both 1 and ε/(3M), each term is below ε/3.
Now let ξ,η∈H, and use (Dense), Dense Subset of a Topological Space and Sequential Characterization of the Closure in a Metric Space to choose sequences (ξk),(ηk) in D converging to ξ,η. Then ∥Jξk−Jξ∥=∥J(ξk−ξ)∥=∥ξk−ξ∥, so Jξk→Jξ, and likewise Jηk→Jη. By the continuity just shown, ⟨Jξk,Jηk⟩→⟨Jξ,Jη⟩ and ⟨ηk,ξk⟩→⟨η,ξ⟩. These are the same sequence by the identity on D. So ⟨Jξ,Jη⟩=⟨η,ξ⟩ by Uniqueness of Limits in a Metric Space. Hence J is a conjugation of H (Conjugation of a Complex Hilbert Space §conjugation) with J(SΩ)=S∗Ω for S∈A.
Uniqueness. Let J′ be any conjugation of H with J′(SΩ)=S∗Ω for S∈A. Then ∥J′ξ∥2=⟨J′ξ,J′ξ⟩=⟨ξ,ξ⟩=∥ξ∥2, so ∥J′ξ∥=∥ξ∥ (Norm Induced by a Complex Inner Product). Additivity and conjugate homogeneity with −1=−1 give J′ξ−J′η=J′(ξ−η), hence ∥J′ξ−J′η∥=∥ξ−η∥. So δ=ε meets Continuous Map Between Metric Spaces, and J′ is continuous on H. It extends J0, so J′=J by the uniqueness in Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §conjugate-linear. Finally JΩ=J(IΩ)=I∗Ω=Ω by (Adj).
Proof of clause 4 (Right action). Let S∈A. Since S∈L(H) and J is a conjugation, JSJ∈L(H) by Basic Properties of Commutants: Unital Algebras Closed under Weak Limits, Order Reversal, the Triple Commutant, and Conjugation §conjugation. For T∈A we have T∗,ST∗∈A by (Alg), so clause 3 and (Adj) give
JSJ(TΩ)=J(S(T∗Ω))=J((ST∗)Ω)=(ST∗)∗Ω=(T∗)∗S∗Ω=TS∗Ω.
Now let U∈A. For every T∈A, UT∈A, so by the formula just proved
(JSJ)U(TΩ)=JSJ((UT)Ω)=UTS∗Ω=U(JSJ(TΩ)).
Thus (JSJ)U and U(JSJ), both in L(H) by Bounded Linear Maps between Complex Inner Product Spaces: the Least Bound, Operations, the Underlying Real Structure, Adjoints, Completeness and the Quadratic-Form Bound §operations, agree on D. By Bounded Linear and Conjugate-Linear Maps on a Dense Subspace of a Complex Hilbert Space Extend Uniquely §equality, (JSJ)U=U(JSJ). As U∈A was arbitrary, JSJ∈A′ by The Commutant of a Set of Bounded Operators on a Complex Hilbert Space §commutant.