Each result cited is applied with the data of its own statement. Throughout, R>0 is the wall radius of The Discounted Hamilton-Jacobi-Bellman Equation with Free Langevin Noise in a Wall on Noncommutative Laws: Standing Notation §parameters, N={1,2,3,…} as in Natural Numbers, and ι=ιR:N→R is the canonical map of The Canonical Map from the Natural Numbers to a Field. For m∈N we have 0<ι(m) by claim 3 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field, so the inverse ι(m)−1 exists and is positive by claim 7 of Elementary Order Arithmetic in an Ordered Field; we write 1/m:=ι(m)−1, a positive real number. Moreover, for m,n∈N with m≤n we have ι(m)≤ι(n): by Order on the Natural Numbers, m≤n means m<n or m=n; in the first case ι(m)<ι(n) by claim 6 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field, and in the second ι(m)=ι(n). For reals δ≥0 and α>0 let V(δ,α)={Ψδ,α(μ,ν): (μ,ν)∈D×D}, so that S(δ,α)=supV(δ,α).
Step 1 (Preliminaries). (a) By The Discounted Hamilton-Jacobi-Bellman Equation with Free Langevin Noise in a Wall on Noncommutative Laws: Standing Notation §free-energy, D and E are the domain and the energy of The Wall-Confined Free Energy: Norm Bound, Lower Bound, Weak-Star Compact Sublevel Sets and Displacement Monotonicity of the Score for the free entropy penalty (D0,E0) and the radius R. Hence D⊆Σd,R by The Wall-Confined Free Energy: Norm Bound, Lower Bound, Weak-Star Compact Sublevel Sets and Displacement Monotonicity of the Score §bounds, and Σd,R⊆Σd by Noncommutative Laws of Finitely Many Self-Adjoint Variables with a Norm Bound §law.
(b) For μ,ν∈D the number W2(μ,ν) is a nonnegative square root by The Noncommutative Quadratic Wasserstein Distance and Optimal Couplings §distance, so W2(μ,ν)≥0, and then 0=W2(μ,ν)⋅0≤W2(μ,ν)⋅W2(μ,ν)=W2(μ,ν)2 by claim 1 of Zero Products and Elementary Identities in a Field and claim 5 of Elementary Arithmetic in an Ordered Field. In the same way, whenever 0≤a and 0≤x are reals, 0=a⋅0≤ax by these two claims; we use this below for products of nonnegative factors.
(c) If a real sequence (xk)k∈N converges to L and (kj)j∈N is strictly increasing in N, then (xkj)j∈N converges to L: given ε>0, take N as in Limit of a Sequence of Real Numbers for (xk); every j≥N has kj≥j≥N by Strictly Increasing Sequences of Natural Numbers Dominate Their Index, hence ∣xkj−L∣<ε.
(d) Let a real sequence (al)l∈N converge to a, let c′ be real and l0∈N. If al≤c′ for every l≥l0, then a≤c′; if al≥c′ for every l≥l0, then a≥c′. Indeed, in the first case suppose c′<a (the order is total) and put ε=a−c′>0; with N as in Limit of a Sequence of Real Numbers and l=N+l0 we get ∣al−a∣<ε, so al>a−ε=c′ by claim 9 of Properties of the Absolute Value in an Ordered Field, a contradiction. In the second case suppose a<c′, put ε=c′−a, and obtain in the same way al<a+ε=c′, a contradiction.
(e) For δ≥0 and λ∈D we have δe≤δE(λ) by the choice of e and claim 5 of Elementary Arithmetic in an Ordered Field; and for λ,λ′∈Σd2 we have u(λ)≤∣u(λ)∣≤b by claim 3 of Properties of the Absolute Value in an Ordered Field, and −v(λ′)≤∣−v(λ′)∣=∣v(λ′)∣≤b by claim 3 of Properties of the Absolute Value in an Ordered Field applied to −v(λ′) and claim 2 of Properties of the Absolute Value in an Ordered Field. We also record: 0<2 by claim 8 of Elementary Order Arithmetic in an Ordered Field, so for every real α>0 the number 2α=α⋅2−1 is positive by that claim 8, and in particular 0≤2α.
Step 2 (Clause bounds). Let δ≥0, α>0, μ,ν∈D. By Step 1(e), u(κd(μ))≤b, −v(κd(ν))≤b, −δE(μ)≤−δe and −δE(ν)≤−δe; by Step 1(b), the positivity of 2α recorded in Step 1(e), and the product rule for nonnegative factors of Step 1(b), 2αW2(μ,ν)2≥0. Adding, Ψδ,α(μ,ν)≤2b−2δe. Since D=∅, V(δ,α) is nonempty, and 2b−2δe is an upper bound for it in the sense of Upper Bound and Least Upper Bound, so V(δ,α) is bounded above; hence its least upper bound S(δ,α) exists as a real number, since R is Dedekind complete by The Real Numbers and Standard Notation. Moreover, for μ,ν∈D,
Ψδ,α(μ,ν)=Ψ0,α(μ,ν)−δE(μ)−δE(ν)≤S(0,α)−2δe,
because S(0,α) is an upper bound of V(0,α) and by Step 1(e). Thus S(0,α)−2δe is an upper bound of V(δ,α), and the least upper bound satisfies S(δ,α)≤S(0,α)−2δe.
Step 3 (Clause diagonal). Let α>0 and λ∈D. By Step 1(a), λ∈Σd,R, so W2(λ,λ)=0 by The Noncommutative Wasserstein Distance: Existence of Optimal Couplings, Symmetry, Separation, a Moment Bound, Weak-Star Lower Semicontinuity, and Displacement Interpolation §separation. Hence Ψ0,α(λ,λ)=u(κd(λ))−v(κd(λ)), and this value is at most S(0,α) since it lies in V(0,α).
Step 4 (Clause monotone). Let 0<α′≤α and μ,ν∈D. Since α′≤α, claim 3 of Elementary Arithmetic in an Ordered Field gives 0≤α−α′; and 0<2−1 by claims 8 and 7 of Elementary Order Arithmetic in an Ordered Field. Hence 2α−α′=2−1(α−α′)≥0 by the product rule for nonnegative factors of Step 1(b). As W2(μ,ν)2≥0 (Step 1(b)), the same rule gives 2α−α′W2(μ,ν)2≥0, so
Ψ0,α(μ,ν)=Ψ0,α′(μ,ν)−2α−α′W2(μ,ν)2≤Ψ0,α′(μ,ν)≤S(0,α′).
So S(0,α′) is an upper bound of V(0,α), whence S(0,α)≤S(0,α′).
Step 5 (Clause maximiser: an approximating sequence). Fix reals δ>0 and α>0, and write Ψ=Ψδ,α and S=S(δ,α), a real number by Step 2. For each m∈N, claim 3 of Approximation Property of the Supremum and the Infimum in R with ε=1/m gives (μm,νm)∈D×D with
S−1/m<Ψ(μm,νm).(5.1)
Write wm=W2(μm,νm)≥0 (Step 1(b)). We have 0<1 by claim 6 of Elementary Order Arithmetic in an Ordered Field and 1≤ι(m) by claim 2 of Properties of the Canonical Map from the Natural Numbers to an Ordered Field, so Order Reversal under Reciprocals, and Summability of the Reciprocals of the Squares §reciprocal with a=1 and b=ι(m) gives 1/m=ι(m)−1≤1−1=1. Hence −1≤−1/m by claim 4 of Elementary Order Arithmetic in an Ordered Field, so S−1≤S−1/m by the compatibility of the order with addition in Ordered Field, and S−1<Ψ(μm,νm) by (5.1) and claim 2 of Elementary Order Arithmetic in an Ordered Field. Solving the definition of Ψ(μm,νm) for one term and using the bounds of Step 1(e) together with 2αwm2≥0 (as in Step 2), we get
2αwm2=u(κd(μm))−v(κd(νm))−δE(μm)−δE(νm)−Ψ(μm,νm)≤2b−2δe−S+1,
δE(μm)=u(κd(μm))−v(κd(νm))−2αwm2−δE(νm)−Ψ(μm,νm)≤2b−δe−S+1,
and in the same way δE(νm)≤2b−δe−S+1. The numbers α2=2α−1 and δ1=δ−1 are positive: 0<α−1 and 0<δ−1 by claim 7 of Elementary Order Arithmetic in an Ordered Field, 0<2 by claim 8 there, and 0<2α−1 by claim 5 there; in particular both are nonnegative. Multiplying the first inequality by α2 and the other two by δ1, which preserves non-strict inequalities by claim 5 of Elementary Arithmetic in an Ordered Field, and using α2⋅2α=(2α−1)(α2−1)=1 and δ1⋅δ=1 on the left-hand sides, gives, for every m∈N,
wm2≤C,E(μm)≤c,E(νm)≤c,C=α2(2b−2δe−S+1),c=δ1(2b−δe−S+1).
Finally ∣wm∣=wm by Absolute Value in an Ordered Field, since 0≤wm, and wm≤1+∣C∣: if wm≤1 this holds because 0≤∣C∣; if 1<wm, then wm=wm⋅1<wm⋅wm≤C≤∣C∣<1+∣C∣ by claim 10 of Elementary Order Arithmetic in an Ordered Field (with the positive factor wm) and claim 3 of Properties of the Absolute Value in an Ordered Field.
Step 6 (Extraction). By Step 5 and The Wall-Confined Free Energy: Norm Bound, Lower Bound, Weak-Star Compact Sublevel Sets and Displacement Monotonicity of the Score §compact applied to (μm)m∈N and c, there are a strictly increasing (mi)i∈N, μ^∈D and a real L1 with μmi→μ^ weak-star, E(μmi)→L1 and E(μ^)≤L1. The sequence (νmi)i∈N lies in D with E(νmi)≤c, so The Wall-Confined Free Energy: Norm Bound, Lower Bound, Weak-Star Compact Sublevel Sets and Displacement Monotonicity of the Score §compact applied to it gives a strictly increasing (ij)j∈N, ν^∈D and a real L2 with νmij→ν^ weak-star, E(νmij)→L2 and E(ν^)≤L2. Put kj=mij, strictly increasing by claim 2 of A Subsequence of a Subsequence is a Subsequence.
Apply The Diagonal Subsequence Lemma for Bounded Real Arrays to the array with aj,1=u(κd(μkj)), aj,2=v(κd(νkj)), aj,3=wkj and aj,k=0 for k≥4, with bounds R1=R2=b, R3=1+∣C∣ and Rk=0 for k≥4 (valid by hypothesis and Step 5). It gives a strictly increasing (jl)l∈N and reals A, B, w such that, with nl=kjl=mijl,
Al:=u(κd(μnl))→A,Bl:=v(κd(νnl))→B,wnl→w.
By claim 2 of A Subsequence of a Subsequence is a Subsequence, (ijl)l and (nl)l are strictly increasing, and by its claim 3, (μnl)l is the subsequence of (μmi)i determined by (ijl)l, and (νnl)l is the subsequence of (νmij)j determined by (jl)l. Hence, by Sequential Weak-Star Compactness of the Noncommutative Laws with a Given Norm Bound §unique and Step 1(c),
μnl→μ^ and νnl→ν^ weak-star,E(μnl)→L1,E(νnl)→L2.
All of μnl, νnl, μ^, ν^ lie in Σd,R⊆Σd by Step 1(a).
Step 7 (Comparison of the limits). (i) A≤u(κd(μ^)). Fix ε>0 first and put c′=u(κd(μ^))+ε>u(κd(μ^)). By Weak-Star Semicontinuity on Bounded Laws of Functions on Square-Integrable Noncommutative Laws §upper, applied with the radius R to (μnl)l and μ^, there is l0 with Al<c′ for all l≥l0, so A≤u(κd(μ^))+ε by Step 1(d). As ε>0 was arbitrary, Comparison of Real Numbers with Arbitrary Positive Slack §slack-above gives the claim.
(ii) v(κd(ν^))≤B. Fix ε>0 first and put c′=v(κd(ν^))−ε<v(κd(ν^)). By Weak-Star Semicontinuity on Bounded Laws of Functions on Square-Integrable Noncommutative Laws §lower, applied with the radius R to (νnl)l and ν^, there is l0 with Bl>c′ for all l≥l0, so v(κd(ν^))−ε≤B by Step 1(d), and Comparison of Real Numbers with Arbitrary Positive Slack §slack-below gives the claim.
(iii) W^2≤w2, where W^=W2(μ^,ν^). Fix ε>0 first. Since wnl→w, there is l0 with ∣wnl−w∣<ε, hence wnl<w+ε (claim 9 of Properties of the Absolute Value in an Ordered Field), for all l≥l0. The index sequence (l0+i)i∈N is strictly increasing, so the tails (μnl0+i)i∈N and (νnl0+i)i∈N are subsequences of (μnl)l and (νnl)l and converge weak-star to μ^ and ν^ by Sequential Weak-Star Compactness of the Noncommutative Laws with a Given Norm Bound §unique; they lie in Σd,R, and W2(μnl0+i,νnl0+i)=wnl0+i≤w+ε for every i. By The Noncommutative Wasserstein Distance: Existence of Optimal Couplings, Symmetry, Separation, a Moment Bound, Weak-Star Lower Semicontinuity, and Displacement Interpolation §lsc, W^≤w+ε. As ε was arbitrary, W^≤w by Comparison of Real Numbers with Arbitrary Positive Slack §slack-above. Since 0≤W^ (Step 1(b)), also 0≤w, and two applications of claim 5 of Elementary Arithmetic in an Ordered Field (with the nonnegative factors W^ and then w) give W^W^≤W^w≤ww.
(iv) E(μ^)≤L1 and E(ν^)≤L2 by Step 6.
Step 8 (The limit of the values). For every l,
Ψ(μnl,νnl)=Al−Bl−2αwnl2−δE(μnl)−δE(νnl),
so by claims 1, 2 and 3 of Arithmetic of Limits of Real Sequences and Step 6 this sequence converges to
P=A−B−2αw2−δL1−δL2.
We show P≥S. Fix ε>0 first; by claim 3 of The Archimedean Property of the Real Numbers choose N0∈N with 1/N0=ι(N0)−1<ε. For l≥N0 we have nl≥l≥N0 by Strictly Increasing Sequences of Natural Numbers Dominate Their Index, so ι(N0)≤ι(nl) by the preamble, where also 0<ι(N0); hence Order Reversal under Reciprocals, and Summability of the Reciprocals of the Squares §reciprocal with a=ι(N0) and b=ι(nl) gives 1/nl=ι(nl)−1≤ι(N0)−1=1/N0<ε, and (5.1) with m=nl gives Ψ(μnl,νnl)>S−1/nl>S−ε. By Step 1(d), P≥S−ε; as ε was arbitrary, P≥S by Comparison of Real Numbers with Arbitrary Positive Slack §slack-below.
Step 9 (Conclusion of clause maximiser). By Step 7, the sign reversal of claim 4 of Elementary Order Arithmetic in an Ordered Field and claim 5 of Elementary Arithmetic in an Ordered Field (with the nonnegative factors 2α, nonnegative by Step 1(e), and δ>0),
u(κd(μ^))≥A,−v(κd(ν^))≥−B,−2αW^2≥−2αw2,−δE(μ^)≥−δL1,−δE(ν^)≥−δL2.
Adding, Ψ(μ^,ν^)≥P≥S by Step 8. On the other hand Ψ(μ^,ν^)≤S because (μ^,ν^)∈D×D and S is an upper bound of V(δ,α). Hence Ψ(μ^,ν^)=S, and (μ^,ν^) is a maximising pair.
Step 10 (Clause strength). Let δ>0, 0<α′<α, and let (μ^,ν^) be a maximising pair of Ψδ,α. Directly from the definition,
Ψδ,α′(μ^,ν^)=Ψδ,α(μ^,ν^)+2α−α′W2(μ^,ν^)2=S(δ,α)+2α−α′W2(μ^,ν^)2,
and the left side is at most S(δ,α′) since it lies in V(δ,α′).
Step 11 (Clause weight). Let α>0 and ε>0 be given; the choices are made in the order (μ0,ν0), then K, then δ1, and δ is arbitrary afterwards. By claim 8 of Elementary Order Arithmetic in an Ordered Field, ε/2>0, so claim 3 of Approximation Property of the Supremum and the Infimum in R gives (μ0,ν0)∈D×D with Ψ0,α(μ0,ν0)>S(0,α)−ε/2. Put K=∣E(μ0)∣+∣E(ν0)∣+1, which is positive: 0≤∣E(μ0)∣+∣E(ν0)∣ by claim 1 of Properties of the Absolute Value in an Ordered Field and claim 2 of Elementary Arithmetic in an Ordered Field, so 1=0+1≤K by the compatibility of the order with addition in Ordered Field, and 0<1 by claim 6 of Elementary Order Arithmetic in an Ordered Field, whence 0<K by claim 2 there; and δ1=2εK−1, which is positive by claims 5 and 7 of Elementary Order Arithmetic in an Ordered Field. Let 0<δ≤δ1. By claim 3 of Properties of the Absolute Value in an Ordered Field and claim 5 of Elementary Arithmetic in an Ordered Field,
δ(E(μ0)+E(ν0))≤δK≤δ1K=2ε.
Therefore, since Ψδ,α(μ0,ν0)∈V(δ,α),
S(δ,α)≥Ψδ,α(μ0,ν0)=Ψ0,α(μ0,ν0)−δ(E(μ0)+E(ν0))>S(0,α)−2ε−2ε=S(0,α)−ε.■