Each result cited below is universally quantified over the data in its own statement.
Step 0 (Sandwich). Let w:Σd2→R be bounded and δ>0 real. The function w∘κd−δE on D is bounded above near each point by The Penalty Envelopes of a Bounded Function on the Domain of the Wall-Confined Free Energy §upper, so Properties of the Upper Semicontinuous Envelope §bounds, for the nonempty set D in the metric space (Σd,R,W2) of The Discounted HJB Equation with Free Langevin Noise in a Wall, Envelope Form: Standing Notation §metric, gives w(κd(μ))−δE(μ)≤wδ−(μ) for every μ∈D; likewise The Penalty Envelopes of a Bounded Function on the Domain of the Wall-Confined Free Energy §lower and Properties of the Lower Semicontinuous Envelope, by Duality §bounds give wδ+(μ)≤w(κd(μ))+δE(μ). Moreover wδ− is upper semicontinuous on D by Properties of the Upper Semicontinuous Envelope §usc, and wδ+ is lower semicontinuous on D by Properties of the Lower Semicontinuous Envelope, by Duality §lsc.
Step 1 (Common data). Let u be a bounded envelope subsolution with shift range δu and v a bounded envelope supersolution with shift range δv, and put δ0=min{δu,δv} and b=max{bu,bv} with ∣u∣≤bu and ∣v∣≤bv. Every δ with 0<δ≤δ0 satisfies δ≤δu and δ≤δv, so the conditions of Envelope Viscosity Subsolutions, Supersolutions and Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §sub and Envelope Viscosity Subsolutions, Supersolutions and Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §super for all such δ are among those assumed: u is an envelope subsolution and v an envelope supersolution with shift range δ0, and ∣u∣≤b, ∣v∣≤b. The hypotheses of Comparison at a Fixed Level for Envelope Viscosity Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §fixed-level on the setting, on D and on H are those of the present theorem; b≥0 because a bound of a bounded function is nonnegative, and δ0>0 as the least of two positive reals. Let ϵ:(0,δ0]→[0,∞) be the function of that lemma for these b and δ0.
Claim 1 (Comparison). Fix μ∈D. For every δ∈(0,δ0], Step 0 and Comparison at a Fixed Level for Envelope Viscosity Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §fixed-level give
u(κd(μ))−δE(μ)≤uδ−(μ)≤vδ+(μ)+ϵ(δ)≤v(κd(μ))+δE(μ)+ϵ(δ),
that is, u(κd(μ))≤v(κd(μ))+2δE(μ)+ϵ(δ). Let η>0 be real. Since ϵ(δ)→0 as δ→0 in the sense of Comparison at a Fixed Level for Envelope Viscosity Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §fixed-level, there is a real δ1>0 with ϵ(δ)<η/2 for every δ in (0,δ0] with δ<δ1. Choose a real δ with 0<δ≤δ0, δ<δ1 and 2δ∣E(μ)∣<η/2 (for instance half the least of δ0, δ1 and η/(4∣E(μ)∣+4)). Then u(κd(μ))≤v(κd(μ))+η. As η>0 was arbitrary, u(κd(μ))≤v(κd(μ)) by Comparison of Real Numbers with Arbitrary Positive Slack §slack-above.
Claim 2 (Uniqueness). Each of u,v is by Envelope Viscosity Subsolutions, Supersolutions and Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §solution both an envelope subsolution and an envelope supersolution with its shift range. Claim 1 applied to the pair (u,v) and to the pair (v,u) gives u(κd(μ))≤v(κd(μ)) and v(κd(μ))≤u(κd(μ)) for every μ∈D, hence equality by antisymmetry of the order.
Claim 3 (Continuity on energy sublevel sets). Let u be a bounded envelope solution with shift range δ0 and ∣u∣≤b, let c be real and Sc={μ∈D:E(μ)≤c}; if Sc is empty there is nothing to prove. By Envelope Viscosity Subsolutions, Supersolutions and Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §solution, u is both an envelope subsolution and an envelope supersolution with shift range δ0, so, as in Step 1, Comparison at a Fixed Level for Envelope Viscosity Solutions of the Discounted HJB Equation with Free Langevin Noise in a Wall §fixed-level applies with v=u for these b and δ0 and gives a function ϵ on (0,δ0] tending to 0 with
uδ−(λ)≤uδ+(λ)+ϵ(δ)for every λ∈D and δ∈(0,δ0].(C)
Fix μ∈Sc and a real η>0. Let δ1>0 be such that ϵ(δ)<η/3 for every δ∈(0,δ0] with δ<δ1, and let δ be half the least of δ0, δ1 and η/(3∣c∣+3∣E(μ)∣+3); then δ∈(0,δ0], ϵ(δ)<η/3 and δ(∣c∣+∣E(μ)∣)<η/3. By Step 0 and the definition of upper semicontinuity (Upper Semicontinuous Function on a Subset of a Metric Space) there is a real r1>0 with uδ−(ν)<uδ−(μ)+η/3 for every ν∈D with W2(μ,ν)<r1, and by Lower Semicontinuous Function on a Subset of a Metric Space there is a real r2>0 with uδ+(μ)−η/3<uδ+(ν) for every ν∈D with W2(μ,ν)<r2. Let ν∈Sc with W2(μ,ν)<min{r1,r2}. Since E(ν)≤c≤∣c∣ and δ>0, Step 0 and (C) at μ give
u(κd(ν))≤uδ−(ν)+δE(ν)<uδ−(μ)+3η+δ∣c∣≤uδ+(μ)+ϵ(δ)+3η+δ∣c∣≤u(κd(μ))+δE(μ)+ϵ(δ)+3η+δ∣c∣<u(κd(μ))+η,
and, since −δE(ν)≥−δ∣c∣,
u(κd(ν))≥uδ+(ν)−δE(ν)>uδ+(μ)−3η−δ∣c∣≥uδ−(μ)−ϵ(δ)−3η−δ∣c∣≥u(κd(μ))−δE(μ)−ϵ(δ)−3η−δ∣c∣>u(κd(μ))−η.
Hence ∣u(κd(ν))−u(κd(μ))∣<η for every ν∈Sc with W2(μ,ν)<min{r1,r2}. As μ∈Sc and η>0 were arbitrary, the function μ↦u(κd(μ)) on Sc, with the restriction of W2 and the metric of R fixed in The Discounted HJB Equation with Free Langevin Noise in a Wall, Envelope Form: Standing Notation §metric, is continuous.