TheoremBase

The envelopes of a constant are the constant shifted by a multiple of the penalty; at a penalised extremum the first-order condition matches the test gradient with the score, so the shifted operator reduces to discount times the constant minus the running cost, witnessed along the diagonal coupling.

Proof

Each result cited is universally quantified over the data in its own statement.

We work in the setting of First-Order Equations on the Noise Wasserstein Space Relative to a Noise Penalty Pair: Standing Notation; elementary order and arithmetic of real numbers is carried by The Real Numbers: Standing Notation and Background §background, which we adopt for that purpose. By Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §pair, DΣ⊆D⊆Pρa\mathcal{D}_{\Sigma}\subseteq\mathcal{D}\subseteq\mathcal{P}^{a}_{\rho}, and D\mathcal{D} is regarded as a subset of the metric space (Pρa,Wa)(\mathcal{P}^{a}_{\rho},W_{a}) of First-Order Equations on the Noise Wasserstein Space Relative to a Noise Penalty Pair: Standing Notation §space, with R\mathbb{R} carrying the metric of The Absolute Value Metric on the Real Line. For ν∈Pρa\nu\in\mathcal{P}^{a}_{\rho}, L2(ν;Xa)L^{2}(\nu;X^{a}) is a real Hilbert space by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §fields; we write 0ν0_{\nu} for its zero vector. By The Discounted Hamilton-Jacobi Equation with a Penalty Drift on the Noise Wasserstein Space §operator,

F(ν,r,q)=λ0 r+θ2 ∥q∥ν2+⟨Σ(ν),q⟩ν−g(ν)((ν,q)∈Va(DΣ), r∈R),F(\nu,r,q)=\lambda_{0}\,r+\frac{\theta}{2}\,\lVert q\rVert_{\nu}^{2}+\langle\Sigma(\nu),q\rangle_{\nu}-g(\nu)\qquad\bigl((\nu,q)\in\mathcal{V}^{a}(\mathcal{D}_{\Sigma}),\ r\in\mathbb{R}\bigr),

and its δ\delta-shifts are those of The Bundle of Noise Fields over a Set of Measures, First-Order Equation Operators on the Noise Wasserstein Space, and Their Delta-Shifts §shifted.

Claim 1 (growth). Since uκ(μ)≤κu_{\kappa}(\mu)\le\kappa and κ≤uκ(μ)\kappa\le u_{\kappa}(\mu) for every μ∈D\mu\in\mathcal{D}, Basic Properties of the Delta-Envelopes on the Noise Wasserstein Space, and the Envelopes of Bounded Functions for a Noise-Closed Penalty Pair §growth, applied to the noise-closed pair with b=κb=\kappa, shows that uκu_{\kappa} has penalty-subordinate growth from above and from below. So for every positive δ\delta both envelopes (uκ)δ−(u_{\kappa})^{-}_{\delta} and (uκ)δ+(u_{\kappa})^{+}_{\delta} of The Delta-Envelopes of a Function on the Domain of a Noise Penalty Pair §minus and The Delta-Envelopes of a Function on the Domain of a Noise Penalty Pair §plus are defined.

Step A (the envelopes of uκu_{\kappa}). Fix a positive δ\delta. The function uκu_{\kappa} is continuous on D\mathcal{D}: for x,y∈Dx,y\in\mathcal{D} the distance between uκ(y)u_{\kappa}(y) and uκ(x)u_{\kappa}(x) is ∣κ−κ∣=0|\kappa-\kappa|=0, which is less than every positive ε\varepsilon, so the defining condition at xx holds with any positive radius. The penalty E\mathcal{E} is lower semicontinuous on D\mathcal{D} relative to D\mathcal{D} by Basic Properties of a Noise-Closed Noise Penalty Pair: Lower Bound, Lower Semicontinuity, Complete Sublevel Sets and Bounded Distances §lsc, the pair being noise-closed. By Claim 1 and Basic Properties of the Delta-Envelopes on the Noise Wasserstein Space, and the Envelopes of Bounded Functions for a Noise-Closed Penalty Pair §exact,

(uκ)δ−(μ)=κ−δ E(μ),(uκ)δ+(μ)=κ+δ E(μ)(μ∈D).(u_{\kappa})^{-}_{\delta}(\mu)=\kappa-\delta\,\mathcal{E}(\mu),\qquad(u_{\kappa})^{+}_{\delta}(\mu)=\kappa+\delta\,\mathcal{E}(\mu)\qquad(\mu\in\mathcal{D}).

Step B (an evaluation of FF). For ν∈DΣ\nu\in\mathcal{D}_{\Sigma} we have (ν,0ν)∈Va(DΣ)(\nu,0_{\nu})\in\mathcal{V}^{a}(\mathcal{D}_{\Sigma}), and by Elementary Identities in a Real Inner Product Space §zero in the real Hilbert space L2(ν;Xa)L^{2}(\nu;X^{a}), ∥0ν∥ν=0\lVert0_{\nu}\rVert_{\nu}=0 and ⟨Σ(ν),0ν⟩ν=0\langle\Sigma(\nu),0_{\nu}\rangle_{\nu}=0, the score Σ(ν)\Sigma(\nu) lying in Tνa⊆L2(ν;Xa)T^{a}_{\nu}\subseteq L^{2}(\nu;X^{a}) by Noise Penalty Pairs on the Noise Wasserstein Space: the Penalty, Its Score, and Their Domains §pair. Hence

F(ν,κ,0ν)=λ0κ−g(ν)(ν∈DΣ).F(\nu,\kappa,0_{\nu})=\lambda_{0}\kappa-g(\nu)\qquad(\nu\in\mathcal{D}_{\Sigma}).

Step C (diagonal witnesses). Let μ^∈DΣ\hat{\mu}\in\mathcal{D}_{\Sigma}, let φ\varphi be a noise intrinsic test function on D\mathcal{D}, let δ\delta and ε\varepsilon be positive, let ww denote either envelope (uκ)δ∓(u_{\kappa})^{\mp}_{\delta}, and put ν=μ^\nu=\hat{\mu}, π=(id,id)#μ^\pi=(\mathrm{id},\mathrm{id})_{\#}\hat{\mu}, s=w(μ^)s=w(\hat{\mu}) and q=∇φ(μ^)∈L2(μ^;Xa)q=\nabla\varphi(\hat{\mu})\in L^{2}(\hat{\mu};X^{a}). Then ν∈DΣ\nu\in\mathcal{D}_{\Sigma}; by A Toolkit for Penalised Comparison on the Noise Wasserstein Space: Constant Test Functions and Linear Combinations of Test Functions, the Identity as a Unique Noise-Optimal Map, and Discrepancies Along the Push-Forward Under (id, id) and Along Glued Couplings §diagonal, π∈Πa(μ^,μ^)\pi\in\Pi^{a}(\hat{\mu},\hat{\mu}) with Ia(π)=0<ε2I^{a}(\pi)=0<\varepsilon^{2}, and the discrepancy of qq and ∇φ(μ^)\nabla\varphi(\hat{\mu}) along π\pi equals ∥q−∇φ(μ^)∥μ^2=∥0μ^∥μ^2=0<ε2\lVert q-\nabla\varphi(\hat{\mu})\rVert_{\hat{\mu}}^{2}=\lVert0_{\hat{\mu}}\rVert_{\hat{\mu}}^{2}=0<\varepsilon^{2} (Elementary Identities in a Real Inner Product Space §zero); and ∣w(ν)−w(μ^)∣=0<ε|w(\nu)-w(\hat{\mu})|=0<\varepsilon and ∣s−w(μ^)∣=0<ε|s-w(\hat{\mu})|=0<\varepsilon. So these witnesses satisfy the first four requirements of Viscosity Subsolution, Supersolution and Solution of a First-Order Equation on the Noise Wasserstein Space Relative to a Noise Penalty Pair §subsolution and of Viscosity Subsolution, Supersolution and Solution of a First-Order Equation on the Noise Wasserstein Space Relative to a Noise Penalty Pair §supersolution; it remains to check the last one in each case.

Claim 2 (subsolution). Assume λ0κ≤g(ν)\lambda_{0}\kappa\le g(\nu) for every ν∈DΣ\nu\in\mathcal{D}_{\Sigma}. By Claim 1, uκu_{\kappa} has penalty-subordinate growth from above. Let δ\delta with 0<δ<10<\delta<1, a noise intrinsic test function φ\varphi on D\mathcal{D}, a point μ^∈D\hat{\mu}\in\mathcal{D} at which (uκ)δ−−φ(u_{\kappa})^{-}_{\delta}-\varphi has a local maximum relative to D\mathcal{D}, and a positive ε\varepsilon be given, in this order; the witnesses chosen below do not depend on ε\varepsilon.

Step 1. By Step A, (uκ)δ−−φ(u_{\kappa})^{-}_{\delta}-\varphi has values κ−δE(μ)−φ(μ)\kappa-\delta\mathcal{E}(\mu)-\varphi(\mu); so, by the local maximum hypothesis, there is a positive radius ε0\varepsilon_{0} with κ−δE(y)−φ(y)≤κ−δE(μ^)−φ(μ^)\kappa-\delta\mathcal{E}(y)-\varphi(y)\le\kappa-\delta\mathcal{E}(\hat{\mu})-\varphi(\hat{\mu}) for every y∈Dy\in\mathcal{D} with Wa(μ^,y)<ε0W_{a}(\hat{\mu},y)<\varepsilon_{0}. Subtracting κ\kappa, the function χ−δE\chi-\delta\mathcal{E} with χ=−φ\chi=-\varphi, the function on Pρa\mathcal{P}^{a}_{\rho} with value −φ(μ)-\varphi(\mu) at μ\mu, has a local maximum at μ^\hat{\mu} relative to D\mathcal{D}. By A Toolkit for Penalised Comparison on the Noise Wasserstein Space: Constant Test Functions and Linear Combinations of Test Functions, the Identity as a Unique Noise-Optimal Map, and Discrepancies Along the Push-Forward Under (id, id) and Along Glued Couplings §linear, applied with Q=DQ=\mathcal{D}, with φ\varphi in the role of both its φ\varphi and its ψ\psi, and with s=−1s=-1 and t=0t=0, the function with value −φ(μ)+0⋅φ(μ)=−φ(μ)-\varphi(\mu)+0\cdot\varphi(\mu)=-\varphi(\mu) at μ\mu, which is χ\chi, is a noise intrinsic test function on D\mathcal{D} with ∇χ(μ^)=−∇φ(μ^)+0⋅∇φ(μ^)=−∇φ(μ^)\nabla\chi(\hat{\mu})=-\nabla\varphi(\hat{\mu})+0\cdot\nabla\varphi(\hat{\mu})=-\nabla\varphi(\hat{\mu}) in the real vector space L2(μ^;Xa)L^{2}(\hat{\mu};X^{a}).

Step 2. Since the pair has regular penalised maxima, Noise Penalty Pairs with Regular Penalised Maxima §regular with χ\chi and λ=δ\lambda=\delta gives μ^∈DΣ\hat{\mu}\in\mathcal{D}_{\Sigma}. Then The First-Order Condition at a Penalised Extremum of a Noise Intrinsic Test Function on the Noise Wasserstein Space §maximum, applied with Q=DQ=\mathcal{D} and this χ\chi, gives −∇φ(μ^)=δΣ(μ^)-\nabla\varphi(\hat{\mu})=\delta\Sigma(\hat{\mu}), hence ∇φ(μ^)=−δΣ(μ^)\nabla\varphi(\hat{\mu})=-\delta\Sigma(\hat{\mu}) in L2(μ^;Xa)L^{2}(\hat{\mu};X^{a}).

Step 3. Take the witnesses of Step C with w=(uκ)δ−w=(u_{\kappa})^{-}_{\delta}, so s=κ−δE(μ^)s=\kappa-\delta\mathcal{E}(\hat{\mu}) by Step A. By The Bundle of Noise Fields over a Set of Measures, First-Order Equation Operators on the Noise Wasserstein Space, and Their Delta-Shifts §shifted, Step 2 and Step B, and the hypothesis at μ^∈DΣ\hat{\mu}\in\mathcal{D}_{\Sigma},

Fδ−(ν,s,q)=F(μ^, κ, −δΣ(μ^)+δΣ(μ^))=F(μ^,κ,0μ^)=λ0κ−g(μ^)≤0<ε.F^{-}_{\delta}(\nu,s,q)=F\bigl(\hat{\mu},\ \kappa,\ -\delta\Sigma(\hat{\mu})+\delta\Sigma(\hat{\mu})\bigr)=F(\hat{\mu},\kappa,0_{\hat{\mu}})=\lambda_{0}\kappa-g(\hat{\mu})\le0<\varepsilon .

With Step C, all five requirements of Viscosity Subsolution, Supersolution and Solution of a First-Order Equation on the Noise Wasserstein Space Relative to a Noise Penalty Pair §subsolution hold, so uκu_{\kappa} is a viscosity subsolution of FF relative to the pair.

Claim 3 (supersolution). Assume g(ν)≤λ0κg(\nu)\le\lambda_{0}\kappa for every ν∈DΣ\nu\in\mathcal{D}_{\Sigma}. By Claim 1, uκu_{\kappa} has penalty-subordinate growth from below. Let δ\delta with 0<δ<10<\delta<1, a noise intrinsic test function φ\varphi on D\mathcal{D}, a point μ^∈D\hat{\mu}\in\mathcal{D} at which (uκ)δ+−φ(u_{\kappa})^{+}_{\delta}-\varphi has a local minimum relative to D\mathcal{D}, and a positive ε\varepsilon be given, in this order; again the witnesses do not depend on ε\varepsilon.

Step 1. By the local minimum hypothesis and Step A there is a positive radius ε0\varepsilon_{0} with κ+δE(μ^)−φ(μ^)≤κ+δE(y)−φ(y)\kappa+\delta\mathcal{E}(\hat{\mu})-\varphi(\hat{\mu})\le\kappa+\delta\mathcal{E}(y)-\varphi(y) for every y∈Dy\in\mathcal{D} with Wa(μ^,y)<ε0W_{a}(\hat{\mu},y)<\varepsilon_{0}; rearranging, φ(y)−δE(y)≤φ(μ^)−δE(μ^)\varphi(y)-\delta\mathcal{E}(y)\le\varphi(\hat{\mu})-\delta\mathcal{E}(\hat{\mu}), so φ−δE\varphi-\delta\mathcal{E} has a local maximum at μ^\hat{\mu} relative to D\mathcal{D}.

Step 2. By Noise Penalty Pairs with Regular Penalised Maxima §regular with χ=φ\chi=\varphi and λ=δ\lambda=\delta, μ^∈DΣ\hat{\mu}\in\mathcal{D}_{\Sigma}, and The First-Order Condition at a Penalised Extremum of a Noise Intrinsic Test Function on the Noise Wasserstein Space §maximum with Q=DQ=\mathcal{D} and χ=φ\chi=\varphi gives ∇φ(μ^)=δΣ(μ^)\nabla\varphi(\hat{\mu})=\delta\Sigma(\hat{\mu}).

Step 3. Take the witnesses of Step C with w=(uκ)δ+w=(u_{\kappa})^{+}_{\delta}, so s=κ+δE(μ^)s=\kappa+\delta\mathcal{E}(\hat{\mu}) by Step A. By The Bundle of Noise Fields over a Set of Measures, First-Order Equation Operators on the Noise Wasserstein Space, and Their Delta-Shifts §shifted, Step 2 and Step B, and the hypothesis at μ^∈DΣ\hat{\mu}\in\mathcal{D}_{\Sigma},

−ε<0≤λ0κ−g(μ^)=F(μ^,κ,0μ^)=F(μ^, κ, δΣ(μ^)−δΣ(μ^))=F(μ^, s−δE(μ^), q−δΣ(μ^))=Fδ+(ν,s,q),-\varepsilon<0\le\lambda_{0}\kappa-g(\hat{\mu})=F(\hat{\mu},\kappa,0_{\hat{\mu}})=F\bigl(\hat{\mu},\ \kappa,\ \delta\Sigma(\hat{\mu})-\delta\Sigma(\hat{\mu})\bigr)=F\bigl(\hat{\mu},\ s-\delta\mathcal{E}(\hat{\mu}),\ q-\delta\Sigma(\hat{\mu})\bigr)=F^{+}_{\delta}(\nu,s,q),

where s−δE(μ^)=κs-\delta\mathcal{E}(\hat{\mu})=\kappa, q=∇φ(μ^)=δΣ(μ^)q=\nabla\varphi(\hat{\mu})=\delta\Sigma(\hat{\mu}) and ν=μ^\nu=\hat{\mu}. With Step C, all five requirements of Viscosity Subsolution, Supersolution and Solution of a First-Order Equation on the Noise Wasserstein Space Relative to a Noise Penalty Pair §supersolution hold, so uκu_{\kappa} is a viscosity supersolution of FF relative to the pair. ■\blacksquare

Citations

Loading…

Dependencies

Uses0

Loading…

Comments

Log in to comment.

Loading…