TheoremBase

Stopped Completion of Squares on a Cascade Block

Statement

Adopt the setting, notation and hypotheses of the completion-of-squares theorem for the fluctuation cost: the fluctuation processes st\mathfrak{s}_{t}, at\mathfrak{a}_{t} of a solution with regular event Ω0\Omega_{0}, empirical state measure Σ\Sigma, control α\alpha and system filtration (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_{t})_{t\in[0,T]}, taken about a mean-field trajectory pair (S,A)(S,A); the extension (U,V,βˉ)(U,V,\bar{\beta}) with derivative bound KK and extended aggregate state drift bˉ\bar{b}; the extension (Uc,Lˉ,Gˉ)(U_{c},\bar{L},\bar{G}) with second-derivative bound KcK_{c}; the stationary co-state PP with bound CPC_{P}; the fluctuation Hessian coefficients Hij(t)H_{ij}(t) and FγδF_{\gamma\delta}; the aggregate fluctuation covariance Θ\Theta and the aggregate state drift bb; the drift difference gs=N(b(Σs,αs)−b(Ss,As))g_{s}=\sqrt{N}(b(\Sigma_{s},\alpha_{s})-b(S_{s},A_{s})); the matrices Et,Bt,Qt,Vt,Rt,F^E_{t},\mathsf{B}_{t},Q_{t},V_{t},R_{t},\hat{F} and the pairing notation x⋅Myx\cdot My defined there; hypotheses (H1) with constant r>0r>0 and (H2) with the Riccati family Z=(Zt)t∈[0,T]Z=(Z_{t})_{t\in[0,T]}, Wt=ZtBt+12VtW_{t}=Z_{t}\mathsf{B}_{t}+\tfrac{1}{2}V_{t} and densities z˙(t)=−(EtTZt+ZtEt−WtRt−1WtT+Qt)\dot{z}(t)=-\bigl(E_{t}^{T}Z_{t}+Z_{t}E_{t}-W_{t}R_{t}^{-1}W_{t}^{T}+Q_{t}\bigr); the constant CZC_{Z} with ∣Ztγδ∣≤CZ|Z^{\gamma\delta}_{t}|\le C_{Z} for all indices and all tt, and the constant cec_{e}; and the processes

ut=at+Rt−1WtTst,es=gs−Esss−Bsas.u_{t}=\mathfrak{a}_{t}+R_{t}^{-1}W_{t}^{T}\mathfrak{s}_{t},\qquad e_{s}=g_{s}-E_{s}\mathfrak{s}_{s}-\mathsf{B}_{s}\mathfrak{a}_{s}.

The hypothesis A2=∫[0,T]E[∣at∣2] dt<∞\mathcal{A}_{2}=\int_{[0,T]}\mathbb{E}[|\mathfrak{a}_{t}|^{2}]\,dt<\infty of the second-order expansion theorem is part of the setting adopted here and is not re-derived; in the intended application the control set is compact, so that ∣at∣≤2NRA|\mathfrak{a}_{t}|\le2\sqrt{N}R_{\mathcal{A}} everywhere with RA=sup⁡a∈A∣a∣R_{\mathcal{A}}=\sup_{a\in\mathcal{A}}|a| and hence A2≤4RA2TN<∞\mathcal{A}_{2}\le4R_{\mathcal{A}}^{2}TN<\infty. The scalar RAR_{\mathcal{A}} is distinct from the matrices RtR_{t} above. Adopt also the weighted second-moment evolution lemma and its stopped form the stopped weighted second-moment lemma, whose weight family is the present ZZ, and, from the first-order expansion lemma for the recentred NN-agent cost, the quantity Dt\mathcal{D}_{t} with its bound CDC_{\mathcal{D}}. Write zt=(st,at)∈Rl+m\mathfrak{z}_{t}=(\mathfrak{s}_{t},\mathfrak{a}_{t})\in\mathbb{R}^{l+m}, 1D\mathbf{1}_{D} for the indicator of a set DD, E\mathbb{E} for the expectation, and ∫[a,b]⋅ ds\int_{[a,b]}\cdot\,ds for the Lebesgue integral over a compact interval. Stopping times are those of (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_{t})_{t\in[0,T]} and 1{s<θ}\mathbf{1}_{\{s<\theta\}} denotes the pre-stopping-time indicator of a stopping time θ\theta.

Block data. Let t♭t_{\flat} and t♯t_{\sharp} be real numbers with 0≤t♭≤t♯≤T0\le t_{\flat}\le t_{\sharp}\le T, let σ\sigma be a stopping time with σ(ω)≥t♭\sigma(\omega)\ge t_{\flat} for every ω\omega, and let G\mathcal{G} be an event with G⊆Ω0\mathcal{G}\subseteq\Omega_{0} and G∈Ft♭sys\mathcal{G}\in\mathcal{F}^{\mathrm{sys}}_{t_{\flat}}. Define τ:Ω→[0,T]\tau:\Omega\to[0,T] by

τ(ω)=σ(ω)  for ω∈G,τ(ω)=t♭  for ω∉G.\tau(\omega)=\sigma(\omega)\ \text{ for }\omega\in\mathcal{G},\qquad \tau(\omega)=t_{\flat}\ \text{ for }\omega\notin\mathcal{G}.

Then the following hold.

1. (The masked stopping time.) τ\tau is a stopping time of (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_{t})_{t\in[0,T]} with τ≥t♭\tau\ge t_{\flat} everywhere; for every s∈[t♭,T]s\in[t_{\flat},T] one has 1{s<τ}=1G 1{s<σ}\mathbf{1}_{\{s<\tau\}}=\mathbf{1}_{\mathcal{G}}\,\mathbf{1}_{\{s<\sigma\}}; min⁡(t♭,τ)=t♭\min(t_{\flat},\tau)=t_{\flat} everywhere; and min⁡(t,τ)=t♭\min(t,\tau)=t_{\flat} off G\mathcal{G} for every t∈[t♭,T]t\in[t_{\flat},T].

2. (Pointwise completion of squares.) At every point of [0,T]×Ω[0,T]\times\Omega,

ss⋅z˙(s) ss+2 ss⋅Zsgs = us⋅Rsus − 12∑i=1l+m∑j=1l+mHij(s) zsizsj + 2 ss⋅Zses.\mathfrak{s}_{s}\cdot\dot{z}(s)\,\mathfrak{s}_{s}+2\,\mathfrak{s}_{s}\cdot Z_{s}g_{s}\ =\ u_{s}\cdot R_{s}u_{s}\ -\ \tfrac{1}{2}\sum_{i=1}^{l+m}\sum_{j=1}^{l+m}H_{ij}(s)\,\mathfrak{z}^{i}_{s}\mathfrak{z}^{j}_{s}\ +\ 2\,\mathfrak{s}_{s}\cdot Z_{s}e_{s}.

3. (Block identity.) With τ\tau as above and s♯=smin⁡(t♯,σ)\mathfrak{s}^{\sharp}=\mathfrak{s}_{\min(t_{\sharp},\sigma)} denoting the sampled function taken componentwise, and Z♯=Zmin⁡(t♯,σ)Z^{\sharp}=Z_{\min(t_{\sharp},\sigma)} likewise,

∫[t♭,t♯]E[1G1{s<σ}  12∑i,j=1l+mHij(s) zsizsj]ds = E[1G st♭⋅Zt♭st♭]−E[1G s♯⋅Z♯s♯] + ∫[t♭,t♯](E[1G1{s<σ}(us⋅Rsus+2 ss⋅Zses)]+∑γ,δ=1lZsγδ E[1G1{s<σ} Θγδ(Σs,αs)])ds,\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\Bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\;\tfrac{1}{2}\sum_{i,j=1}^{l+m}H_{ij}(s)\,\mathfrak{z}^{i}_{s}\mathfrak{z}^{j}_{s}\Bigr]ds\ =\ \mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\,\mathfrak{s}_{t_{\flat}}\cdot Z_{t_{\flat}}\mathfrak{s}_{t_{\flat}}\bigr]-\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\,\mathfrak{s}^{\sharp}\cdot Z^{\sharp}\mathfrak{s}^{\sharp}\bigr]\ +\ \int_{[t_{\flat},t_{\sharp}]}\Bigl(\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\bigl(u_{s}\cdot R_{s}u_{s}+2\,\mathfrak{s}_{s}\cdot Z_{s}e_{s}\bigr)\bigr]+\sum_{\gamma,\delta=1}^{l}Z^{\gamma\delta}_{s}\,\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\,\Theta^{\gamma\delta}(\Sigma_{s},\alpha_{s})\bigr]\Bigr)ds ,

all expectations and integrals being finite.

4. (Block lower bound.) Assume in addition hypothesis (JC) of the localized joint coercivity lemma, with radius ρ∗\rho^{*} as in its claim 2, and assume the confinement condition: ρs(ω)≤ρ∗\rho_{s}(\omega)\le\rho^{*} whenever s∈[t♭,t♯]s\in[t_{\flat},t_{\sharp}], ω∈G\omega\in\mathcal{G} and s<σ(ω)s<\sigma(\omega). Then

∫[t♭,t♯]E[1G1{s<σ} NDs]ds ≥ E[1G st♭⋅Zt♭st♭]−E[1G s♯⋅Z♯s♯]+r∫[t♭,t♯]E[1G1{s<σ}∣us∣2]ds+∫[t♭,t♯]∑γ,δ=1lZsγδ E[1G1{s<σ}Θγδ(Σs,αs)]ds − Xlin − Xquad,\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\,N\mathcal{D}_{s}\bigr]ds\ \ge\ \mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\,\mathfrak{s}_{t_{\flat}}\cdot Z_{t_{\flat}}\mathfrak{s}_{t_{\flat}}\bigr]-\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\,\mathfrak{s}^{\sharp}\cdot Z^{\sharp}\mathfrak{s}^{\sharp}\bigr]+r\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}|u_{s}|^{2}\bigr]ds+\int_{[t_{\flat},t_{\sharp}]}\sum_{\gamma,\delta=1}^{l}Z^{\gamma\delta}_{s}\,\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\Theta^{\gamma\delta}(\Sigma_{s},\alpha_{s})\bigr]ds\ -\ \mathcal{X}^{\mathrm{lin}}\ -\ \mathcal{X}^{\mathrm{quad}},

where the two error terms are

Xlin=2 l2 CZ ce N−1/2∫[t♭,t♯]E[1G1{s<σ} ∣ss∣(∣ss∣2+∣as∣2)]ds,\mathcal{X}^{\mathrm{lin}}=2\,l^{2}\,C_{Z}\,c_{e}\,N^{-1/2}\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\Bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\,|\mathfrak{s}_{s}|\bigl(|\mathfrak{s}_{s}|^{2}+|\mathfrak{a}_{s}|^{2}\bigr)\Bigr]ds,

and

Xquad=12(l+m)∫[t♭,t♯]E[1G1{s<σ}(ωL(ρs)+CP ωb(ρs)) ∣zs∣2]ds,\mathcal{X}^{\mathrm{quad}}=\tfrac{1}{2}(l+m)\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\Bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}\bigl(\omega_{L}(\rho_{s})+C_{P}\,\omega_{b}(\rho_{s})\bigr)\,|\mathfrak{z}_{s}|^{2}\Bigr]ds ,

with ρs\rho_{s} and the moduli ωL,ωb\omega_{L},\omega_{b} of the second-order expansion theorem; and moreover Xquad≤cJ2∫[t♭,t♯]E[1G1{s<σ}∣zs∣2]ds\mathcal{X}^{\mathrm{quad}}\le\tfrac{c_{J}}{2}\int_{[t_{\flat},t_{\sharp}]}\mathbb{E}\bigl[\mathbf{1}_{\mathcal{G}}\mathbf{1}_{\{s<\sigma\}}|\mathfrak{z}_{s}|^{2}\bigr]ds.

Proofs

Log in to submit a proof.

Loading...

Citations

Loading…

Dependencies

Loading…

Related

0 relations

Curated associations between results. These are editable and subjective — they do not replace the dependency graph, which is derived from the references in the text.

No relations recorded yet.

Comments

Log in to comment.

Loading…