TheoremBase

The Good-Set Stopping Time of the Realized Control: Flow Deviation and Control Energy

Statement

Adopt the setting and notation of claims 3 and 4 of the adaptedness lemma for the realized mean-field flow, together with those of the progressive measurability lemma for the realized control on which it rests: the affine-controlled transition-rate family with compact convex control set A\mathcal{A} and its transition-rate family β\beta; the horizon T>0T>0; the solution of the controlled NN-agent dynamics on the NN-agent driving system (Ω,F,P)(\Omega,\mathcal{F},P) with observation filtration (Gt)t∈[0,T](\mathcal{G}_t)_{t\in[0,T]} and system filtration (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_t)_{t\in[0,T]}; the realized control α^\hat{\alpha}; a point x0x_0 of the probability simplex Δl\Delta^l and the realized mean-field flow Φt(ω)=St(x0,α^(ω))\Phi_t(\omega)=S_t(x_0,\hat{\alpha}(\omega)); a map S∗:[0,T]→RlS^*:[0,T]\to\mathbb{R}^l with continuous components and the deviation process Yt(ω)=∣Φt(ω)−St∗∣Y_t(\omega)=|\Phi_t(\omega)-S^*_t| with supremum Y‾\overline{Y}, where ∣⋅∣|\cdot| is the Euclidean norm; a map A:[0,T]→AA:[0,T]\to\mathcal{A} each of whose components is measurable with respect to the trace Borel σ\sigma-algebra on [0,T][0,T] and the Borel σ\sigma-algebra of the real line, and the control energy process Et(ω)=∫[0,t]∣α^(s,ω)−As∣2 ds\mathcal{E}_t(\omega)=\int_{[0,t]}|\hat{\alpha}(s,\omega)-A_s|^2\,ds of claim 5 of the progressive measurability lemma. Stopping times are those of whichever of the two filtrations (Gt)t∈[0,T](\mathcal{G}_t)_{t\in[0,T]} and (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_t)_{t\in[0,T]} is named, with time index restricted to [0,T][0,T], and for a function θ:Ω→[0,T]\theta:\Omega\to[0,T] and t∈[0,T]t\in[0,T] we write {t<θ}\{t<\theta\} for {ω∈Ω:t<θ(ω)}\{\omega\in\Omega:t<\theta(\omega)\}, and similarly for the other order relations. Throughout, a real-valued function on a subinterval II of the real numbers R\mathbb{R} is called continuous on II when it is continuous relative to II, both II and the codomain R\mathbb{R} carrying the metric of the real line.

Fix a real number εY\varepsilon_Y and a real number cE>0c_{\mathcal{E}}>0. For ω∈Ω\omega\in\Omega put

HY(ω)={t∈[0,T]:Yt(ω)≥εY},HE(ω)={t∈[0,T]:Et(ω)≥cE},H_Y(\omega)=\{t\in[0,T]:Y_t(\omega)\ge\varepsilon_Y\},\qquad H_{\mathcal{E}}(\omega)=\{t\in[0,T]:\mathcal{E}_t(\omega)\ge c_{\mathcal{E}}\},

and define τY(ω)\tau_Y(\omega) to be the greatest lower bound of HY(ω)H_Y(\omega) if HY(ω)≠∅H_Y(\omega)\neq\emptyset and TT otherwise, τE(ω)\tau_{\mathcal{E}}(\omega) to be the greatest lower bound of HE(ω)H_{\mathcal{E}}(\omega) if HE(ω)≠∅H_{\mathcal{E}}(\omega)\neq\emptyset and TT otherwise (in each case the greatest lower bound exists by the existence theorem for infima, the set being nonempty in the case at hand and bounded below by 00), and the good-set time (a stopping time by claim 1 below)

τ(ω)=min⁡(τY(ω),τE(ω)).\tau(\omega)=\min\bigl(\tau_Y(\omega),\tau_{\mathcal{E}}(\omega)\bigr).

Then the following hold.

1. (Stopping times.) Each of τY\tau_Y, τE\tau_{\mathcal{E}} and τ\tau is a stopping time of (Gt)t∈[0,T](\mathcal{G}_t)_{t\in[0,T]} and of (Ftsys)t∈[0,T](\mathcal{F}^{\mathrm{sys}}_t)_{t\in[0,T]}. In particular {t<τ}∈Gt\{t<\tau\}\in\mathcal{G}_t and {τ≤t}∈Gt\{\tau\le t\}\in\mathcal{G}_t for every t∈[0,T]t\in[0,T], and {τ<T}∈GT\{\tau<T\}\in\mathcal{G}_T.

2. (Bounds before and at the stopping time.) For every ω∈Ω\omega\in\Omega and every t∈[0,T]t\in[0,T] with t<τ(ω)t<\tau(\omega),

Yt(ω)<εYandEt(ω)<cE.Y_t(\omega)<\varepsilon_Y\qquad\text{and}\qquad\mathcal{E}_t(\omega)<c_{\mathcal{E}} .

Moreover Emin⁡(t,τ(ω))(ω)≤cE\mathcal{E}_{\min(t,\tau(\omega))}(\omega)\le c_{\mathcal{E}} for every ω∈Ω\omega\in\Omega and every t∈[0,T]t\in[0,T]; and if ∣x0−S0∗∣<εY|x_0-S^*_0|<\varepsilon_Y, then also Ymin⁡(t,τ(ω))(ω)≤εYY_{\min(t,\tau(\omega))}(\omega)\le\varepsilon_Y for every ω∈Ω\omega\in\Omega and every t∈[0,T]t\in[0,T].

3. (Early stopping.) {τ<T}={τY<T}∪{τE<T}\{\tau<T\}=\{\tau_Y<T\}\cup\{\tau_{\mathcal{E}}<T\}, with

{τY<T}⊆{Y‾≥εY},{τE<T}⊆{ET≥cE},{τY=T}⊆{Y‾≤εY},\{\tau_Y<T\}\subseteq\{\overline{Y}\ge\varepsilon_Y\},\qquad\{\tau_{\mathcal{E}}<T\}\subseteq\{\mathcal{E}_T\ge c_{\mathcal{E}}\},\qquad\{\tau_Y=T\}\subseteq\{\overline{Y}\le\varepsilon_Y\},

all three sets on the right belonging to GT\mathcal{G}_T; consequently

P(τ<T)≤P(Y‾≥εY)+P(ET≥cE).P(\tau<T)\le P\bigl(\overline{Y}\ge\varepsilon_Y\bigr)+P\bigl(\mathcal{E}_T\ge c_{\mathcal{E}}\bigr).

Proofs

Log in to submit a proof.

Loading...

Citations

Loading…

Dependencies

Loading…

Related

0 relations

Curated associations between results. These are editable and subjective — they do not replace the dependency graph, which is derived from the references in the text.

No relations recorded yet.

Comments

Log in to comment.

Loading…