Adopt the setting, hypotheses and notation of the time-shift lemma for the mean-field control problem : the affine-controlled transition-rate family ( β 0 , β 1 ) (\beta_{0},\beta_{1}) ( β 0 , β 1 ) on l l l states — whose control set A ⊆ R m \mathcal{A}\subseteq\mathbb{R}^{m} A ⊆ R m is nonempty, compact and convex as part of its data — and its transition-rate family β \beta β , the horizon T > 0 T>0 T > 0 , the population cost data ( L , G ) (L,G) ( L , G ) with L L L convex in the control on A \mathcal{A} A , the probability simplex Δ l \Delta^{l} Δ l , the value-layer objects of the optimal-solution-set definition together with their horizon-θ \theta θ instances superscripted by [ θ ] [\theta] [ θ ] — in particular the sets U A \mathcal{U}_{\mathcal{A}} U A and U A [ θ ] \mathcal{U}^{[\theta]}_{\mathcal{A}} U A [ θ ] of A \mathcal{A} A -valued controls , the mean-field costs F F F and F [ θ ] F^{[\theta]} F [ θ ] , and the optimal values J x ∗ J^{*}_{x} J x ∗ and J x ∗ [ θ ] J^{*[\theta]}_{x} J x ∗ [ θ ] — the rate extension ( U , V , β ˉ ) (U,V,\bar{\beta}) ( U , V , β ˉ ) with derivative bound K K K , the cost extension ( U c , L ˉ , G ˉ ) (U_{c},\bar{L},\bar{G}) ( U c , L ˉ , G ˉ ) with second-derivative bound K c K_{c} K c , and the stationary mean-field triple ( S , A , P ) (S,A,P) ( S , A , P ) with horizon T T T . The variable t 0 t_{0} t 0 , fixed in the time-shift lemma, is not fixed here: for each t 0 ∈ [ 0 , T ) t_{0}\in[0,T) t 0 ∈ [ 0 , T ) we write T ♯ = T − t 0 T^{\sharp}=T-t_{0} T ♯ = T − t 0 and S ♯ S^{\sharp} S ♯ , A ♯ A^{\sharp} A ♯ , P ♯ P^{\sharp} P ♯ for the shifted maps of that lemma — all depending on t 0 t_{0} t 0 , left implicit in the notation — and invoke its conclusions for that t 0 t_{0} t 0 . Write ∣ ⋅ ∣ |\cdot| ∣ ⋅ ∣ for the Euclidean norm and ∫ [ a , b ] ⋅ d t \int_{[a,b]}\cdot\,dt ∫ [ a , b ] ⋅ d t for the Lebesgue integral over a compact interval .
Fix a real C P C_{P} C P with ∑ δ = 1 l ∣ P t δ ∣ ≤ C P \sum_{\delta=1}^{l}|P^{\delta}_{t}|\le C_{P} ∑ δ = 1 l ∣ P t δ ∣ ≤ C P for all t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] , which exists by clause 1 of the co-state definition and the extreme value theorem , and adopt the constants M 2 = K c + 3 l K C P M_{2}=K_{c}+3\,l\,K\,C_{P} M 2 = K c + 3 l K C P and C 2 = 1 2 ( l + m ) M 2 C_{2}=\tfrac{1}{2}(l+m)M_{2} C 2 = 2 1 ( l + m ) M 2 of part (b) of the first-order expansion lemma for the mean-field cost and the constant Λ b \Lambda_{b} Λ b of the affine rate-family lemma . Define
C u p = ( C 2 T + l K c 2 ) e 2 Λ b T , C_{up}=\Big(C_{2}\,T+\tfrac{l\,K_{c}}{2}\Big)\,e^{2\Lambda_{b}T}, C u p = ( C 2 T + 2 l K c ) e 2 Λ b T ,
with the exponential function .
Then the following hold.
1. (Upper support bound.) For every t 0 ∈ [ 0 , T ) t_{0}\in[0,T) t 0 ∈ [ 0 , T ) and every x ∈ Δ l x\in\Delta^{l} x ∈ Δ l ,
J x ∗ [ T ♯ ] ≤ ∫ [ t 0 , T ] L ( S t , A t ) d t + G ( S T ) − ∑ γ = 1 l P t 0 γ ( x γ − S t 0 γ ) + C u p ∣ x − S t 0 ∣ 2 . J^{*[T^{\sharp}]}_{x}\ \le\ \int_{[t_{0},T]}L(S_{t},A_{t})\,dt+G(S_{T})-\sum_{\gamma=1}^{l}P^{\gamma}_{t_{0}}\,\big(x^{\gamma}-S^{\gamma}_{t_{0}}\big)+C_{up}\,\big|x-S_{t_{0}}\big|^{2}. J x ∗ [ T ♯ ] ≤ ∫ [ t 0 , T ] L ( S t , A t ) d t + G ( S T ) − γ = 1 ∑ l P t 0 γ ( x γ − S t 0 γ ) + C u p x − S t 0 2 .
2. (To-go comparison inequality.) Assume [ A ] ∈ M S 0 ∗ [A]\in\mathcal{M}^{*}_{S_{0}} [ A ] ∈ M S 0 ∗ , and assume:
(TG) (First-order regularity of the to-go value along the triple.) There are real numbers ε t g > 0 \varepsilon_{tg}>0 ε t g > 0 and C t g ≥ 0 C_{tg}\ge0 C t g ≥ 0 such that for every t 0 ∈ [ 0 , T ) t_{0}\in[0,T) t 0 ∈ [ 0 , T ) and every x ∈ Δ l x\in\Delta^{l} x ∈ Δ l with ∣ x − S t 0 ∣ ≤ ε t g |x-S_{t_{0}}|\le\varepsilon_{tg} ∣ x − S t 0 ∣ ≤ ε t g ,
J x ∗ [ T ♯ ] ≥ J S t 0 ∗ [ T ♯ ] − ∑ γ = 1 l P t 0 γ ( x γ − S t 0 γ ) − C t g ∣ x − S t 0 ∣ 2 . J^{*[T^{\sharp}]}_{x}\ \ge\ J^{*[T^{\sharp}]}_{S_{t_{0}}}-\sum_{\gamma=1}^{l}P^{\gamma}_{t_{0}}\,\big(x^{\gamma}-S^{\gamma}_{t_{0}}\big)-C_{tg}\,\big|x-S_{t_{0}}\big|^{2}. J x ∗ [ T ♯ ] ≥ J S t 0 ∗ [ T ♯ ] − γ = 1 ∑ l P t 0 γ ( x γ − S t 0 γ ) − C t g x − S t 0 2 .
Then for every t 0 ∈ [ 0 , T ) t_{0}\in[0,T) t 0 ∈ [ 0 , T ) , every x ∈ Δ l x\in\Delta^{l} x ∈ Δ l with ∣ x − S t 0 ∣ ≤ ε t g |x-S_{t_{0}}|\le\varepsilon_{tg} ∣ x − S t 0 ∣ ≤ ε t g , and every ξ ∈ U A [ T ♯ ] \xi\in\mathcal{U}^{[T^{\sharp}]}_{\mathcal{A}} ξ ∈ U A [ T ♯ ] ,
F [ T ♯ ] ( x , ξ ) ≥ ∫ [ t 0 , T ] L ( S t , A t ) d t + G ( S T ) − ∑ γ = 1 l P t 0 γ ( x γ − S t 0 γ ) − C t g ∣ x − S t 0 ∣ 2 . F^{[T^{\sharp}]}(x,\xi)\ \ge\ \int_{[t_{0},T]}L(S_{t},A_{t})\,dt+G(S_{T})-\sum_{\gamma=1}^{l}P^{\gamma}_{t_{0}}\,\big(x^{\gamma}-S^{\gamma}_{t_{0}}\big)-C_{tg}\,\big|x-S_{t_{0}}\big|^{2}. F [ T ♯ ] ( x , ξ ) ≥ ∫ [ t 0 , T ] L ( S t , A t ) d t + G ( S T ) − γ = 1 ∑ l P t 0 γ ( x γ − S t 0 γ ) − C t g x − S t 0 2 .