Adopt the setting and notation of the first-order expansion lemma for the recentred N N N -agent cost : the transition-rate family β \beta β on l l l states with control set A ⊆ R m \mathcal{A}\subseteq\mathbb{R}^{m} A ⊆ R m and rate bound B B B ; the observation-rate family β ~ \tilde{\beta} β ~ ; the horizon T > 0 T>0 T > 0 ; the N N N -agent driving system ; the A \mathcal{A} A -valued observation-driven control policy h h h ; the solution on [ 0 , T ] [0,T] [ 0 , T ] with regular event Ω 0 \Omega_{0} Ω 0 , empirical state measure Σ t \Sigma_{t} Σ t and control α t \alpha_{t} α t ; the mean-field trajectory pair ( S , A ) (S,A) ( S , A ) ; the fluctuation processes s t = N ( Σ t − S t ) \mathfrak{s}_{t}=\sqrt{N}(\Sigma_{t}-S_{t}) s t = N ( Σ t − S t ) and a t = N ( α t − A t ) \mathfrak{a}_{t}=\sqrt{N}(\alpha_{t}-A_{t}) a t = N ( α t − A t ) ; the population cost data ( L , G ) (L,G) ( L , G ) ; the twice continuously differentiable extension ( U , V , β ˉ ) (U,V,\bar{\beta}) ( U , V , β ˉ ) of β \beta β with derivative bound K K K and extended aggregate state drift b ˉ \bar{b} b ˉ ; the twice continuously differentiable extension ( U c , L ˉ , G ˉ ) (U_{c},\bar{L},\bar{G}) ( U c , L ˉ , G ˉ ) of ( L , G ) (L,G) ( L , G ) with second-derivative bound K c K_{c} K c ; the stationary co-state P P P with its bound C P C_{P} C P , so that ( S , A , P ) (S,A,P) ( S , A , P ) is a stationary mean-field triple; the mean-field Hamiltonian H t ( Σ , α ) = L ˉ ( Σ , α ) − ∑ δ = 1 l P t δ b ˉ δ ( Σ , α ) \mathcal{H}_{t}(\Sigma,\alpha)=\bar{L}(\Sigma,\alpha)-\sum_{\delta=1}^{l}P^{\delta}_{t}\bar{b}^{\delta}(\Sigma,\alpha) H t ( Σ , α ) = L ˉ ( Σ , α ) − ∑ δ = 1 l P t δ b ˉ δ ( Σ , α ) and its state derivative coefficients ∂ γ H t \partial_{\gamma}\mathcal{H}_{t} ∂ γ H t ; the abbreviation y t = Σ t − S t y_{t}=\Sigma_{t}-S_{t} y t = Σ t − S t ; and the quantities
D t = H t ( Σ t , α t ) − H t ( S t , A t ) − ∑ γ = 1 l ∂ γ H t ( S t , A t ) y t γ , D G = G ˉ ( Σ T ) − G ˉ ( S T ) − ∑ γ = 1 l ∂ γ G ˉ ( S T ) y T γ . \mathcal{D}_{t}=\mathcal{H}_{t}(\Sigma_{t},\alpha_{t})-\mathcal{H}_{t}(S_{t},A_{t})-\sum_{\gamma=1}^{l}\partial_{\gamma}\mathcal{H}_{t}(S_{t},A_{t})\,y^{\gamma}_{t},\qquad \mathcal{D}_{G}=\bar{G}(\Sigma_{T})-\bar{G}(S_{T})-\sum_{\gamma=1}^{l}\partial_{\gamma}\bar{G}(S_{T})\,y^{\gamma}_{T}. D t = H t ( Σ t , α t ) − H t ( S t , A t ) − γ = 1 ∑ l ∂ γ H t ( S t , A t ) y t γ , D G = G ˉ ( Σ T ) − G ˉ ( S T ) − γ = 1 ∑ l ∂ γ G ˉ ( S T ) y T γ .
Write d d d for the Euclidean distance , ∣ ⋅ ∣ |\cdot| ∣ ⋅ ∣ for the Euclidean norm, Δ l \Delta^{l} Δ l for the probability simplex , and ⋅ \sqrt{\cdot} ⋅ for the nonnegative square root . Assume, as there, hypothesis (A) : A \mathcal{A} A is compact and convex . Adopt the fluctuation Hessian coefficients H i j ( t ) H_{ij}(t) H ij ( t ) (i , j ∈ { 1 , … , l + m } i,j\in\{1,\dots,l+m\} i , j ∈ { 1 , … , l + m } ) and the terminal coefficients F γ δ = ∂ δ ∂ γ G ˉ ( S T ) F_{\gamma\delta}=\partial_{\delta}\partial_{\gamma}\bar{G}(S_{T}) F γ δ = ∂ δ ∂ γ G ˉ ( S T ) of these data, and the moduli of continuity ω L \omega_{L} ω L , ω b \omega_{b} ω b and ω G \omega_{G} ω G of the second-order expansion theorem for the N N N -agent cost , which by part (a) of that theorem are nondecreasing functions from [ 0 , ∞ ) [0,\infty) [ 0 , ∞ ) to [ 0 , ∞ ) [0,\infty) [ 0 , ∞ ) , bounded by 2 K c 2K_{c} 2 K c , 6 l K 6\,l\,K 6 l K and 2 K c 2K_{c} 2 K c respectively, and such that for every real ε > 0 \varepsilon>0 ε > 0 there is a real η > 0 \eta>0 η > 0 with ω L ( u ) ≤ ε \omega_{L}(u)\le\varepsilon ω L ( u ) ≤ ε , ω b ( u ) ≤ ε \omega_{b}(u)\le\varepsilon ω b ( u ) ≤ ε and ω G ( u ) ≤ ε \omega_{G}(u)\le\varepsilon ω G ( u ) ≤ ε for all u ∈ [ 0 , η ] u\in[0,\eta] u ∈ [ 0 , η ] .
For t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] write z t = ( s t , a t ) \mathfrak{z}_{t}=(\mathfrak{s}_{t},\mathfrak{a}_{t}) z t = ( s t , a t ) for the R l + m \mathbb{R}^{l+m} R l + m -valued map whose first l l l components are those of s t \mathfrak{s}_{t} s t and whose last m m m components are those of a t \mathfrak{a}_{t} a t , so that ∣ z t ∣ 2 = ∣ s t ∣ 2 + ∣ a t ∣ 2 |\mathfrak{z}_{t}|^{2}=|\mathfrak{s}_{t}|^{2}+|\mathfrak{a}_{t}|^{2} ∣ z t ∣ 2 = ∣ s t ∣ 2 + ∣ a t ∣ 2 . For t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] and ω ∈ Ω \omega\in\Omega ω ∈ Ω write, as in that theorem,
ρ t = d ( ( Σ t , α t ) , ( S t , A t ) ) = N − 1 / 2 ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) 1 / 2 , d ( Σ T , S T ) = N − 1 / 2 ∣ s T ∣ . \rho_{t}=d\bigl((\Sigma_{t},\alpha_{t}),(S_{t},A_{t})\bigr)=N^{-1/2}\bigl(|\mathfrak{s}_{t}|^{2}+|\mathfrak{a}_{t}|^{2}\bigr)^{1/2},\qquad d(\Sigma_{T},S_{T})=N^{-1/2}|\mathfrak{s}_{T}| . ρ t = d ( ( Σ t , α t ) , ( S t , A t ) ) = N − 1/2 ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) 1/2 , d ( Σ T , S T ) = N − 1/2 ∣ s T ∣.
Hypothesis (JC) (Local joint coercivity of the cost). There is a real number c J > 0 c_{J}>0 c J > 0 such that
1 2 ∑ i = 1 l + m ∑ j = 1 l + m H i j ( t ) w i w j ≥ c J ∣ w ∣ 2 for every t ∈ [ 0 , T ] and every w ∈ R l + m , \tfrac{1}{2}\sum_{i=1}^{l+m}\sum_{j=1}^{l+m}H_{ij}(t)\,w^{i}w^{j}\ \ge\ c_{J}\,|w|^{2}\qquad\text{for every }t\in[0,T]\text{ and every }w\in\mathbb{R}^{l+m}, 2 1 i = 1 ∑ l + m j = 1 ∑ l + m H ij ( t ) w i w j ≥ c J ∣ w ∣ 2 for every t ∈ [ 0 , T ] and every w ∈ R l + m ,
and the terminal coefficients are positive semidefinite:
∑ γ = 1 l ∑ δ = 1 l F γ δ v γ v δ ≥ 0 for every v ∈ R l . \sum_{\gamma=1}^{l}\sum_{\delta=1}^{l}F_{\gamma\delta}\,v^{\gamma}v^{\delta}\ \ge\ 0\qquad\text{for every }v\in\mathbb{R}^{l}. γ = 1 ∑ l δ = 1 ∑ l F γ δ v γ v δ ≥ 0 for every v ∈ R l .
Then the following hold.
1. (Second-order remainder bound.) For every t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] and every ω ∈ Ω \omega\in\Omega ω ∈ Ω ,
∣ N D t − 1 2 ∑ i = 1 l + m ∑ j = 1 l + m H i j ( t ) z t i z t j ∣ ≤ 1 2 ( l + m ) ( ω L ( ρ t ) + C P ω b ( ρ t ) ) ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) , \Bigl|\,N\,\mathcal{D}_{t}-\tfrac{1}{2}\sum_{i=1}^{l+m}\sum_{j=1}^{l+m}H_{ij}(t)\,\mathfrak{z}^{i}_{t}\,\mathfrak{z}^{j}_{t}\,\Bigr|\ \le\ \tfrac{1}{2}\,(l+m)\,\bigl(\omega_{L}(\rho_{t})+C_{P}\,\omega_{b}(\rho_{t})\bigr)\,\bigl(|\mathfrak{s}_{t}|^{2}+|\mathfrak{a}_{t}|^{2}\bigr), N D t − 2 1 i = 1 ∑ l + m j = 1 ∑ l + m H ij ( t ) z t i z t j ≤ 2 1 ( l + m ) ( ω L ( ρ t ) + C P ω b ( ρ t ) ) ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) ,
and for every ω ∈ Ω \omega\in\Omega ω ∈ Ω ,
∣ N D G − 1 2 ∑ γ = 1 l ∑ δ = 1 l F γ δ s T γ s T δ ∣ ≤ 1 2 l ω G ( d ( Σ T , S T ) ) ∣ s T ∣ 2 . \Bigl|\,N\,\mathcal{D}_{G}-\tfrac{1}{2}\sum_{\gamma=1}^{l}\sum_{\delta=1}^{l}F_{\gamma\delta}\,\mathfrak{s}^{\gamma}_{T}\,\mathfrak{s}^{\delta}_{T}\,\Bigr|\ \le\ \tfrac{1}{2}\,l\,\omega_{G}\bigl(d(\Sigma_{T},S_{T})\bigr)\,|\mathfrak{s}_{T}|^{2}. N D G − 2 1 γ = 1 ∑ l δ = 1 ∑ l F γ δ s T γ s T δ ≤ 2 1 l ω G ( d ( Σ T , S T ) ) ∣ s T ∣ 2 .
This conclusion does not use (JC).
2. (A coercivity radius.) There is a real number ρ ∗ > 0 \rho^{*}>0 ρ ∗ > 0 such that
1 2 ( l + m ) ( ω L ( u ) + C P ω b ( u ) ) ≤ c J 2 for every u ∈ [ 0 , ρ ∗ ] . \tfrac{1}{2}\,(l+m)\,\bigl(\omega_{L}(u)+C_{P}\,\omega_{b}(u)\bigr)\ \le\ \tfrac{c_{J}}{2}\qquad\text{for every }u\in[0,\rho^{*}]. 2 1 ( l + m ) ( ω L ( u ) + C P ω b ( u ) ) ≤ 2 c J for every u ∈ [ 0 , ρ ∗ ] .
3. (Localized joint coercivity.) Let ρ ∗ \rho^{*} ρ ∗ be as in claim 2. For every t ∈ [ 0 , T ] t\in[0,T] t ∈ [ 0 , T ] and every ω ∈ Ω \omega\in\Omega ω ∈ Ω with ρ t ( ω ) ≤ ρ ∗ \rho_{t}(\omega)\le\rho^{*} ρ t ( ω ) ≤ ρ ∗ ,
N D t ≥ c J 2 ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) . N\,\mathcal{D}_{t}\ \ge\ \frac{c_{J}}{2}\,\bigl(|\mathfrak{s}_{t}|^{2}+|\mathfrak{a}_{t}|^{2}\bigr). N D t ≥ 2 c J ( ∣ s t ∣ 2 + ∣ a t ∣ 2 ) .
In particular N D t ≥ c J 2 ∣ a t ∣ 2 N\mathcal{D}_{t}\ge\tfrac{c_{J}}{2}|\mathfrak{a}_{t}|^{2} N D t ≥ 2 c J ∣ a t ∣ 2 there, with no deficit in the state fluctuation.
4. (Terminal bound.) For every ω ∈ Ω \omega\in\Omega ω ∈ Ω ,
N D G ≥ − 1 2 l ω G ( d ( Σ T , S T ) ) ∣ s T ∣ 2 ; N\,\mathcal{D}_{G}\ \ge\ -\,\tfrac{1}{2}\,l\,\omega_{G}\bigl(d(\Sigma_{T},S_{T})\bigr)\,|\mathfrak{s}_{T}|^{2}; N D G ≥ − 2 1 l ω G ( d ( Σ T , S T ) ) ∣ s T ∣ 2 ;
consequently, for every real ϵ > 0 \epsilon>0 ϵ > 0 there is a real ρ G ∗ > 0 \rho^{*}_{G}>0 ρ G ∗ > 0 such that N D G ≥ − ϵ ∣ s T ∣ 2 N\mathcal{D}_{G}\ge-\epsilon\,|\mathfrak{s}_{T}|^{2} N D G ≥ − ϵ ∣ s T ∣ 2 at every ω ∈ Ω \omega\in\Omega ω ∈ Ω with d ( Σ T , S T ) ≤ ρ G ∗ d(\Sigma_{T},S_{T})\le\rho^{*}_{G} d ( Σ T , S T ) ≤ ρ G ∗ .
5. (Joint coercivity implies control-block coercivity.) Hypothesis (H1) of the quadratic growth lemma for the mean-field Hamiltonian holds with the constant r = c J r=c_{J} r = c J ; that is, writing R t R_{t} R t for the matrix defined there,
h ⋅ R t h ≥ c J ∣ h ∣ 2 for every t ∈ [ 0 , T ] and every h ∈ R m . h\cdot R_{t}h\ \ge\ c_{J}\,|h|^{2}\qquad\text{for every }t\in[0,T]\text{ and every }h\in\mathbb{R}^{m}. h ⋅ R t h ≥ c J ∣ h ∣ 2 for every t ∈ [ 0 , T ] and every h ∈ R m .
In particular, if in addition hypothesis (U) of that lemma holds, its conclusion (d) furnishes a real r 0 > 0 r_{0}>0 r 0 > 0 with H t ( S t , a ) − H t ( S t , A t ) ≥ r 0 ∣ a − A t ∣ 2 \mathcal{H}_{t}(S_{t},a)-\mathcal{H}_{t}(S_{t},A_{t})\ge r_{0}|a-A_{t}|^{2} H t ( S t , a ) − H t ( S t , A t ) ≥ r 0 ∣ a − A t ∣ 2 for all t t t and all a ∈ A a\in\mathcal{A} a ∈ A , so that the conclusions of the first-order expansion lemma requiring (H1) are available under (JC) as well.