Structure of the Optimal Control Set and Separation of Near-Optimal Controls

Adopt the setting, hypotheses and notation of the optimal value, controls and trajectories of the mean-field problem: the initial state $\sigma\in\Delta^{l}$, the optimal value $J^{*}_{\sigma}$, the set $\mathcal{M}^{*}_{\sigma}$ of optimal controls, the mean-field flow $S(x_{0},\xi)$ of claim 2 of the flow stability lemma, the mean-field cost $F$, the metric $\rho$ on $\mathcal{U}_{\mathcal{A}}$, and the product metric space $(X,d_{X})$ with $X=\Delta^{l}\times\mathcal{U}_{\mathcal{A}}$ of the boundedness, lower semicontinuity and attainment theorem. Write $|\cdot|$ for the Euclidean norm on $\mathbb{R}^{l}$ and let $\mathbb{N}$ be the natural numbers.

For $x_{0}\in\Delta^{l}$ and $\xi,\zeta\in\mathcal{U}_{\mathcal{A}}$ put

Then the following hold.

1. (Structure of the optimal control set.) $\mathcal{M}^{*}_{\sigma}=\{\xi\in\mathcal{U}_{\mathcal{A}}:F(\sigma,\xi)\le J^{*}_{\sigma}\}$; the set $\mathcal{M}^{*}_{\sigma}$ is nonempty; it is closed in the topological space whose underlying set is $\mathcal{U}_{\mathcal{A}}$ and whose open sets are the subsets open in $(\mathcal{U}_{\mathcal{A}},\rho)$; and it is a compact and sequentially compact subset of $(\mathcal{U}_{\mathcal{A}},\rho)$.

2. (Deviation from the optimal set.) For all $x_{0}\in\Delta^{l}$ and $\xi,\zeta\in\mathcal{U}_{\mathcal{A}}$ the supremum $\Psi(x_{0},\xi,\zeta)$ exists. Moreover, for all $x_{0}\in\Delta^{l}$ and $\xi\in\mathcal{U}_{\mathcal{A}}$ there is $\zeta^{\dagger}\in\mathcal{M}^{*}_{\sigma}$ with

and the value $\Psi(x_{0},\xi,\zeta^{\dagger})$ is the same for every $\zeta^{\dagger}\in\mathcal{M}^{*}_{\sigma}$ with this property. Write $D(x_{0},\xi)$ for that common value. Then $0\le D(x_{0},\xi)$ for all $x_{0}\in\Delta^{l}$ and $\xi\in\mathcal{U}_{\mathcal{A}}$, and $D(\sigma,\xi^{*})=0$ for every $\xi^{*}\in\mathcal{M}^{*}_{\sigma}$.

3. (Comparison estimate.) Let $x_{0},x_{0}'\in\Delta^{l}$ and $\xi,\xi'\in\mathcal{U}_{\mathcal{A}}$. Then the supremum

exists and $\bigl|D(x_{0},\xi)-D(x_{0}',\xi')\bigr|\le\Theta$.

4. (Sequential continuity of the deviation.) Let $\bigl((x^{j}_{0},\xi_{j})\bigr)_{j\in\mathbb{N}}$ be a sequence in $X$ that converges to $(x_{0},\xi)\in X$ in $(X,d_{X})$. Then the real sequence $\bigl(D(x^{j}_{0},\xi_{j})\bigr)_{j\in\mathbb{N}}$ has limit $D(x_{0},\xi)$.

5. (Separation of near-optimal controls.) For every real $\varepsilon>0$ there is a real $\eta>0$ such that every $\xi\in\mathcal{U}_{\mathcal{A}}$ satisfying $F(\sigma,\xi)\le J^{*}_{\sigma}+\eta$ satisfies $D(\sigma,\xi)<\varepsilon$.