Moment Bounds for the Aggregate Compensated Counters of the Controlled N-Agent Dynamics

Adopt the setting of the compensated counters of the controlled $N$-agent dynamics with $N$ agents, $l$ states, $\tilde{l}$ observation channels, and control dimension $m$: a transition-rate family $\beta$ with rate bound $B$, an observation-rate family $\tilde{\beta}$ with rate bound $\tilde{B}$, a horizon $T>0$, an $N$-agent driving system $(\Omega,\mathcal{F},P)$, an observation-driven control policy $h$, a solution on $[0,T]$ with regular event $\Omega_0$, counters $N^{i,\sigma\gamma}_t$, consumed clock times $\mathcal{T}^{i,\sigma\gamma}_t$, and system filtration $(\mathcal{F}^{\mathrm{sys}}_t)_{t\in[0,T]}$, and the compensated counters $M^{i,\sigma\gamma}_t=N^{i,\sigma\gamma}_t-\mathcal{T}^{i,\sigma\gamma}_t$ of that lemma. Write $\mathbb{E}$ for the expectation. For each ordered pair $(\sigma,\gamma)$ of distinct states define the aggregate counter, the aggregate consumed clock time, and the aggregate compensated counter

the fraktur $\mathfrak{A}^{\sigma\gamma}$, a sum of consumed clock times, is unrelated to the calligraphic control-energy symbol $\mathcal{A}$ used in companion results of this series. Then, for every ordered pair $(\sigma,\gamma)$ of distinct states:

(a) (Martingale, counting-path, and compensator properties.) $(\mathfrak{M}^{\sigma\gamma}_t)_{t\in[0,T]}$ is a square-integrable martingale with respect to $(\mathcal{F}^{\mathrm{sys}}_t)_{t\in[0,T]}$ with $\mathfrak{M}^{\sigma\gamma}_0=0$; almost surely, $t\mapsto\mathcal{N}^{\sigma\gamma}_t$ agrees on $[0,T]$ with a counting path; and at every $\omega\in\Omega$ and all $0\le r\le t\le T$,

(b) (Second and fourth moments.) For every $t\in[0,T]$, the powers $(\mathfrak{M}^{\sigma\gamma}_t)^2$ and $(\mathfrak{M}^{\sigma\gamma}_t)^4$ are integrable, and

(c) (Aggregate state martingale.) Let $M_t=(M^\gamma_t)_{\gamma\in\{1,\dots,l\}}$ be as in the martingale decomposition (the superscript shapes distinguish the per-clock compensated counters $M^{i,\sigma\gamma}$, the aggregate compensated counters $\mathfrak{M}^{\sigma\gamma}$, and the state martingales $M^\gamma$), and write $|\cdot|$ for the Euclidean norm (Euclidean distance to the origin) and $\sqrt{N}$ for the nonnegative square root. Then, almost surely, for every $\gamma\in\{1,\dots,l\}$ and every $t\in[0,T]$,

the sum running over $\sigma\in\{1,\dots,l\}$ with $\sigma\neq\gamma$; and consequently, for every $t\in[0,T]$,