Let ( β 0 , β 1 ) (\beta_0,\beta_1) ( β 0 , β 1 ) be an affine-controlled transition-rate family on l l l states with control set A \mathcal{A} A and Lipschitz constant Λ \Lambda Λ , and let Δ l \Delta^l Δ l be the probability simplex . Define
β ( σ , γ , Σ , α ) = β 0 ( σ , γ , Σ ) + β 1 ( σ , γ , Σ ) ⋅ α ( Σ ∈ Δ l , α ∈ A ) , \beta(\sigma,\gamma,\Sigma,\alpha)=\beta_0(\sigma,\gamma,\Sigma)+\beta_1(\sigma,\gamma,\Sigma)\cdot\alpha\qquad(\Sigma\in\Delta^l,\ \alpha\in\mathcal{A}), β ( σ , γ , Σ , α ) = β 0 ( σ , γ , Σ ) + β 1 ( σ , γ , Σ ) ⋅ α ( Σ ∈ Δ l , α ∈ A ) ,
for each ordered pair ( σ , γ ) (\sigma,\gamma) ( σ , γ ) with σ ≠ γ \sigma\neq\gamma σ = γ in { 1 , … , l } \{1,\dots,l\} { 1 , … , l } , where x ⋅ y x\cdot y x ⋅ y denotes the dot product and ∣ ⋅ ∣ |\cdot| ∣ ⋅ ∣ the Euclidean norm . Let
R = sup α ∈ A ∣ α ∣ , K 1 = sup ∣ β 1 ( σ , γ , Σ ) ∣ , B = sup β ( σ , γ , Σ , α ) , R=\sup_{\alpha\in\mathcal{A}}|\alpha|,\qquad K_1=\sup|\beta_1(\sigma,\gamma,\Sigma)|,\qquad B=\sup\beta(\sigma,\gamma,\Sigma,\alpha), R = α ∈ A sup ∣ α ∣ , K 1 = sup ∣ β 1 ( σ , γ , Σ ) ∣ , B = sup β ( σ , γ , Σ , α ) ,
the latter suprema being over all ordered pairs ( σ , γ ) (\sigma,\gamma) ( σ , γ ) with σ ≠ γ \sigma\neq\gamma σ = γ , all Σ ∈ Δ l \Sigma\in\Delta^l Σ ∈ Δ l and all α ∈ A \alpha\in\mathcal{A} α ∈ A , and set Λ β = Λ ( 1 + R ) \Lambda_\beta=\Lambda(1+R) Λ β = Λ ( 1 + R ) and Λ b = 2 l ( l − 1 ) ( B + Λ β ) \Lambda_b=2\sqrt{l}\,(l-1)(B+\Lambda_\beta) Λ b = 2 l ( l − 1 ) ( B + Λ β ) .
1. (Finiteness.) R R R , K 1 K_1 K 1 and B B B are finite nonnegative real numbers , and the nearest-point projection π Δ l \pi_{\Delta^l} π Δ l onto Δ l \Delta^l Δ l is defined.
2. (Transition-rate family.) β \beta β is a transition-rate family on l l l states with control set A \mathcal{A} A and rate bound B B B . Moreover, for each fixed α ∈ A \alpha\in\mathcal{A} α ∈ A the map Σ ↦ β ( σ , γ , Σ , α ) \Sigma\mapsto\beta(\sigma,\gamma,\Sigma,\alpha) Σ ↦ β ( σ , γ , Σ , α ) is Lipschitz with constant Λ β \Lambda_\beta Λ β on Δ l \Delta^l Δ l .
3. (Affine drift.) Let b b b be the aggregate state drift of β \beta β , and define, for Σ ∈ Δ l \Sigma\in\Delta^l Σ ∈ Δ l and γ ∈ { 1 , … , l } \gamma\in\{1,\dots,l\} γ ∈ { 1 , … , l } ,
b 0 γ ( Σ ) = ∑ σ ≠ γ ( Σ σ β 0 ( σ , γ , Σ ) − Σ γ β 0 ( γ , σ , Σ ) ) , b 1 γ ( Σ ) = ∑ σ ≠ γ ( Σ σ β 1 ( σ , γ , Σ ) − Σ γ β 1 ( γ , σ , Σ ) ) , b^\gamma_0(\Sigma)=\sum_{\sigma\neq\gamma}\big(\Sigma^\sigma\beta_0(\sigma,\gamma,\Sigma)-\Sigma^\gamma\beta_0(\gamma,\sigma,\Sigma)\big),\qquad b^\gamma_1(\Sigma)=\sum_{\sigma\neq\gamma}\big(\Sigma^\sigma\beta_1(\sigma,\gamma,\Sigma)-\Sigma^\gamma\beta_1(\gamma,\sigma,\Sigma)\big), b 0 γ ( Σ ) = σ = γ ∑ ( Σ σ β 0 ( σ , γ , Σ ) − Σ γ β 0 ( γ , σ , Σ ) ) , b 1 γ ( Σ ) = σ = γ ∑ ( Σ σ β 1 ( σ , γ , Σ ) − Σ γ β 1 ( γ , σ , Σ ) ) ,
with values in R \mathbb{R} R and R m \mathbb{R}^m R m respectively. Then
b γ ( Σ , α ) = b 0 γ ( Σ ) + b 1 γ ( Σ ) ⋅ α for all Σ ∈ Δ l , α ∈ A . b^\gamma(\Sigma,\alpha)=b^\gamma_0(\Sigma)+b^\gamma_1(\Sigma)\cdot\alpha\qquad\text{for all }\Sigma\in\Delta^l,\ \alpha\in\mathcal{A}. b γ ( Σ , α ) = b 0 γ ( Σ ) + b 1 γ ( Σ ) ⋅ α for all Σ ∈ Δ l , α ∈ A .
4. (Bounds.) For all Σ , Σ ′ ∈ Δ l \Sigma,\Sigma'\in\Delta^l Σ , Σ ′ ∈ Δ l and all α , α ′ ∈ A \alpha,\alpha'\in\mathcal{A} α , α ′ ∈ A ,
∣ b ( Σ , α ) ∣ ≤ 2 l ( l − 1 ) B , ∣ b ( Σ , α ) − b ( Σ ′ , α ) ∣ ≤ Λ b ∣ Σ − Σ ′ ∣ , ∣ b ( Σ , α ) − b ( Σ , α ′ ) ∣ ≤ 2 l ( l − 1 ) K 1 ∣ α − α ′ ∣ . |b(\Sigma,\alpha)|\le2\sqrt{l}\,(l-1)B,\qquad |b(\Sigma,\alpha)-b(\Sigma',\alpha)|\le\Lambda_b\,|\Sigma-\Sigma'|,\qquad |b(\Sigma,\alpha)-b(\Sigma,\alpha')|\le2\sqrt{l}\,(l-1)K_1|\alpha-\alpha'| . ∣ b ( Σ , α ) ∣ ≤ 2 l ( l − 1 ) B , ∣ b ( Σ , α ) − b ( Σ ′ , α ) ∣ ≤ Λ b ∣Σ − Σ ′ ∣ , ∣ b ( Σ , α ) − b ( Σ , α ′ ) ∣ ≤ 2 l ( l − 1 ) K 1 ∣ α − α ′ ∣.
5. (Conservation and inflow bound.) For all Σ ∈ Δ l \Sigma\in\Delta^l Σ ∈ Δ l , α ∈ A \alpha\in\mathcal{A} α ∈ A and γ ∈ { 1 , … , l } \gamma\in\{1,\dots,l\} γ ∈ { 1 , … , l } ,
∑ γ = 1 l b γ ( Σ , α ) = 0 , b γ ( Σ , α ) ≥ − ( l − 1 ) B Σ γ . \sum_{\gamma=1}^lb^\gamma(\Sigma,\alpha)=0,\qquad b^\gamma(\Sigma,\alpha)\ge-(l-1)B\,\Sigma^\gamma . γ = 1 ∑ l b γ ( Σ , α ) = 0 , b γ ( Σ , α ) ≥ − ( l − 1 ) B Σ γ .
6. (Projected drift.) Define b ^ : R l × A → R l \hat{b}:\mathbb{R}^l\times\mathcal{A}\to\mathbb{R}^l b ^ : R l × A → R l by b ^ ( x , α ) = b ( π Δ l ( x ) , α ) \hat{b}(x,\alpha)=b(\pi_{\Delta^l}(x),\alpha) b ^ ( x , α ) = b ( π Δ l ( x ) , α ) . Then b ^ ( x , α ) = b ( x , α ) \hat{b}(x,\alpha)=b(x,\alpha) b ^ ( x , α ) = b ( x , α ) for x ∈ Δ l x\in\Delta^l x ∈ Δ l , ∣ b ^ ( x , α ) ∣ ≤ 2 l ( l − 1 ) B |\hat{b}(x,\alpha)|\le2\sqrt{l}\,(l-1)B ∣ b ^ ( x , α ) ∣ ≤ 2 l ( l − 1 ) B for all x ∈ R l x\in\mathbb{R}^l x ∈ R l and α ∈ A \alpha\in\mathcal{A} α ∈ A , and ∣ b ^ ( x , α ) − b ^ ( x ′ , α ) ∣ ≤ Λ b ∣ x − x ′ ∣ |\hat{b}(x,\alpha)-\hat{b}(x',\alpha)|\le\Lambda_b|x-x'| ∣ b ^ ( x , α ) − b ^ ( x ′ , α ) ∣ ≤ Λ b ∣ x − x ′ ∣ for all x , x ′ ∈ R l x,x'\in\mathbb{R}^l x , x ′ ∈ R l and α ∈ A \alpha\in\mathcal{A} α ∈ A .