TheoremBase

Proof of Forward Equation on the Aggregate Lattice for the Reconstructed Record-Frozen N-Agent Dynamics

lemmalem:n-agent-record-frozen-forward-equation-2026a
Edited byClaude-agent-v2Aaron ·
Verified by 0 users · Flagged by 0 users
Reason: Proof that the reconstructed record-frozen N-agent solution is a Poisson-clock jump system and that its empirical measure solves the forward equation on the aggregate lattice.

Proof

Throughout, fix rRr\in\mathbf{R} and write S\mathfrak{S} for the solution furnished by clause (d) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records: its state processes are the σr,i\sigma^{r,i}, its control process is αs=ar(s)\alpha_s=a^r(s), its regular event is Ωr\Omega^r with P(Ωr)=1P(\Omega^r)=1, and {(r,ω):ωΩr}G\{(r,\omega):\omega\in\Omega^r\}\subseteq G. Its clocks are the transition and observation clocks of the driving system. We write Xti=σtr,iX^i_t=\sigma^{r,i}_t for the ii-th coordinate of XtX_t. Measurability of real-valued maps on [0,T][0,T] or on Ω\Omega is always with respect to B[0,T]\mathcal{B}_{[0,T]} or F\mathcal{F} and the Borel σ\sigma-algebra of the real line, and Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions is used for constants, indicators, sums and products of measurable maps.

Step 0 (Σ(x)\Sigma(x) lies in the lattice). For xEx\in E the counts #{i:xi=γ}\#\{i:x^i=\gamma\}, γ{1,,l}\gamma\in\{1,\dots,l\}, are nonnegative integers with sum NN, each index ii having exactly one value xix^i. Hence the coordinates of Σ(x)\Sigma(x) are nonnegative with sum 11, so Σ(x)\Sigma(x) lies in the probability simplex Δl\Delta^l, and NΣ(x)γN\Sigma(x)^\gamma is 00 or a natural number; thus Σ(x)GN\Sigma(x)\in\mathbb{G}_N by the definition of the aggregate lattice. In particular GN\mathbb{G}_N is nonempty, and it is finite, being contained in the set of points of Rl\mathbb{R}^l all of whose coordinates lie in {0,1N,,1}\{0,\frac1N,\dots,1\}, which has (N+1)l(N+1)^l elements; EE has lN1l^N\ge1 elements and A\mathsf{A} has Nl(l1)1Nl(l-1)\ge1 elements, so the finiteness and nonemptiness hypotheses of Forward Equation for a Finite-State Jump System Driven by Poisson Clocks with the Fresh-Start Property and Uniqueness for the Forward Equation of a Bounded Jump-Rate Family on a Finite Set hold.

Step 1 (Identities). By the derived notation of Solution of the Controlled N-Agent Dynamics, the occupation indicators of S\mathfrak{S} are ηti,γ=1{Xti=γ}\eta^{i,\gamma}_t=\mathbf{1}\{X^i_t=\gamma\} and its empirical state measure is the point with coordinates 1Ni1{Xti=γ}=Σ(Xt)γ\frac1N\sum_i\mathbf{1}\{X^i_t=\gamma\}=\Sigma(X_t)^\gamma, that is, Σ^tr\hat{\Sigma}^r_t, at every ωΩ\omega\in\Omega. Now let ωΩr\omega\in\Omega^r. Then (r,ω)G(r,\omega)\in G, so clause (c) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records gives, for every ii and tt, exactly one γ\gamma with ηtr,i,γ(ω)=1\eta^{r,i,\gamma}_t(\omega)=1, the others being 00, and σtr,i(ω)\sigma^{r,i}_t(\omega) is that γ\gamma; hence ηtr,i,γ(ω)=1{σtr,i(ω)=γ}\eta^{r,i,\gamma}_t(\omega)=\mathbf{1}\{\sigma^{r,i}_t(\omega)=\gamma\} for all γ\gamma, and therefore Σtr(ω)=Σ^tr(ω)\Sigma^r_t(\omega)=\hat{\Sigma}^r_t(\omega). This proves the first assertion of claim 1. Consequently, by condition 2 of Solution of the Controlled N-Agent Dynamics for S\mathfrak{S} (regular event Ωr\Omega^r, control ara^r), for every ωΩ\omega\in\Omega, every e=(i,(σ,γ))Ae=(i,(\sigma,\gamma))\in\mathsf{A} and every t[0,T]t\in[0,T],

Tti,σγ(ω)=[0,t]1Ωr(ω)1{Xui(ω)=σ}β(σ,γ,Σ^ur(ω),ar(u))du=[0,t]1Ωr(ω)ge(u,Xu(ω))du.(1)\mathcal{T}^{i,\sigma\gamma}_t(\omega)=\int_{[0,t]}\mathbf{1}_{\Omega^r}(\omega)\,\mathbf{1}\{X^i_u(\omega)=\sigma\}\,\beta\bigl(\sigma,\gamma,\hat{\Sigma}^r_u(\omega),a^r(u)\bigr)\,du=\int_{[0,t]}\mathbf{1}_{\Omega^r}(\omega)\,g^{e}(u,X_u(\omega))\,du .\qquad(1)

Step 2 (D1). By condition 2 of N-Agent Driving System, each Yi,σγY^{i,\sigma\gamma} is a stochastic process, that is, a family of random variables indexed by [0,)[0,\infty) (the earlier version of that definition invoked in N-Agent Driving System defines the term identically), every path of which is a counting path.

Step 3 (D2). Fix e=(i,(σ,γ))e=(i,(\sigma,\gamma)) and xEx\in E. By clause (d) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records, ar(u)Aa^r(u)\in\mathcal{A} for every uu, and Σ(x)Δl\Sigma(x)\in\Delta^l by Step 0, so 0ge(u,x)B0\le g^{e}(u,x)\le B by condition 1 of Transition-Rate Family. If xiσx^i\neq\sigma then ge(,x)g^{e}(\cdot,x) is the constant 00, which is measurable. If xi=σx^i=\sigma then ge(u,x)=β(σ,γ,y,ar(u))g^{e}(u,x)=\beta(\sigma,\gamma,y,a^r(u)) with y=Σ(x)y=\Sigma(x); we show more generally that uβ(σ,γ,y,ar(u))u\mapsto\beta(\sigma,\gamma,y,a^r(u)) is measurable for every yΔly\in\Delta^l. The map αβ(σ,γ,y,α)\alpha\mapsto\beta(\sigma,\gamma,y,\alpha) is sequentially continuous on ARm\mathcal{A}\subseteq\mathbb{R}^m: if ζnζ\zeta_n\to\zeta in A\mathcal{A} in Euclidean distance, then the sequence (y,ζn)(y,\zeta_n) satisfies the hypothesis of condition 2 of Transition-Rate Family with constant first entries, whence β(σ,γ,y,ζn)β(σ,γ,y,ζ)\beta(\sigma,\gamma,y,\zeta_n)\to\beta(\sigma,\gamma,y,\zeta). Each component of ar:[0,T]Aa^r:[0,T]\to\mathcal{A} is measurable with respect to B[0,T]\mathcal{B}_{[0,T]} by The Record-Frozen Control Path and Record-Frozen Policy. Hence uβ(σ,γ,y,ar(u))u\mapsto\beta(\sigma,\gamma,y,a^r(u)) is measurable by Sequentially Continuous Functions of Measurable Euclidean Maps are Measurable, applied on the measurable space ([0,T],B[0,T])([0,T],\mathcal{B}_{[0,T]}) with d=md=m, the subset A\mathcal{A} and the map ara^r. Since ara^r takes values in A\mathcal{A} (clause (d) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records) and its components are B[0,T]\mathcal{B}_{[0,T]}-measurable (The Record-Frozen Control Path and Record-Frozen Policy), ara^r is a control path in the sense of that definition; this is the assertion of claim 1 concerning ara^r.

Step 4 (D3). The system filtration (Ftsys,r)t[0,T](\mathcal{F}^{\mathrm{sys},r}_t)_{t\in[0,T]} of S\mathfrak{S} is a filtration of sub-σ\sigma-algebras of F\mathcal{F} by clause (vii)(e) of Existence, Uniqueness, and Regularity for the Controlled N-Agent Dynamics, and ΩrF\Omega^r\in\mathcal{F} has probability one. For t[0,T]t\in[0,T] and xEx\in E, {Xt=x}=i=1N{σtr,i=xi}\{X_t=x\}=\bigcap_{i=1}^N\{\sigma^{r,i}_t=x^i\}, and each {σtr,i=xi}\{\sigma^{r,i}_t=x^i\} lies in Ftsys,r\mathcal{F}^{\mathrm{sys},r}_t because σr,i\sigma^{r,i} is adapted to the system filtration by clause (iv) of Existence, Uniqueness, and Regularity for the Controlled N-Agent Dynamics; so {Xt=x}Ftsys,r\{X_t=x\}\in\mathcal{F}^{\mathrm{sys},r}_t.

For the product measurability, fix xEx\in E. By Step 1, for every (u,ω)[0,T]×Ω(u,\omega)\in[0,T]\times\Omega,

1Ωr(ω)1{Xu(ω)=x}=1Ωr(ω)i=1Nηur,i,xi(ω),\mathbf{1}_{\Omega^r}(\omega)\,\mathbf{1}\{X_u(\omega)=x\}=\mathbf{1}_{\Omega^r}(\omega)\prod_{i=1}^N\eta^{r,i,x^i}_u(\omega),

since on Ωr\Omega^r one has 1{Xui=xi}=ηur,i,xi\mathbf{1}\{X^i_u=x^i\}=\eta^{r,i,x^i}_u for every ii, and both sides vanish off Ωr\Omega^r. The first factor is the indicator of the measurable rectangle [0,T]×Ωr[0,T]\times\Omega^r and is therefore B[0,T]F\mathcal{B}_{[0,T]}\otimes\mathcal{F}-measurable. For the remaining factors we show that for all i,γi,\gamma the map (u,ω)ηur,i,γ(ω)(u,\omega)\mapsto\eta^{r,i,\gamma}_u(\omega) is B[0,T]T\mathcal{B}_{[0,T]}\otimes\mathcal{T}-measurable; this suffices, because TF\mathcal{T}\subseteq\mathcal{F} makes every measurable rectangle of B[0,T]T\mathcal{B}_{[0,T]}\otimes\mathcal{T} a measurable rectangle of B[0,T]F\mathcal{B}_{[0,T]}\otimes\mathcal{F}, so that B[0,T]TB[0,T]F\mathcal{B}_{[0,T]}\otimes\mathcal{T}\subseteq\mathcal{B}_{[0,T]}\otimes\mathcal{F} by the definition of the product σ\sigma-algebra as a generated σ\sigma-algebra, and a finite product of measurable real-valued maps is measurable. Consider the map ι:[0,T]×Ω(R×[0,T])×Ω\iota:[0,T]\times\Omega\to(\mathbf{R}\times[0,T])\times\Omega, ι(u,ω)=((r,u),ω)\iota(u,\omega)=((r,u),\omega). The family of subsets SS of (R×[0,T])×Ω(\mathbf{R}\times[0,T])\times\Omega with ι1(S)B[0,T]T\iota^{-1}(S)\in\mathcal{B}_{[0,T]}\otimes\mathcal{T} is a σ\sigma-algebra (preimages commute with complements and countable unions), so ι\iota is measurable from B[0,T]T\mathcal{B}_{[0,T]}\otimes\mathcal{T} to (RB[0,T])T(\mathcal{R}\otimes\mathcal{B}_{[0,T]})\otimes\mathcal{T} as soon as ι1(A×C)B[0,T]T\iota^{-1}(A\times C)\in\mathcal{B}_{[0,T]}\otimes\mathcal{T} for every ARB[0,T]A\in\mathcal{R}\otimes\mathcal{B}_{[0,T]} and CTC\in\mathcal{T}. Now ι1(A×C)=Ar×C\iota^{-1}(A\times C)=A_r\times C with Ar={u[0,T]:(r,u)A}A_r=\{u\in[0,T]:(r,u)\in A\}. The family S\mathcal{S} of subsets AA of R×[0,T]\mathbf{R}\times[0,T] with ArB[0,T]A_r\in\mathcal{B}_{[0,T]} is a σ\sigma-algebra, since (R×[0,T]A)r=[0,T]Ar(\mathbf{R}\times[0,T]\setminus A)_r=[0,T]\setminus A_r, (nAn)r=n(An)r(\bigcup_nA_n)_r=\bigcup_n(A_n)_r, and B[0,T]\mathcal{B}_{[0,T]} is a σ\sigma-algebra by claim 1 of Restricted Lebesgue Measure and Integral Toolkit on a Compact Interval; and S\mathcal{S} contains every measurable rectangle A×BA'\times B' with ARA'\in\mathcal{R} and BB[0,T]B'\in\mathcal{B}_{[0,T]}, whose rr-section is BB' if rAr\in A' and empty otherwise. Hence SRB[0,T]\mathcal{S}\supseteq\mathcal{R}\otimes\mathcal{B}_{[0,T]}, so ArB[0,T]A_r\in\mathcal{B}_{[0,T]} and Ar×CA_r\times C is a measurable rectangle of B[0,T]T\mathcal{B}_{[0,T]}\otimes\mathcal{T}. Thus ι\iota is measurable, and (u,ω)ηur,i,γ(ω)(u,\omega)\mapsto\eta^{r,i,\gamma}_u(\omega) is the composition of ι\iota with the map (r,u,ω)ηur,i,γ(ω)(r',u,\omega)\mapsto\eta^{r',i,\gamma}_u(\omega), which is (RB[0,T])T(\mathcal{R}\otimes\mathcal{B}_{[0,T]})\otimes\mathcal{T}-measurable by clause (a) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records; a composition of measurable maps is measurable, the preimage of a set under the composition being the preimage under ι\iota of its preimage under the outer map. The same argument with the map ω((r,u),ω)\omega\mapsto((r,u),\omega) for fixed uu (preimages of rectangles A×CA\times C are CC or empty) shows that ωηur,i,γ(ω)\omega\mapsto\eta^{r,i,\gamma}_u(\omega) is T\mathcal{T}-measurable for each fixed uu, so that {Σur=y}TF\{\Sigma^r_u=y\}\in\mathcal{T}\subseteq\mathcal{F} for every u[0,T]u\in[0,T] and yRly\in\mathbb{R}^l; this is used in Step 8.

Step 5 (D4). The solution S\mathfrak{S} satisfies conditions 1--4 of Solution of the Controlled N-Agent Dynamics with regular event Ωr\Omega^r, so clause (vii)(b) of Existence, Uniqueness, and Regularity for the Controlled N-Agent Dynamics shows that each Tti,σγ\mathcal{T}^{i,\sigma\gamma}_t is F\mathcal{F}-measurable with values in [0,Bt]=[0,Λt][0,Bt]=[0,\Lambda t]; and by (1), for ωΩr\omega\in\Omega^r, Tti,σγ(ω)=[0,t]ge(u,Xu(ω))du\mathcal{T}^{i,\sigma\gamma}_t(\omega)=\int_{[0,t]}g^{e}(u,X_u(\omega))\,du with e=(i,(σ,γ))e=(i,(\sigma,\gamma)), as (D4) requires. The counters of Forward Equation for a Finite-State Jump System Driven by Poisson Clocks with the Fresh-Start Property are YTtee=YTti,σγi,σγ=Nti,σγY^{e}_{\mathcal{T}^{e}_t}=Y^{i,\sigma\gamma}_{\mathcal{T}^{i,\sigma\gamma}_t}=N^{i,\sigma\gamma}_t, the transition counters of condition 3 of Solution of the Controlled N-Agent Dynamics.

Step 6 (H1). Fix ωΩr\omega\in\Omega^r; conditions 1, 3 and 6 of Solution of the Controlled N-Agent Dynamics hold at ω\omega, and we suppress ω\omega.

Piecewise constancy. By condition 1, for each ii there are a count K(i)K^{(i)} and times 0<t1(i)<<tK(i)(i)T0<t^{(i)}_1<\dots<t^{(i)}_{K^{(i)}}\le T such that XiX^i is constant on [0,t1(i))[0,t^{(i)}_1), on each [tj(i),tj+1(i))[t^{(i)}_j,t^{(i)}_{j+1}), and on [tK(i)(i),T][t^{(i)}_{K^{(i)}},T] (on all of [0,T][0,T] if K(i)=0K^{(i)}=0). Let 0<t1<<tKT0<t_1<\dots<t_K\le T enumerate the union of these finite sets of times (K=0K=0 if the union is empty). Let II be one of the intervals [0,t1)[0,t_1), [tk,tk+1)[t_k,t_{k+1}) (1k<K1\le k<K), [tK,T][t_K,T] (or [0,T][0,T] if K=0K=0), with left endpoint \ell. Fix ii and let jj be the largest index with tj(i)t^{(i)}_j\le\ell, or j=0j=0 if there is none. If j<K(i)j<K^{(i)} then tj+1(i)>t^{(i)}_{j+1}>\ell, and since tj+1(i)t^{(i)}_{j+1} belongs to the union it is at least the next enumerated time after \ell, which is the right endpoint of II when I=[tk,tk+1)I=[t_k,t_{k+1}) or [0,t1)[0,t_1), and does not exist when I=[tK,T]I=[t_K,T] (all enumerated times being tK\le t_K), so that this case is impossible then. Hence II is contained in the constancy interval of XiX^i starting at tj(i)t^{(i)}_j (at 00 if j=0j=0), and XiX^i is constant on II. As this holds for every ii, XX is constant on II: the path of XX is piecewise constant and right-continuous with the times t1,,tKt_1,\dots,t_K, as (H1) requires, and XtX_{t-} is defined for t(0,T]t\in(0,T].

Jump rule. Let t(0,T]t\in(0,T], and let NteN^{e}_{t-} and the notation of (H1) be as in Forward Equation for a Finite-State Jump System Driven by Poisson Clocks with the Fresh-Start Property, and write Nt=eANte\mathcal{N}_t=\sum_{e\in\mathsf{A}}N^{e}_t and Nt\mathcal{N}_{t-} for the grand total and its left limit, called NtN_t and NtN_{t-} there (the bare symbol NN denotes the number of agents here); put ΔNte=NteNte\Delta N^{e}_t=N^{e}_t-N^{e}_{t-}, a nonnegative integer. By condition 3 each path sNses\mapsto N^{e}_s coincides on [0,T][0,T] with a counting path, so it is nondecreasing and integer-valued; the set {Nse:0s<t}\{N^{e}_s:0\le s<t\} is a set of integers bounded above by NteN^{e}_t, so its supremum NteN^{e}_{t-} is attained at some se<ts_e<t, and by monotonicity Nse=NteN^{e}_s=N^{e}_{t-} for all s[se,t)s\in[s_e,t). Choose s<ts'<t with sses'\ge s_e for all eAe\in\mathsf{A} and such that Xs=XtX_s=X_{t-} for s(s,t)s\in(s',t) (possible by piecewise constancy). Fix s(s,t)s\in(s',t). Condition 6 at the times tt and ss, subtracted, gives for all ii and γ\gamma, using ηi,γ=1{Xi=γ}\eta^{i,\gamma}=\mathbf{1}\{X^i=\gamma\} from Step 1,

1{Xti=γ}1{Xti=γ}=σγΔNti,σγγγΔNti,γγ.(2)\mathbf{1}\{X^i_t=\gamma\}-\mathbf{1}\{X^i_{t-}=\gamma\}=\sum_{\sigma\neq\gamma}\Delta N^{i,\sigma\gamma}_t-\sum_{\gamma'\neq\gamma}\Delta N^{i,\gamma\gamma'}_t .\qquad(2)

If Nt=Nt\mathcal{N}_t=\mathcal{N}_{t-}, then, as Nt=eNte\mathcal{N}_{t-}=\sum_eN^{e}_{t-}, all ΔNte\Delta N^{e}_t vanish, so (2) gives 1{Xti=γ}=1{Xti=γ}\mathbf{1}\{X^i_t=\gamma\}=\mathbf{1}\{X^i_{t-}=\gamma\} for all i,γi,\gamma, that is, Xt=XtX_t=X_{t-}. If Nt=Nt+1\mathcal{N}_t=\mathcal{N}_{t-}+1, let e0=(i0,(σ0,γ0))e_0=(i_0,(\sigma_0,\gamma_0)) be the unique label with ΔNte0=1\Delta N^{e_0}_t=1, all other ΔNte\Delta N^{e}_t being 00. For ii0i\neq i_0 the right side of (2) vanishes for every γ\gamma, so Xti=XtiX^i_t=X^i_{t-}. For i=i0i=i_0 and γ=γ0\gamma=\gamma_0, the right side of (2) equals ΔNti0,σ0γ0=1\Delta N^{i_0,\sigma_0\gamma_0}_t=1, no label of the form (i0,(γ0,γ))(i_0,(\gamma_0,\gamma')) being e0e_0 since γ0σ0\gamma_0\neq\sigma_0; hence 1{Xti0=γ0}=1+1{Xti0=γ0}1\mathbf{1}\{X^{i_0}_t=\gamma_0\}=1+\mathbf{1}\{X^{i_0}_{t-}=\gamma_0\}\ge1, forcing Xti0=γ0X^{i_0}_t=\gamma_0. Thus Xt=ϕe0(Xt)X_t=\phi^{e_0}(X_{t-}), as (H1) requires.

Step 7 (H2). Fix s[0,T]s\in[0,T], the time called rr in (H2), and put ϱs=B(Ts)\varrho_s=B(T-s). The residual clocks of (H2) are Y^ue,s=YTsi,σγ+ui,σγYTsi,σγi,σγ\hat{Y}^{e,s}_u=Y^{i,\sigma\gamma}_{\mathcal{T}^{i,\sigma\gamma}_s+u}-Y^{i,\sigma\gamma}_{\mathcal{T}^{i,\sigma\gamma}_s} for e=(i,(σ,γ))e=(i,(\sigma,\gamma)), which are the residual transition clocks Y^ui,σγ\hat{Y}^{i,\sigma\gamma}_u of Fresh-Start Property of the Controlled N-Agent Dynamics applied at time ss to the solution S\mathfrak{S}; that lemma applies with the policy h^r\hat{h}^r, which is A\mathcal{A}-valued by clause (d) of Measurable Reconstruction of the Controlled N-Agent Dynamics from Observation Records, with the solution S\mathfrak{S} on the same driving system, and with its time parameter equal to ss. By its clause (a), each residual clock is a homogeneous Poisson process with rate 11: each Y^ue,s\hat{Y}^{e,s}_u is a random variable, and by conditions 2 and 3 of Stochastic Process, Independent Increments, and Inhomogeneous Poisson Process (the earlier version of that definition, which is the one invoked in Fresh-Start Property of the Controlled N-Agent Dynamics, states conditions 1--3 and the notion of a homogeneous Poisson process with rate 11 identically; the two versions differ only in the continuity requirement imposed on a general intensity function, which plays no role here), for all real 0=u0<u1<<upϱs0=u_0<u_1<\dots<u_p\le\varrho_s the increments Y^uqe,sY^uq1e,s\hat{Y}^{e,s}_{u_q}-\hat{Y}^{e,s}_{u_{q-1}}, 1qp1\le q\le p, are independent, the qq-th having the Poisson distribution with parameter uquq1u_q-u_{q-1}. For the independence requirement, clause (b) of Fresh-Start Property of the Controlled N-Agent Dynamics states that the family consisting of Fssys,r\mathcal{F}^{\mathrm{sys},r}_s, the σ\sigma-algebras σ(Y^ui,σγ:u0)\sigma(\hat{Y}^{i,\sigma\gamma}_u:u\ge0) and the σ\sigma-algebras generated by the residual observation clocks is independent. The family required by (H2) consists of Fssys,r\mathcal{F}^{\mathrm{sys},r}_s and the σ\sigma-algebras Ge=σ(Y^ue,s:0uϱs)\mathcal{G}_e=\sigma(\hat{Y}^{e,s}_u:0\le u\le\varrho_s), eAe\in\mathsf{A}; each Ge\mathcal{G}_e is contained in σ(Y^ui,σγ:u0)\sigma(\hat{Y}^{i,\sigma\gamma}_u:u\ge0), its generators in the sense of Sigma-Algebra Generated by Random Variables and Independence of Sigma-Algebras being among those of the latter, so that the smaller generated σ\sigma-algebra is contained in the larger. Given finitely many distinct members of the (H2) family and events in them, these events lie in the corresponding distinct members of the fresh-start family, so the product identity of Sigma-Algebra Generated by Random Variables and Independence of Sigma-Algebras holds. Thus (H2) holds.

Step 8 (Claims 1 and 2). Steps 2--7 establish (D1)--(D4), (H1) and (H2), which proves claim 1, so conclusions (a) and (b) of Forward Equation for a Finite-State Jump System Driven by Poisson Clocks with the Fresh-Start Property hold: for every F~:ER\tilde{F}:E\to\mathbb{R}, all 0stT0\le s\le t\le T and DFssys,rD\in\mathcal{F}^{\mathrm{sys},r}_s,

E[(F~(Xt)F~(Xs))1D]=E[1D[s,t]1ΩreAge(u,Xu)(F~(ϕe(Xu))F~(Xu))du],(3)\mathbb{E}\bigl[(\tilde{F}(X_t)-\tilde{F}(X_s))\mathbf{1}_D\bigr]=\mathbb{E}\Bigl[\mathbf{1}_D\int_{[s,t]}\mathbf{1}_{\Omega^r}\sum_{e\in\mathsf{A}}g^{e}(u,X_u)\bigl(\tilde{F}(\phi^{e}(X_u))-\tilde{F}(X_u)\bigr)\,du\Bigr],\qquad(3)

the inner integral being defined everywhere and F\mathcal{F}-measurable; and for s[0,T)s\in[0,T) and DFssys,rD\in\mathcal{F}^{\mathrm{sys},r}_s the family μuD(x)=P(D{Xu=x})\mu^{D}_u(x)=P(D\cap\{X_u=x\}), u[s,T]u\in[s,T], is a solution of the forward equation on [s,T][s,T] for the rates quE(x,x)=e:ϕe(x)=xge(u,x)q^{E}_u(x,x')=\sum_{e:\phi^{e}(x)=x'}g^{e}(u,x) on EE (called qq in that lemma).

Generator identity. Let F:GNRF:\mathbb{G}_N\to\mathbb{R}, with F(y+1Nvc)F(y+\frac1Nv_c) read as F(y)F(y) when y+1NvcGNy+\frac1Nv_c\notin\mathbb{G}_N. We claim that for all u[0,T]u\in[0,T] and xEx\in E, writing y=Σ(x)y=\Sigma(x),

eAge(u,x)(F(Σ(ϕe(x)))F(y))=c=(σ,γ)Nyσβ(σ,γ,y,ar(u))(F(y+1Nvc)F(y))=yGN,yyqur(y,y)(F(y)F(y)).(4)\sum_{e\in\mathsf{A}}g^{e}(u,x)\bigl(F(\Sigma(\phi^{e}(x)))-F(y)\bigr)=\sum_{c=(\sigma,\gamma)}Ny^{\sigma}\beta(\sigma,\gamma,y,a^r(u))\bigl(F(y+\tfrac1Nv_c)-F(y)\bigr)=\sum_{y'\in\mathbb{G}_N,\,y'\neq y}q^r_u(y,y')\bigl(F(y')-F(y)\bigr).\qquad(4)

For the first equality fix c=(σ,γ)c=(\sigma,\gamma) and consider the labels e=(i,c)e=(i,c). If xiσx^i\neq\sigma then ge(u,x)=0g^{e}(u,x)=0. If xi=σx^i=\sigma, then ϕe(x)\phi^{e}(x) differs from xx only in coordinate ii, which changes from σ\sigma to γ\gamma, so the count of σ\sigma decreases by one and that of γ\gamma increases by one: Σ(ϕe(x))=y+1N(δγδσ)=y+1Nvc\Sigma(\phi^{e}(x))=y+\frac1N(\delta_\gamma-\delta_\sigma)=y+\frac1Nv_c, a point of GN\mathbb{G}_N by Step 0, and ge(u,x)=β(σ,γ,y,ar(u))g^{e}(u,x)=\beta(\sigma,\gamma,y,a^r(u)). There are NyσNy^{\sigma} indices ii with xi=σx^i=\sigma, so the labels (i,c)(i,c) contribute Nyσβ(σ,γ,y,ar(u))(F(y+1Nvc)F(y))Ny^{\sigma}\beta(\sigma,\gamma,y,a^r(u))(F(y+\frac1Nv_c)-F(y)) to the left side, which is also the cc-term of the middle expression; when yσ=0y^{\sigma}=0 both are 00 whatever the reading of F(y+1Nvc)F(y+\frac1Nv_c). For the second equality: if yσ1Ny^{\sigma}\ge\frac1N then y+1Nvcy+\frac1Nv_c has nonnegative coordinates yσ1Ny^{\sigma}-\frac1N, yγ+1Ny^{\gamma}+\frac1N and yγy^{\gamma'} (γ{σ,γ}\gamma'\notin\{\sigma,\gamma\}), all multiples of 1N\frac1N with sum 11, so it lies in GN\mathbb{G}_N, whereas if yσ=0y^{\sigma}=0 its σ\sigma-coordinate is negative and it does not; distinct labels give distinct points y+1Nvcy+\frac1Nv_c, as vcv_c determines cc. Hence, by the definition of qrq^r, the right side of (4) is the sum over the labels cc with yσ1Ny^{\sigma}\ge\frac1N of Nyσβ(σ,γ,y,ar(u))(F(y+1Nvc)F(y))Ny^{\sigma}\beta(\sigma,\gamma,y,a^r(u))(F(y+\frac1Nv_c)-F(y)), and the remaining terms of the middle expression vanish.

The displayed identity of claim 2. Apply (3) with F~=FΣ\tilde{F}=F\circ\Sigma, so that F~(Xt)=F(Σ^tr)\tilde{F}(X_t)=F(\hat{\Sigma}^r_t), and use the first equality of (4) at x=Xu(ω)x=X_u(\omega), where y=Σ^ur(ω)y=\hat{\Sigma}^r_u(\omega): the integrand of (3) becomes the integrand displayed in claim 2, as a function of (u,ω)(u,\omega). The measurability assertion for the inner integral is that of conclusion (a) of Forward Equation for a Finite-State Jump System Driven by Poisson Clocks with the Fresh-Start Property, the two integrands being the same function.

The rates qrq^r. For yyy\neq y' in GN\mathbb{G}_N the map uqur(y,y)u\mapsto q^r_u(y,y') is either the constant 00 or uNyσβ(σ,γ,y,ar(u))u\mapsto Ny^{\sigma}\beta(\sigma,\gamma,y,a^r(u)), a scalar multiple of a map shown measurable in Step 3; so it is measurable. Since there are l(l1)l(l-1) transition labels, 0yσ10\le y^{\sigma}\le1 for yGNΔly\in\mathbb{G}_N\subseteq\Delta^l and βB\beta\le B, yyqur(y,y)cNyσBl(l1)NB\sum_{y'\neq y}q^r_u(y,y')\le\sum_cNy^{\sigma}B\le l(l-1)NB.

νD\nu^{D} solves the forward equation. Fix s[0,T)s\in[0,T) and DFssys,rD\in\mathcal{F}^{\mathrm{sys},r}_s. For u[s,T]u\in[s,T] and yGNy\in\mathbb{G}_N, the events {Xu=x}\{X_u=x\}, xEx\in E, partition Ω\Omega and {Σ^ur=y}\{\hat{\Sigma}^r_u=y\} is the union of those with Σ(x)=y\Sigma(x)=y, so by additivity of PP

νuD(y)=P(D{Σ^ur=y})=xE:Σ(x)=yμuD(x);\nu^{D}_u(y)=P(D\cap\{\hat{\Sigma}^r_u=y\})=\sum_{x\in E:\,\Sigma(x)=y}\mu^{D}_u(x);

moreover {Σur=y}\{\Sigma^r_u=y\} is an event (Step 4) that differs from {Σ^ur=y}\{\hat{\Sigma}^r_u=y\} only inside ΩΩr\Omega\setminus\Omega^r (Step 1), a set of probability zero, so P(D{Σ^ur=y})=P(D{Σur=y})P(D\cap\{\hat{\Sigma}^r_u=y\})=P(D\cap\{\Sigma^r_u=y\}) by monotonicity and additivity of PP. Property (i) of a solution: uνuD(y)u\mapsto\nu^{D}_u(y) is a finite sum of the maps uμuD(x)u\mapsto\mu^{D}_u(x), each bounded and B[s,T]\mathcal{B}_{[s,T]}-measurable by property (i) for μD\mu^{D}, hence bounded and measurable. Property (ii): let F:GNRF:\mathbb{G}_N\to\mathbb{R} and write Lur\mathcal{L}^r_u for the operator of Uniqueness for the Forward Equation of a Bounded Jump-Rate Family on a Finite Set for the rates qrq^r on GN\mathbb{G}_N and LuE\mathcal{L}^{E}_u for the one for the rates qEq^{E} on EE. Grouping the points of EE according to Σ(x)\Sigma(x) gives νtD(F)=xEμtD(x)F(Σ(x))=μtD(FΣ)\nu^{D}_t(F)=\sum_{x\in E}\mu^{D}_t(x)F(\Sigma(x))=\mu^{D}_t(F\circ\Sigma) for every t[s,T]t\in[s,T], and likewise νuD(LurF)=μuD((LurF)Σ)\nu^{D}_u(\mathcal{L}^r_uF)=\mu^{D}_u((\mathcal{L}^r_uF)\circ\Sigma). By (4), for every xEx\in E,

(LurF)(Σ(x))=eAge(u,x)((FΣ)(ϕe(x))(FΣ)(x))=xx e:ϕe(x)=xge(u,x)((FΣ)(x)(FΣ)(x))=LuE(FΣ)(x),(\mathcal{L}^r_uF)(\Sigma(x))=\sum_{e\in\mathsf{A}}g^{e}(u,x)\bigl((F\circ\Sigma)(\phi^{e}(x))-(F\circ\Sigma)(x)\bigr)=\sum_{x'\neq x}\ \sum_{e:\,\phi^{e}(x)=x'}g^{e}(u,x)\bigl((F\circ\Sigma)(x')-(F\circ\Sigma)(x)\bigr)=\mathcal{L}^{E}_u(F\circ\Sigma)(x),

the middle step regrouping the labels ee by the value ϕe(x)\phi^{e}(x) and discarding those with ϕe(x)=x\phi^{e}(x)=x, whose terms vanish. Hence νuD(LurF)=μuD(LuE(FΣ))\nu^{D}_u(\mathcal{L}^r_uF)=\mu^{D}_u(\mathcal{L}^{E}_u(F\circ\Sigma)), and property (ii) for μD\mu^{D} with the function FΣF\circ\Sigma yields, for every t[s,T]t\in[s,T],

νtD(F)=μtD(FΣ)=μsD(FΣ)+[s,t]μuD(LuE(FΣ))du=νsD(F)+[s,t]νuD(LurF)du.\nu^{D}_t(F)=\mu^{D}_t(F\circ\Sigma)=\mu^{D}_s(F\circ\Sigma)+\int_{[s,t]}\mu^{D}_u(\mathcal{L}^{E}_u(F\circ\Sigma))\,du=\nu^{D}_s(F)+\int_{[s,t]}\nu^{D}_u(\mathcal{L}^r_uF)\,du .

Thus (νuD)u[s,T](\nu^{D}_u)_{u\in[s,T]} is a solution of the forward equation on [s,T][s,T] for the rates qrq^r with rate bound l(l1)NBl(l-1)NB, which completes the proof of claim 2.

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Comments

Loading…