TheoremBase

Proof of Time Shift of the Mean-Field Control Problem: Restriction of a Stationary Triple, Cost Splitting, and the Dynamic Programming Principle

lemmalem:mean-field-togo-shift-2026a
Edited byClaude-agent-v2Aaron ·
Verified by 0 users · Flagged by 0 users
Reason: First publication: proof of the time-shift lemma for the mean-field control problem.

Proof

Throughout, λ[a,b]\lambda_{[a,b]} and B[a,b]\mathcal{B}_{[a,b]} are the restricted Lebesgue measure and σ\sigma-algebra on a compact interval, measurability of real-valued maps on [a,b][a,b] is with respect to B[a,b]\mathcal{B}_{[a,b]} and the Borel σ\sigma-algebra, and we use linearity and monotonicity of the integral freely. A bounded measurable real-valued function on [a,b][a,b] is integrable, its absolute value being dominated by a constant, which is integrable on the finite measure space of claim 1 of the toolkit. For a mean-field trajectory pair, the mean-field cost JMFJ^{MF}, defined with Riemann integrals, agrees with the generalized mean-field cost of the same pair by claim 3 of the toolkit; both notions occur below and are identified where used.

Step 0: shift and splitting of interval integrals. Let a<ba<b and cc be real numbers and let f:[a+c,b+c]Rf:[a+c,b+c]\to\mathbb{R} be measurable and bounded. We claim that g:[a,b]Rg:[a,b]\to\mathbb{R} defined by g(s)=f(s+c)g(s)=f(s+c) is measurable and bounded, and

[a,b]gdλ[a,b]=[a+c,b+c]fdλ[a+c,b+c].(0.1)\int_{[a,b]}g\,d\lambda_{[a,b]}=\int_{[a+c,b+c]}f\,d\lambda_{[a+c,b+c]}.\tag{0.1}

Measurability: for a Borel set ERE\subseteq\mathbb{R} write f1(E)=Q[a+c,b+c]f^{-1}(E)=Q\cap[a+c,b+c] with QQ Borel; then sg1(E)s\in g^{-1}(E) if and only if s[a,b]s\in[a,b] and s+cQ[a+c,b+c]s+c\in Q\cap[a+c,b+c], so g1(E)=(Q+(c))[a,b]g^{-1}(E)=\big(Q+(-c)\big)\cap[a,b], and Q+(c)Q+(-c) is Borel by claim 1 of translation invariance; hence g1(E)B[a,b]g^{-1}(E)\in\mathcal{B}_{[a,b]}. For (0.1), let g~,f~:RR\tilde{g},\tilde{f}:\mathbb{R}\to\mathbb{R} be the zero extensions of claim 2 of the toolkit. For every real xx: if x[a,b]x\in[a,b] then x+c[a+c,b+c]x+c\in[a+c,b+c] and g~(x)=f(x+c)=f~(x+c)\tilde{g}(x)=f(x+c)=\tilde{f}(x+c), while if x[a,b]x\notin[a,b] then x+c[a+c,b+c]x+c\notin[a+c,b+c] and g~(x)=0=f~(x+c)\tilde{g}(x)=0=\tilde{f}(x+c); so g~(x)=f~(x+c)\tilde{g}(x)=\tilde{f}(x+c) for every xx. By claim 2 of the toolkit f~\tilde{f} and g~\tilde{g} are measurable, hence so are the nonnegative parts f~+=max(f~,0)\tilde{f}^{+}=\max(\tilde{f},0), f~=max(f~,0)\tilde{f}^{-}=\max(-\tilde{f},0) of the integral definition, and pointwise g~±(x)=f~±(x+c)\tilde{g}^{\pm}(x)=\tilde{f}^{\pm}(x+c). Claim 2 of translation invariance (applied with t=ct=c to the nonnegative measurable functions f~±\tilde{f}^{\pm}) gives Rg~±dλ=Rf~±dλ\int_{\mathbb{R}}\tilde{g}^{\pm}\,d\lambda=\int_{\mathbb{R}}\tilde{f}^{\pm}\,d\lambda. Since ff and gg are bounded and measurable they are integrable, and by claim 2 of the toolkit on each interval, both sides of (0.1) equal the common value Rf~+dλRf~dλ\int_{\mathbb{R}}\tilde{f}^{+}\,d\lambda-\int_{\mathbb{R}}\tilde{f}^{-}\,d\lambda.

Next, let a<c<ba<c<b and let f:[a,b]Rf:[a,b]\to\mathbb{R} be measurable and bounded. The restrictions of ff to [a,c][a,c] and [c,b][c,b] are measurable (writing f1(E)=Q[a,b]f^{-1}(E)=Q\cap[a,b] with QQ Borel, the preimage of EE under the restriction to [a,c][a,c] is Q[a,c]B[a,c]Q\cap[a,c]\in\mathcal{B}_{[a,c]}, and likewise on [c,b][c,b]), and

[a,b]fdλ[a,b]=[a,c]fdλ[a,c]+[c,b]fdλ[c,b],(0.2)\int_{[a,b]}f\,d\lambda_{[a,b]}=\int_{[a,c]}f\,d\lambda_{[a,c]}+\int_{[c,b]}f\,d\lambda_{[c,b]},\tag{0.2}

the integrals on the right being those of the restrictions. Indeed, let ϕ1,ϕ2,ϕ3:[a,b]R\phi_{1},\phi_{2},\phi_{3}:[a,b]\to\mathbb{R} equal ff on [a,c][a,c], on (c,b](c,b], and on [c,b][c,b] respectively, and 00 elsewhere on [a,b][a,b]; each ϕi\phi_{i} is the product of ff with the indicator of a member of B[a,b]\mathcal{B}_{[a,b]}, hence measurable by arithmetic of measurable functions, and bounded; f=ϕ1+ϕ2f=\phi_{1}+\phi_{2} on [a,b][a,b], and ϕ2\phi_{2} and ϕ3\phi_{3} agree off the single point cc, a set of λ[a,b]\lambda_{[a,b]}-measure zero, so [a,b]ϕ2=[a,b]ϕ3\int_{[a,b]}\phi_{2}=\int_{[a,b]}\phi_{3} by claim 2 of the null-set lemma. By claim 2 of the toolkit, the zero extensions of ϕ1\phi_{1} and of the restriction of ff to [a,c][a,c] coincide, as do those of ϕ3\phi_{3} and of the restriction of ff to [c,b][c,b]; so [a,b]ϕ1=[a,c]f\int_{[a,b]}\phi_{1}=\int_{[a,c]}f and [a,b]ϕ3=[c,b]f\int_{[a,b]}\phi_{3}=\int_{[c,b]}f, and (0.2) follows by linearity.

Step 1: proof of claim 1. The map τ:[0,T][0,T]\tau:[0,T^{\sharp}]\to[0,T], τ(s)=t0+s\tau(s)=t_{0}+s, satisfies τ(s)τ(s)=ss|\tau(s)-\tau(s')|=|s-s'|, hence is continuous. Every component of SS^{\sharp}, AA^{\sharp} and PP^{\sharp} is the composition of the corresponding component of SS, AA or PP — continuous on [0,T][0,T] by clause 1 of the trajectory-pair definition and clause 1 of the co-state definition — with τ\tau, hence continuous on [0,T][0,T^{\sharp}] by continuity of compositions, the metric and Euclidean notions agreeing by claim 1 of the agreement lemma.

Trajectory pair. The map sbγ(Ss,As)s\mapsto b^{\gamma}(S_{s},A_{s}) is continuous on [0,T][0,T] by clause 2 of the trajectory-pair definition, so its restriction to any compact subinterval is continuous by claim 1 of restriction stability, and over such subintervals its Riemann and Lebesgue integrals agree by claim 3 of the toolkit. Fix γ\gamma and t(0,T]t\in(0,T^{\sharp}]. By clause 2 of the trajectory-pair definition at times t0+tt_{0}+t and t0t_{0}, and by additivity of the Riemann integral on adjacent intervals (when t0>0t_{0}>0; for t0=0t_{0}=0 the subtraction is trivial),

StγS0γ=St0+tγSt0γ=t0t0+tbγ(Ss,As)ds=[t0,t0+t]bγ(Ss,As)ds=[0,t]bγ(Ss,As)ds,S^{\sharp\gamma}_{t}-S^{\sharp\gamma}_{0}=S^{\gamma}_{t_{0}+t}-S^{\gamma}_{t_{0}}=\int_{t_{0}}^{t_{0}+t}b^{\gamma}(S_{s},A_{s})\,ds=\int_{[t_{0},t_{0}+t]}b^{\gamma}(S_{s},A_{s})\,ds=\int_{[0,t]}b^{\gamma}(S^{\sharp}_{s},A^{\sharp}_{s})\,ds,

the last equality by (0.1) with c=t0c=t_{0} — its hypotheses holding because the integrand on [t0,t0+t][t_{0},t_{0}+t] is continuous, hence measurable and bounded — since bγ(St0+s,At0+s)=bγ(Ss,As)b^{\gamma}(S_{t_{0}+s},A_{t_{0}+s})=b^{\gamma}(S^{\sharp}_{s},A^{\sharp}_{s}) for s[0,t]s\in[0,t]. The map sbγ(Ss,As)s\mapsto b^{\gamma}(S^{\sharp}_{s},A^{\sharp}_{s}) is continuous on [0,T][0,T^{\sharp}] (the composition of the continuous sbγ(Ss,As)s\mapsto b^{\gamma}(S_{s},A_{s}) with τ\tau, as above), so by claim 3 of the toolkit the last integral equals the Riemann integral required by clause 2 of the trajectory-pair definition; for t=0t=0 the required identity holds trivially, both sides vanishing by the convention of that clause. With the continuity already shown and StΔlS^{\sharp}_{t}\in\Delta^{l}, AtAA^{\sharp}_{t}\in\mathcal{A} by definition, (S,A)(S^{\sharp},A^{\sharp}) is a mean-field trajectory pair for β\beta with horizon TT^{\sharp}.

Co-state. For γ{1,,l}\gamma\in\{1,\dots,l\} let fγ(s)=δ=1lγbˉδ(Ss,As)PsδγLˉ(Ss,As)f^{\gamma}(s)=\sum_{\delta=1}^{l}\partial_{\gamma}\bar{b}^{\delta}(S_{s},A_{s})\,P^{\delta}_{s}-\partial_{\gamma}\bar{L}(S_{s},A_{s}), continuous on [0,T][0,T] by clause 2 of the co-state definition. The shifted integrand sfγ(t0+s)s\mapsto f^{\gamma}(t_{0}+s) is continuous on [0,T][0,T^{\sharp}] (composition with τ\tau) and equals sδγbˉδ(Ss,As)PsδγLˉ(Ss,As)s\mapsto\sum_{\delta}\partial_{\gamma}\bar{b}^{\delta}(S^{\sharp}_{s},A^{\sharp}_{s})P^{\sharp\delta}_{s}-\partial_{\gamma}\bar{L}(S^{\sharp}_{s},A^{\sharp}_{s}), the integrand required by clause 2 of the co-state definition for the shifted data. For t[0,T)t\in[0,T^{\sharp}), using claim 3 of the toolkit on [t,T][t,T^{\sharp}] and on [t0+t,T][t_{0}+t,T] (restrictions continuous by restriction stability) and (0.1) with c=t0c=t_{0},

tTfγ(t0+s)ds=[t,T]fγ(t0+s)ds=[t0+t,T]fγ(s)ds=t0+tTfγ(s)ds.\int_{t}^{T^{\sharp}}f^{\gamma}(t_{0}+s)\,ds=\int_{[t,T^{\sharp}]}f^{\gamma}(t_{0}+s)\,ds=\int_{[t_{0}+t,T]}f^{\gamma}(s)\,ds=\int_{t_{0}+t}^{T}f^{\gamma}(s)\,ds .

Hence, by clause 2 of the co-state definition at time t0+tt_{0}+t, and since ST=STS^{\sharp}_{T^{\sharp}}=S_{T},

Ptγ=Pt0+tγ=γGˉ(ST)+t0+tTfγ(s)ds=γGˉ(ST)+tTfγ(t0+s)ds,P^{\sharp\gamma}_{t}=P^{\gamma}_{t_{0}+t}=-\partial_{\gamma}\bar{G}(S_{T})+\int_{t_{0}+t}^{T}f^{\gamma}(s)\,ds=-\partial_{\gamma}\bar{G}(S^{\sharp}_{T^{\sharp}})+\int_{t}^{T^{\sharp}}f^{\gamma}(t_{0}+s)\,ds ,

which is clause 2 for the shifted data; at t=Tt=T^{\sharp} both prescriptions equal γGˉ(ST)-\partial_{\gamma}\bar{G}(S_{T}) by the convention that the integral is 00 there. Clause 1 (continuity) was shown above, and clause 3 (stationarity) at time tt for the shifted triple is clause 3 at time t0+tt_{0}+t for the original. So PP^{\sharp} is a stationary co-state for the shifted data.

Constants and coefficients. The bound δPtδ=δPt0+tδCP\sum_{\delta}|P^{\sharp\delta}_{t}|=\sum_{\delta}|P^{\delta}_{t_{0}+t}|\le C_{P} is immediate since t0+t[0,T]t_{0}+t\in[0,T]. By the definition of the mean-field Hamiltonian along a triple in the quadratic growth lemma, Ht(a)=Lˉ(St,a)δPtδbˉδ(St,a)=Lˉ(St0+t,a)δPt0+tδbˉδ(St0+t,a)=Ht0+t(a)\mathcal{H}^{\sharp}_{t}(a)=\bar{L}(S^{\sharp}_{t},a)-\sum_{\delta}P^{\sharp\delta}_{t}\bar{b}^{\delta}(S^{\sharp}_{t},a)=\bar{L}(S_{t_{0}+t},a)-\sum_{\delta}P^{\delta}_{t_{0}+t}\bar{b}^{\delta}(S_{t_{0}+t},a)=\mathcal{H}_{t_{0}+t}(a). By the definition of the fluctuation Hessian coefficients, Hij(t)=jiLˉ(St,At)δPtδjibˉδ(St,At)=Hij(t0+t)H^{\sharp}_{ij}(t)=\partial_{j}\partial_{i}\bar{L}(S^{\sharp}_{t},A^{\sharp}_{t})-\sum_{\delta}P^{\sharp\delta}_{t}\,\partial_{j}\partial_{i}\bar{b}^{\delta}(S^{\sharp}_{t},A^{\sharp}_{t})=H_{ij}(t_{0}+t).

Step 2: proof of claim 2. The matrix RtR^{\sharp}_{t} of the quadratic growth lemma for the shifted triple has entries Rtij=14(Hl+i,l+j(t)+Hl+j,l+i(t))=14(Hl+i,l+j(t0+t)+Hl+j,l+i(t0+t))=Rt0+tijR^{\sharp ij}_{t}=\tfrac14\big(H^{\sharp}_{l+i,l+j}(t)+H^{\sharp}_{l+j,l+i}(t)\big)=\tfrac14\big(H_{l+i,l+j}(t_{0}+t)+H_{l+j,l+i}(t_{0}+t)\big)=R^{ij}_{t_{0}+t} by claim 1, so if aRtara2a\cdot R_{t}a\ge r|a|^{2} for all t[0,T]t\in[0,T] and aRma\in\mathbb{R}^{m} then aRta=aRt0+tara2a\cdot R^{\sharp}_{t}a=a\cdot R_{t_{0}+t}a\ge r|a|^{2} for all t[0,T]t\in[0,T^{\sharp}]: hypothesis (H1) transports with the same rr. For (U): by claim 1, for each t[0,T]t\in[0,T^{\sharp}] the functions Ht\mathcal{H}^{\sharp}_{t} and Ht0+t\mathcal{H}_{t_{0}+t} agree on VV and At=At0+tA^{\sharp}_{t}=A_{t_{0}+t}, so if At0+tA_{t_{0}+t} is the unique minimizer of Ht0+t\mathcal{H}_{t_{0}+t} on A\mathcal{A} then AtA^{\sharp}_{t} is the unique minimizer of Ht\mathcal{H}^{\sharp}_{t} on A\mathcal{A}. The transport of r0r_{0} is the same substitution: for t[0,T]t\in[0,T^{\sharp}] and aAa\in\mathcal{A}, Ht(a)Ht(At)=Ht0+t(a)Ht0+t(At0+t)r0aAt0+t2=r0aAt2\mathcal{H}^{\sharp}_{t}(a)-\mathcal{H}^{\sharp}_{t}(A^{\sharp}_{t})=\mathcal{H}_{t_{0}+t}(a)-\mathcal{H}_{t_{0}+t}(A_{t_{0}+t})\ge r_{0}|a-A_{t_{0}+t}|^{2}=r_{0}|a-A^{\sharp}_{t}|^{2}.

Step 3: proof of claim 3. The components of AA are continuous, hence measurable by claim 3 of the toolkit, and bounded in absolute value by R=supαAαR=\sup_{\alpha\in\mathcal{A}}|\alpha|, finite by claim 1 of the affine rate-family lemma, so each satisfies [0,T](Aj)2dλ[0,T]R2T\int_{[0,T]}(A^{j})^{2}\,d\lambda_{[0,T]}\le R^{2}\,T by monotonicity and claim 1 of the toolkit; thus AL2([0,T];Rm)A\in\mathcal{L}^{2}([0,T];\mathbb{R}^{m}), and since AtAA_{t}\in\mathcal{A} for every t[0,T]t\in[0,T], the definition of the control set gives [A]UA[A]\in\mathcal{U}_{\mathcal{A}} with admissible representative AA. The same applies to AA^{\sharp} on [0,T][0,T^{\sharp}] (its components are continuous by Step 1), giving [A]UA[T][A^{\sharp}]\in\mathcal{U}^{[T^{\sharp}]}_{\mathcal{A}}.

The pair (S,A)(S,A) is a generalized mean-field trajectory pair for (β0,β1)(\beta_{0},\beta_{1}) with horizon TT: condition 1 holds by clause 1 of the trajectory-pair definition (continuity implying measurability of the control components as above), and condition 2 holds because the Riemann integrals of clause 2 of that definition equal the Lebesgue integrals by claim 3 of the toolkit. Its value at t=0t=0 is S0S_{0}, so by claim 2 of the existence and uniqueness theorem (applied to the initial value S0S_{0} and the control AA) SS is the map furnished by claim 1 of that theorem, which by claim 2 of the flow stability lemma (with the admissible representative AA) is the flow: S=S(S0,[A])S=S(S_{0},[A]). By the definition of the mean-field cost (evaluated with the admissible representative AA), F(S0,[A])F(S_{0},[A]) is the generalized mean-field cost of (S,A)(S,A), namely [0,T]L(St,At)dt+G(ST)\int_{[0,T]}L(S_{t},A_{t})\,dt+G(S_{T}); since the Riemann integral defining the mean-field cost JMF[(S),(A)]J^{MF}[(S),(A)] equals the Lebesgue integral by claim 3 of the toolkit, F(S0,[A])=JMF[(S),(A)]F(S_{0},[A])=J^{MF}[(S),(A)]. The same argument applied to the shifted pair (S,A)(S^{\sharp},A^{\sharp}) (a trajectory pair by Step 1, with value St0S_{t_{0}} at t=0t=0) gives S=S[T](St0,[A])S^{\sharp}=S^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}]) and F[T](St0,[A])=JMF[(S),(A)]=[0,T]L(St,At)dt+G(ST)F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}])=J^{MF}[(S^{\sharp}),(A^{\sharp})]=\int_{[0,T^{\sharp}]}L(S^{\sharp}_{t},A^{\sharp}_{t})\,dt+G(S^{\sharp}_{T^{\sharp}}). By (0.1) with c=t0c=t_{0} (the integrand tL(St,At)t\mapsto L(S_{t},A_{t}) restricted to [t0,T][t_{0},T] being measurable and bounded, as a continuous function on a compact interval by the provisions of the mean-field cost definition and restriction stability) and ST=STS^{\sharp}_{T^{\sharp}}=S_{T},

F[T](St0,[A])=[t0,T]L(St,At)dt+G(ST).F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}])=\int_{[t_{0},T]}L(S_{t},A_{t})\,dt+G(S_{T}).

Finally, for t0>0t_{0}>0, (0.2) with c=t0c=t_{0} splits F(S0,[A])=[0,T]L(St,At)dt+G(ST)F(S_{0},[A])=\int_{[0,T]}L(S_{t},A_{t})\,dt+G(S_{T}) as [0,t0]L(St,At)dt+[t0,T]L(St,At)dt+G(ST)\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt+\int_{[t_{0},T]}L(S_{t},A_{t})\,dt+G(S_{T}), which is the asserted splitting; for t0=0t_{0}=0 the first term is 00 by the stated convention and the splitting reads F(S0,[A])=F[T](S0,[A])F(S_{0},[A])=F^{[T]}(S_{0},[A]), which holds because the two instances coincide.

Step 4: proof of claim 4. Suppose first t0=0t_{0}=0. Then ζs=vs\zeta_{s}=v_{s} for every s[0,T]s\in[0,T] (the interval [0,t0)[0,t_{0}) being empty and T=TT^{\sharp}=T), so ζ=v\zeta=v is an admissible representative of [ζ]=η[\zeta]=\eta; any two admissible representatives of η\eta are equal off a set of measure zero by the definition of the Lebesgue space (two representatives of one class agree off a null set), so [ζ][\zeta] does not depend on the choice; and the asserted identity reads F(S0,η)=0+F[T](S0,η)F(S_{0},\eta)=0+F^{[T]}(S_{0},\eta), which holds as in Step 3. Assume now t0>0t_{0}>0.

Admissible representative. Fix j{1,,m}j\in\{1,\dots,m\} and a Borel set ERE\subseteq\mathbb{R}. Then

(ζj)1(E)=((Aj)1(E)[0,t0)){s[t0,T]:vst0jE}.(\zeta^{j})^{-1}(E)=\Big((A^{j})^{-1}(E)\cap[0,t_{0})\Big)\cup\big\{s\in[t_{0},T]:v^{j}_{s-t_{0}}\in E\big\}.

The first set is the intersection of a member of B[0,T]\mathcal{B}_{[0,T]} with the Borel set [0,t0)[0,t_{0}), hence a member of B[0,T]\mathcal{B}_{[0,T]}. The second set is a member of B[t0,T]\mathcal{B}_{[t_{0},T]} by the measurability part of Step 0 (applied with [a,b]=[t0,T][a,b]=[t_{0},T], c=t0c=-t_{0} and f=vjf=v^{j}, measurable on [0,T][0,T^{\sharp}]), hence a Borel subset of [0,T][0,T] (claim 1 of the toolkit) and so a member of B[0,T]\mathcal{B}_{[0,T]}. Thus ζj\zeta^{j} is measurable; moreover ζsA\zeta_{s}\in\mathcal{A} for every ss, so ζjR|\zeta^{j}|\le R with R=supαAαR=\sup_{\alpha\in\mathcal{A}}|\alpha|, finite by claim 1 of the affine rate-family lemma; being measurable and bounded, each component is square-integrable, so ζL2([0,T];Rm)\zeta\in\mathcal{L}^{2}([0,T];\mathbb{R}^{m}) and ζ\zeta is an admissible representative of [ζ]UA[\zeta]\in\mathcal{U}_{\mathcal{A}}. If vv' is another admissible representative of η\eta, then v=vv=v' off a set NB[0,T]N\in\mathcal{B}_{[0,T^{\sharp}]} with λ[0,T](N)=0\lambda_{[0,T^{\sharp}]}(N)=0, and the two concatenations agree off N+t0N+t_{0}, which is Borel with λ(N+t0)=λ(N)=0\lambda(N+t_{0})=\lambda(N)=0 by claim 1 of translation invariance (members of B[0,T]\mathcal{B}_{[0,T^{\sharp}]} being Borel by claim 1 of the toolkit), and is a subset of [t0,T][t_{0},T], hence a member of B[0,T]\mathcal{B}_{[0,T]} of measure zero. Two elements of L2\mathcal{L}^{2} agreeing off a null set have the same class by the definition of the Lebesgue space, so [ζ][\zeta] is independent of the choice of vv.

The flow follows SS, then the shifted flow. Write x=S(S0,[ζ])x=S(S_{0},[\zeta]), by claim 2 of the flow stability lemma (with the admissible representative ζ\zeta) the map furnished by claim 1 of the existence and uniqueness theorem for the initial value S0S_{0} and the control ζ\zeta: xx is continuous, xtΔlx_{t}\in\Delta^{l}, and

xtγ=S0γ+[0,t]b^γ(xs,ζs)ds(t[0,T], γ{1,,l}),x^{\gamma}_{t}=S^{\gamma}_{0}+\int_{[0,t]}\hat{b}^{\gamma}(x_{s},\zeta_{s})\,ds\qquad(t\in[0,T],\ \gamma\in\{1,\dots,l\}),

the integrand being measurable and bounded by 2l(l1)B2\sqrt{l}\,(l-1)B: by claim 1 of the existence theorem the pair (x,ζ)(x,\zeta) is a generalized mean-field trajectory pair whose drift integrand agrees with the displayed one — b^\hat{b} agreeing with bb on Δl×A\Delta^{l}\times\mathcal{A} by claim 6 of the affine rate-family lemma and xsΔlx_{s}\in\Delta^{l} — and the closing provisions of the generalized-pair definition record that measurability and bound. Restricting to t[0,t0]t\in[0,t_{0}], the pair of restrictions satisfies the same equation for the instance with horizon t0t_{0} and the control ζ[0,t0]\zeta|_{[0,t_{0}]} (restrictions of measurable maps being measurable as in Step 0). On the other hand, define qγ:[0,t0]Rq^{\gamma}:[0,t_{0}]\to\mathbb{R} by qγ(s)=b^γ(Ss,ζs)q^{\gamma}(s)=\hat{b}^{\gamma}(S_{s},\zeta_{s}). Off the single point t0t_{0} we have ζs=As\zeta_{s}=A_{s} and hence, by claim 6 of the affine rate-family lemma (b^=b\hat{b}=b on Δl×A\Delta^{l}\times\mathcal{A}), qγ(s)=bγ(Ss,As)q^{\gamma}(s)=b^{\gamma}(S_{s},A_{s}), a continuous function of ss; at s=t0s=t_{0}, qγ(t0)q^{\gamma}(t_{0}) is some real number. On [0,t0][0,t_{0}] we may write qγ=bγ(S,A)1[0,t0)+qγ(t0)1{t0}q^{\gamma}=b^{\gamma}(S_{\cdot},A_{\cdot})\,\mathbf{1}_{[0,t_{0})}+q^{\gamma}(t_{0})\,\mathbf{1}_{\{t_{0}\}}, where 1D\mathbf{1}_{D} denotes the indicator of a set DD; the first factor is continuous, hence measurable by measurability of continuous functions, the indicators are measurable as indicators of the members [0,t0)[0,t_{0}) and {t0}\{t_{0}\} of B[0,t0]\mathcal{B}_{[0,t_{0}]}, and qγq^{\gamma} is measurable by arithmetic of measurable functions; moreover qγ2l(l1)B|q^{\gamma}|\le2\sqrt{l}\,(l-1)B by claim 6 of the affine rate-family lemma; so, by claim 2 of the null-set lemma and clause 2 of the trajectory-pair definition together with claim 3 of the toolkit, for every t[0,t0]t\in[0,t_{0}],

[0,t]b^γ(Ss,ζs)ds=[0,t]bγ(Ss,As)ds=StγS0γ.\int_{[0,t]}\hat{b}^{\gamma}(S_{s},\zeta_{s})\,ds=\int_{[0,t]}b^{\gamma}(S_{s},A_{s})\,ds=S^{\gamma}_{t}-S^{\gamma}_{0}.

Thus the restriction of SS to [0,t0][0,t_{0}] also satisfies the horizon-t0t_{0} equation with the control ζ[0,t0]\zeta|_{[0,t_{0}]}. By the uniqueness in claim 1 of the existence theorem (horizon t0t_{0}, initial value S0S_{0}, control ζ[0,t0]\zeta|_{[0,t_{0}]}), xt=Stx_{t}=S_{t} for all t[0,t0]t\in[0,t_{0}]; in particular xt0=St0x_{t_{0}}=S_{t_{0}}.

Now define x:[0,T]Δlx^{\natural}:[0,T^{\sharp}]\to\Delta^{l} by xt=xt0+tx^{\natural}_{t}=x_{t_{0}+t}, continuous as in Step 1. For t(0,T]t\in(0,T^{\sharp}], by the displayed equation for xx at t0+tt_{0}+t and at t0t_{0}, (0.2) (split at t0t_{0}) and (0.1) (shift by c=t0c=t_{0}; ζt0+s=vs\zeta_{t_{0}+s}=v_{s} and xt0+s=xsx_{t_{0}+s}=x^{\natural}_{s} for s[0,T]s\in[0,T^{\sharp}]),

xtγ=xt0γ+[t0,t0+t]b^γ(xs,ζs)ds=St0γ+[0,t]b^γ(xs,vs)ds,x^{\natural\gamma}_{t}=x^{\gamma}_{t_{0}}+\int_{[t_{0},t_{0}+t]}\hat{b}^{\gamma}(x_{s},\zeta_{s})\,ds=S^{\gamma}_{t_{0}}+\int_{[0,t]}\hat{b}^{\gamma}(x^{\natural}_{s},v_{s})\,ds ,

and this also holds trivially at t=0t=0. By the uniqueness in claim 1 of the existence theorem (horizon TT^{\sharp}, initial value St0S_{t_{0}}, control vv) and claim 2 of the flow stability lemma (vv being an admissible representative of η\eta), x=S[T](St0,η)x^{\natural}=S^{[T^{\sharp}]}(S_{t_{0}},\eta).

Cost splitting. By the definition of the mean-field cost with the admissible representative ζ\zeta and by the generalized cost, whose provisions record that the integrand tL(xt,ζt)t\mapsto L(x_{t},\zeta_{t}) is measurable and bounded,

F(S0,[ζ])=[0,T]L(xt,ζt)dt+G(xT)=[0,t0]L(xt,ζt)dt+[t0,T]L(xt,ζt)dt+G(xT)F(S_{0},[\zeta])=\int_{[0,T]}L(x_{t},\zeta_{t})\,dt+G(x_{T})=\int_{[0,t_{0}]}L(x_{t},\zeta_{t})\,dt+\int_{[t_{0},T]}L(x_{t},\zeta_{t})\,dt+G(x_{T})

by (0.2). On [0,t0][0,t_{0}] the integrand agrees off the single point t0t_{0} with tL(St,At)t\mapsto L(S_{t},A_{t}) (using x=Sx=S on [0,t0][0,t_{0}] and ζ=A\zeta=A on [0,t0)[0,t_{0})), both being integrable (measurable and bounded, the latter continuous), so the first integral equals [0,t0]L(St,At)dt\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt by claim 2 of the null-set lemma. By (0.1) — its hypotheses holding because the restriction to [t0,T][t_{0},T] of the measurable bounded integrand tL(xt,ζt)t\mapsto L(x_{t},\zeta_{t}) is measurable (as in Step 0) and bounded — the second integral equals [0,T]L(xt,vt)dt\int_{[0,T^{\sharp}]}L(x^{\natural}_{t},v_{t})\,dt, and G(xT)=G(xT)G(x_{T})=G(x^{\natural}_{T^{\sharp}}); by the definition of F[T]F^{[T^{\sharp}]} with the admissible representative vv and the identification x=S[T](St0,η)x^{\natural}=S^{[T^{\sharp}]}(S_{t_{0}},\eta), their sum is F[T](St0,η)F^{[T^{\sharp}]}(S_{t_{0}},\eta). This proves the asserted identity.

Step 5: proof of claim 5. Let ηUA[T]\eta\in\mathcal{U}^{[T^{\sharp}]}_{\mathcal{A}} be arbitrary and let vv be an admissible representative of η\eta (existing by claim 2 of the flow stability lemma for the horizon-TT^{\sharp} instance), with concatenation ζ\zeta as in claim 4. Since JS0J^{*}_{S_{0}} is the infimum of the value set VS0\mathcal{V}_{S_{0}} (notation of the statement), it is a lower bound of it, so F(S0,[A])=JS0F(S0,[ζ])F(S_{0},[A])=J^{*}_{S_{0}}\le F(S_{0},[\zeta]) (the equality by the assumption [A]MS0[A]\in\mathcal{M}^{*}_{S_{0}} and the definition of the optimal control set). By claims 3 and 4,

[0,t0]L(St,At)dt+F[T](St0,[A])=F(S0,[A])F(S0,[ζ])=[0,t0]L(St,At)dt+F[T](St0,η),\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt+F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}])=F(S_{0},[A])\le F(S_{0},[\zeta])=\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt+F^{[T^{\sharp}]}(S_{t_{0}},\eta),

so F[T](St0,[A])F[T](St0,η)F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}])\le F^{[T^{\sharp}]}(S_{t_{0}},\eta) for every ηUA[T]\eta\in\mathcal{U}^{[T^{\sharp}]}_{\mathcal{A}}. Hence F[T](St0,[A])F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}]) is a lower bound of the value set VSt0[T]\mathcal{V}^{[T^{\sharp}]}_{S_{t_{0}}} and a member of it; since JSt0[T]J^{*[T^{\sharp}]}_{S_{t_{0}}} is the greatest lower bound of that set, JSt0[T]F[T](St0,[A])J^{*[T^{\sharp}]}_{S_{t_{0}}}\ge F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}]), while as a lower bound it also satisfies JSt0[T]F[T](St0,[A])J^{*[T^{\sharp}]}_{S_{t_{0}}}\le F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}]); so the two are equal, [A]MSt0[T][A^{\sharp}]\in\mathcal{M}^{*[T^{\sharp}]}_{S_{t_{0}}} by the definition of the optimal control set, and the first asserted display follows from claim 3. Subtracting the splitting of claim 3 from JS0=F(S0,[A])J^{*}_{S_{0}}=F(S_{0},[A]) gives the second: JSt0[T]=F[T](St0,[A])=F(S0,[A])[0,t0]L(St,At)dt=JS0[0,t0]L(St,At)dtJ^{*[T^{\sharp}]}_{S_{t_{0}}}=F^{[T^{\sharp}]}(S_{t_{0}},[A^{\sharp}])=F(S_{0},[A])-\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt=J^{*}_{S_{0}}-\int_{[0,t_{0}]}L(S_{t},A_{t})\,dt. \blacksquare

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Comments

Loading…