Defines, from eight parameters, the data of a two-state controlled population of Ising type: the compact box of admissible transition rates, the rates themselves, the entropic running cost with its splitting interaction, the two observation channels, and the smooth extensions of all three.
Let , , , , and be positive real numbers, and let and be real numbers with . These eight numbers are the parameters¶, with the roles: is the entropic weight, and a large makes deviation of the transition rates from the rest rate cheap; is the splitting strength, and the cost it weights is smallest when the population is evenly split; is the state-dependent observation rate and the background observation rate; is a convexity weight, used only in the extension of the running cost; is the horizon; and is the range of admissible transition rates.
The Ising population data with these parameters are the objects displayed in the five clauses below, taken together. They describe a population in which each agent occupies one of two states, the two coordinates of the control are the rates of the two possible transitions, the running cost prices deviation of those rates from entropically and rewards an even split, and each agent emits observations in a channel determined by its state; the components are not separately meaningful, since the transition rates, the cost and the observation rates are the rate, cost and observation data of one controlled population, and each is accompanied by the extension of itself that the fluctuation theory differentiates.
1. (Dimensions and vectors.)¶ The state count, control dimension and channel count are the natural numbers , and . State is called down and state up. Write for the probability simplex, whose points are the population profiles ; for the Euclidean norm on Euclidean space; for the dot product; for the transpose and for the product of real matrices; and for the indicator equal to when the subscripted condition holds and to otherwise. Put
Every difference of two population profiles is a multiple of , since the two coordinates of a profile sum to and so those of a difference sum to , while points across the simplex; the two are orthogonal, , and .
2. (Control set and ambient open sets.)¶ The control set is the box
and the ambient open sets are
together with and . The set is the state-side open set of both the transition-rate extension and the cost extension, the control-side open set of the transition-rate extension, and the open set of the observation-rate extension.
3. (Transition rates and their extension.)¶ An agent in the down state moves up at the rate given by the first control coordinate, and an agent in the up state moves down at the rate given by the second: for and ,
neither depending on the profile . These rates are affine in the control with the coefficients
and their extension is and for .
4. (Observation rates and their extension.)¶ An agent in state emits observations in the matching channel at rate and in the other channel at the background rate : for ,
again independent of the profile, with the extension for .
5. (Running and terminal cost and their extension.)¶ Let be the regularised entropic rate cost with cut-offs and , a function which is nonnegative, vanishes exactly at the rest rate , and has second derivative at every , by claims The Regularised Entropic Rate Cost §profile, The Regularised Entropic Rate Cost §cost-function and The Regularised Entropic Rate Cost §sign-bounds of that lemma. The running cost and terminal cost are
where the first term charges each agent for the rate at which it is being moved, weighted by the share of the population subject to that rate, and the second is smallest when the population is evenly split. Their extension is
The term weighted by is written into only, not into ; it vanishes at every point of , since there.
6. (Notational cautions.)¶ The parameter is written in the source of this model, a letter reserved here for transition-rate families; is the negative of the interaction parameter written there, and is unrelated to the auxiliary integrand written inside The Fluctuation Linear-Quadratic Cost Functional; the external field written there is taken to be here and is not named. The open set introduced above is unrelated to the coefficient matrices written in Completion of Squares and A Priori Control Bound for the Fluctuation Cost. The cut-offs and are real numbers, not maps, and the overbar in is unrelated to the overbars marking extensions in , , and . The vector is not a natural number, and carries no time subscript anywhere.
Loading…
Prerequisites
No prerequisites tracked.
Dependents
No dependents yet.
Dependent proofs
No dependent proofs yet.
No relations recorded yet.