At a local maximum, perturbing along noise gradients of bounded cylindrical functions and expanding the Gaussian entropy (second-order expansion) and the potential energy (tangent inequality plus dominated convergence) shows that the Gibbs Ornstein-Uhlenbeck functional is bounded by the noise-gradient norm; the Gibbs Fisher bound lemma then puts the maximiser in the score domain.
Each result cited is universally quantified over the data in its own statement.
Real arithmetic, the order of and absolute values are those of The Real Numbers: Standing Notation and Background §background, used without further mention; square roots are the nonnegative ones of Existence and Uniqueness of the Nonnegative Square Root, and for nonnegative reals , if and only if by claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field.
The quadruple is a noise penalty pair on by The Gibbs Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair, so Noise Penalty Pairs with Regular Penalised Maxima §regular applies to it. Let be a noise intrinsic test function on , let be positive, and let be a point at which has a local maximum relative to in the metric space of First-Order Equations on the Noise Wasserstein Space Relative to a Noise Penalty Pair: Standing Notation §space. By Local Maximum of a Function Relative to a Subset of a Metric Space there is a positive such that every with satisfies
We must show . By property (b) of Noise Intrinsic Test Functions on the Noise Wasserstein Space §differentiability, is differentiable along noise couplings at , and its gradient has the property of Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §differentiable by Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §gradient.
Data on and on . Write with head dimension , profile and semiconvexity constant (Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §admissible), fix and as in Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §below and Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §slope, so , and let be the number of Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §translation. Let be the normaliser of The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §normaliser. Since , has finite relative entropy with respect to (The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain); by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy, has finite relative entropy with respect to and is integrable with respect to , and by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §domain, and each is integrable with respect to . For every , The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §pair and Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy give
For every we have and by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, hence (if this holds as ; if , then , as ); and by Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §slope and Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, , so
Step 1 (Data for a fixed cylindrical direction). Fix and , and put , a bounded cylindrical function with noise gradient , by the preamble of Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation (whose hypothesis holds for ); so the -th coordinate of is for and for . Let be the class of , which is square-integrable with respect to by The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient; it is the element written in A Bound on the Gibbs Ornstein-Uhlenbeck Functional by Noise Gradients Gives Finite Fisher Information Relative to the Gibbs Measure. By Bounded Twice Continuously Differentiable Functions with Bounded First and Second Partial Derivatives on Euclidean Space §bounded there are nonnegative with and for all and ; these are the numbers written and in Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation. Let and be the constants of that lemma (Determinants of Positive Definite Matrices: Positivity, the Bound , Bounds under Pinching, and the Expansion of §expansion, read with , where they are written and ), and put
where is the noise Ornstein-Uhlenbeck functional. By the formula of The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient, , so for every . Note , and every with satisfies . For let , the map of Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation, and put and . By Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §displacement, applied with and its representative , , , and .
The potential pairing. By Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, applied with the vector , and since for (Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §gradient), for all and the function
is given by the displayed finite sum. Each product is integrable with respect to by the preamble of The Gibbs Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates, so is integrable; put . For each the integrand of the -th term of The Gibbs Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates §functional is that of the -th term of The Noise Ornstein-Uhlenbeck Functional of a Probability Measure at a Bounded C^2 Function of Finitely Many Coordinates §functional plus , so the linearity of Linearity and Monotonicity of the Lebesgue Integral §integrable and (1.1) with give
the left-hand side being the Gibbs Ornstein-Uhlenbeck functional, defined as and is integrable with respect to .
Step 2 (A bound on ). With , the bound Noise Displacement and Cross Pairings Along Couplings: Bounds, Linearity, Displacement Couplings, Polarisation and a Vanishing Criterion §bound gives .
Step 3 (The perturbed measures lie in , and the change of the potential energy). Let with , so and . By Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation §pushforward, is Borel and has finite relative entropy with respect to . Let . The vector lies in , a linear subspace of by The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §hilbert, and . So Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §translation, the positivity and the monotonicity of (claim 4 of Basic Properties of the Exponential Function) give
and therefore, by the bound of the data paragraph,
The function is integrable with respect to by Linearity and Monotonicity of the Lebesgue Integral §integrable, being integrable and constants integrable by claim 6(a) of Borel Measurability and Bounded Integration on a Metric Space. The function is Borel, by claims 3 and 4 of Borel Measurability and Bounded Integration on a Metric Space, being continuous (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity); and , so is integrable, by the monotonicity of Linearity and Monotonicity of the Lebesgue Integral §nonnegative and the definition of integrability. By the change of variables formula of Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §pushforward (claim 2 of Image Measures, Measures with Densities, and Change of Variables), is integrable with respect to and . Hence, by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy, has finite relative entropy with respect to , that is, (The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain), and (0.2) for and , with the linearity of Linearity and Monotonicity of the Lebesgue Integral §integrable, gives
Next, , so Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §tangent-inequality, applied at the points and (in the roles of its and ), gives , with of (1.1); since ,
The function is Borel by (1.1), each being continuous (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity) and each Borel (Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel), with claims 3 and 4 of Borel Measurability and Bounded Integration on a Metric Space and claims 2 and 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions. By the Cauchy-Schwarz inequality in the real Hilbert space (The Cauchy-Schwarz Inequality in a Real Inner Product Space, The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §hilbert), (0.3) and (3.1),
so is integrable. Integrating (3.3), by the linearity and monotonicity of Linearity and Monotonicity of the Lebesgue Integral §integrable,
Step 4 (Continuity of the potential pairing at ). We claim: for every positive there is with such that whenever . Suppose not, for some . Then for each the number does not qualify, so there is with and . Then by The Archimedean Property of the Real Numbers and Limit of a Sequence of Real Numbers. Fix and . The distance from to in is , which tends to ; given , the continuity of at (Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity, in the sense of Continuous Map Between Metric Spaces) provides with whenever , and for all large ; so , and by (1.1) and Arithmetic of Limits of Real Sequences. Since , (3.4) gives , an integrable function. By claim 3 of Dominated Convergence Theorem (on the measure space , with the Borel functions and limit function ), , so for all large (Limit of a Sequence of Real Numbers), a contradiction. This proves the claim.
Step 5 (). Let be positive. First choose, by Differentiability of a Function on the Noise-Connected Measures Along Noise Couplings, and Its Gradient §differentiable applied to and , a positive such that for every and every with . Next let be given by Step 4 with . Then choose a positive with
which is possible since each condition holds for all sufficiently small positive . Let , so and .
By Step 3, . As and , The Noise Wasserstein Distance §distance (the pair being noise-connected by The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §connected) gives , so , both numbers being nonnegative. Hence (0.1) gives .
Since and , the choice of gives , so .
Since and , Relative Entropy along a Noise-Gradient Perturbation of the Identity: the Formula, the Second-Order Expansion and the First Variation §expansion gives . Since , Step 4 gives . With (3.2) and (3.5),
Multiplying by and using and , . Combining the three inequalities,
Taking and and dividing by gives . As was arbitrary (given , take ), Comparison of Real Numbers with Arbitrary Positive Slack §vanishing gives , and by (1.2),
Step 6 (Conclusion). By Steps 5 and 2, with , a nonnegative real number not depending on or ,
This holds for every and every . Since and is integrable with respect to , A Bound on the Gibbs Ornstein-Uhlenbeck Functional by Noise Gradients Gives Finite Fisher Information Relative to the Gibbs Measure §fisher shows that has a relative score with respect to and finite Fisher information relative to with weights . As , by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain. Since , and the local maximiser were arbitrary, the pair has regular penalised maxima (Noise Penalty Pairs with Regular Penalised Maxima §regular).
Loading…