Gaussian integration by parts applied to a test function times the Gibbs weight (derivatives bounded via the slope bound and the lower bound on V) gives integration by parts against the Gibbs measure, so the Gibbs measure has zero score in the Gibbs entropy pair. The pair is (beta/kappa - K)-displacement convex, and the HWI theorem yields the entropy-form log-Sobolev and Talagrand inequalities. Gross's form follows from the entropy form for the measure with density proportional to + eps, letting eps tend to 0.
Each result cited is universally quantified over the data in its own statement. Elementary real arithmetic and order (The Real Numbers: Standing Notation and Background §background) are used without citation; this covers manipulations of inequalities, finite sums and products, the limit laws for convergent real sequences, the preservation of non-strict inequalities under limits, and the fact that when are nonnegative with . Integrals and integrability are those of Measure Spaces and the Lebesgue Integral: Standing Notation; linearity and monotonicity of the integral are Linearity and Monotonicity of the Lebesgue Integral §integrable and Linearity and Monotonicity of the Lebesgue Integral §nonnegative; a bounded Borel function is integrable with respect to a Borel probability measure on by claim 6(b) of Borel Measurability and Bounded Integration on a Metric Space. Test functions in are written , ; the letter is reserved for the function of The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm.
Notation. Write and for the weight of The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §weight, and keep the full notation for the normaliser of The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §normaliser; is positive and by The Gibbs Measure of an Admissible Cylindrical Potential Relative to a Diagonal Gaussian Measure §gibbs. Let with head dimension and profile (Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §admissible), and fix constants and as in Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §below and Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §slope; by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §translation, and for every , and every being continuous, hence Borel, by Basic Properties of an Admissible Cylindrical Potential: Continuity, Growth under Noise Translations, Integrability, the Tangent Inequality and Tangency of the Noise Gradient §continuity. Let , , so that . Put
which is positive since and .
Step 1 (Calculus of profiles). For the set is open by claim 1 of Euclidean Space is Open in Itself, and Maps are Continuous, and the class and the partial derivatives on it are those of Differential Calculus and Convexity on Euclidean Open Sets: Standing Notation §derivatives, that is, of C^k Maps on a Euclidean Open Set, which are the notions of Constants, Coordinate Functions, Sums and Products of Functions on a Euclidean Open Set and A Composition of Maps Between Euclidean Open Sets is of Class . Points of are written .
(a) Sums and products. Let be of class on and . By claim 3 of Constants, Coordinate Functions, Sums and Products of Functions on a Euclidean Open Set, applied to and the scalar , then to and , and to and , the functions and are of class on . The partial derivatives of and exist at every point by clause 1 of C^k Maps on a Euclidean Open Set, read through its clause 3, so by claim 1 of Constants, Coordinate Functions, Sums and Products of Functions on a Euclidean Open Set, applied in the same way, and pointwise on , for every . By these formulas, (Bounded Continuously Differentiable Functions with Bounded Partial Derivatives on Euclidean Space §bounded) is closed under sums, real multiples and products.
(b) Lifting. Let , , , and let be of class . For the slice of at in the -th variable is the slice of at if (both taken on a common interval, every radius being admissible in claim 1 of Slice Function and the Partial Derivative, the domains being whole Euclidean spaces) and is constant if ; so by claim 2 of Slice Function and the Partial Derivative and claim 1 of Sum, Constant Multiple, and Product Rules for One-Dimensional Derivatives, for and for . The coordinate functions () of are smooth, hence of class , on by claim 2 of Constants, Coordinate Functions, Sums and Products of Functions on a Euclidean Open Set and Smooth Map on a Euclidean Open Set; so is of class on by clauses 1 and 3 of C^k Maps on a Euclidean Open Set, and is of class on by claim 2 of A Composition of Maps Between Euclidean Open Sets is of Class , applied with , the open set in place of , and . By the formulas just obtained, lies in if . Since by Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §coordinates, ; in particular every with representation has the representation for every .
(c) Composition with . Let be of class . By Derivative and Continuity of the Scaled Exponential Function with , is differentiable at every point of the interval with , and continuous on . The slice of at in the -th variable is composed with the slice of , so by Chain Rule for One-Dimensional Derivatives and claim 2 of Slice Function and the Partial Derivative, . For a real-valued function on (), continuity at a point in the sense of Continuity at a Point for Maps Between Euclidean Spaces is the same as continuity at that point from to in the sense of Continuous Map Between Metric Spaces, since is the nonnegative square root of , , and exactly when for nonnegative and positive . So (with ) is continuous at every point in the first sense, and is continuous at every point by clause 1 of C^k Maps on a Euclidean Open Set and Composition of Continuous Euclidean Maps; and (clause 1 of C^k Maps on a Euclidean Open Set) are then continuous on in the second sense, hence so is by Continuity of Sums and Products of Real-Valued Functions on a Metric Space §on-set, and so it is continuous at every point in the first sense. Hence is of class by clause 1 of C^k Maps on a Euclidean Open Set, read through its clause 3.
(d) Cylindrical functions. Let and . By (b) they have representations , with a common ; by (a), and are representations of and , which therefore belong to (Bounded C^1 Cylindrical Functions on a Hilbert Space with an Orthonormal Basis §cylindrical); and by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial and (a), for every
all terms vanishing for . A constant function belongs to by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §linear; explicitly, the function with constant value has the representation , where is the constant function with value , which is smooth, hence of class , by claim 2 of Constants, Coordinate Functions, Sums and Products of Functions on a Euclidean Open Set and Smooth Map on a Euclidean Open Set, and whose partial derivative vanishes by claim 1 of Sum, Constant Multiple, and Product Rules for One-Dimensional Derivatives and claim 2 of Slice Function and the Partial Derivative, its slices being constant; so , and the partial derivatives of the constant function vanish by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial.
Step 2 (Integration by parts against the Gibbs measure). For and put
We show: is integrable with respect to and . It is Borel: is Borel by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §continuity, and by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel, as noted, and claims 2 and 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions apply ( by Variance Sequences and Their Truncations §variances).
Let be a representation of and . By Step 1(b), with ( the projection onto the first coordinates), and, being of class and so of class (clause 2 of C^k Maps on a Euclidean Open Set), with of class ( the projection onto the first coordinates), for and for . Comparing with Admissible Cylindrical Potentials on a Hilbert Space in the Noise Geometry §gradient, for , and for . Put . By Step 1(a),(c), is of class on with
so that, by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial for the representation of ,
Growth bound. Let bound and every , and let . Let and . For , the slope bound gives , so ; for , . Put ; then (if then ; if then ). By claims 1, 2 and 4 of Basic Properties of the Exponential Function, , , , and by The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm §exp, . Hence
since and . Therefore, for all and ,
Integration by parts. By Gaussian Integration by Parts for Functions of Finitely Many Coordinates Relative to a Diagonal Gaussian Measure on a Hilbert Space with , this and this (the functions written and there being and ), the functions , and are integrable with respect to (Gaussian Integration by Parts for Functions of Finitely Many Coordinates Relative to a Diagonal Gaussian Measure on a Hilbert Space §integrable). If , then is integrable by linearity, and its integral is by Gaussian Integration by Parts for Functions of Finitely Many Coordinates Relative to a Diagonal Gaussian Measure on a Hilbert Space §coordinate. If , then (Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial) and , so , integrable with integral by Gaussian Integration by Parts for Functions of Finitely Many Coordinates Relative to a Diagonal Gaussian Measure on a Hilbert Space §orthogonal. In both cases Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §density shows that is integrable with respect to and
Step 3 (The Gibbs entropy pair). Since for all , the hypothesis of the Gibbs entropy pair holds with this ; let be the Gibbs entropy pair with potential and temperature . It is a noise penalty pair on by The Gibbs Entropy Pair is a Noise Penalty Pair, with Nonnegative Penalty and Dense Score Domain §pair, and it is -displacement convex by The Gibbs Entropy Pair of a K-Semiconvex Potential is Lambda-Displacement Convex with Lambda the Temperature over the Variance-to-Noise Bound Minus K §convex, being nonnegative and the semiconvexity constant of . We record:
(F1) For : has finite relative entropy with respect to and is integrable with respect to by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §entropy; and each is integrable with respect to by Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §domain; and by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §penalty-domain.
(F2) For : by (F1) and Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §splitting, has a relative score with respect to , finite Fisher information relative to with weights , and ; so Entropy and Score Relative to the Gibbs Measure Split into Their Gaussian Parts and the Potential, with a Fisher Information Bound §field applies and, with (The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §pair),
Step 4 (The Gibbs measure is a zero of the score). The constant function is a density of with respect to itself, since for (integral of an indicator); and by The Natural Logarithm and claim 1 of Basic Properties of the Exponential Function. So is the zero function, integrable with integral : has finite relative entropy with respect to itself (Relative Entropy of Probability Measures §relative-entropy), , and .
By (F1), and every is integrable with respect to , so The Relative Score with Respect to the Gibbs Measure of an Admissible Cylindrical Potential applies to . For let be the zero vector of . For every , by Elementary Identities in a Real Inner Product Space §zero, and by (2.1). So is the relative score of with respect to (The Relative Score with Respect to the Gibbs Measure of an Admissible Cylindrical Potential §score); the series has all terms , so it converges with sum (Series of Real Numbers §convergent), and has finite Fisher information relative to with weights , with (The Weighted Fisher Information Relative to the Gibbs Measure of an Admissible Cylindrical Potential §information). Hence by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain, and by (3.1) . As is a real Hilbert space with this norm (Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §fields, The Space of Square-Integrable Hilbert-Valued Maps is a Real Hilbert Space: Coordinates and Synthesis §hilbert), is its zero vector by Elementary Identities in a Real Inner Product Space §vanishing. Thus Talagrand, HWI and Log-Sobolev Inequalities for a Uniformly Displacement Convex Noise Penalty Pair with a Point of Zero Score applies to the pair, this , and , with .
Step 5 (Claim 1). Let be as in claim 1. Then and, by The Gibbs Entropy Pair on the Noise Wasserstein Space: Relative Entropy to the Gibbs Measure and the Gibbs Score Field §score-domain, . By Talagrand, HWI and Log-Sobolev Inequalities for a Uniformly Displacement Convex Noise Penalty Pair with a Point of Zero Score §log-sobolev and (3.1),
Dividing by and using gives .
Step 6 (Claim 2). Let have finite relative entropy with respect to . Then , and by Step 4; both lie in by (F1). By Talagrand, HWI and Log-Sobolev Inequalities for a Uniformly Displacement Convex Noise Penalty Pair with a Point of Zero Score §talagrand with , and The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §symmetry,
so .
Step 7 (A bound for ). Let and let be Borel. Then is Borel by The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm §continuous, with by The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm §lower, and for , by The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm §log, while . So , and , are bounded Borel functions, integrable with respect to every Borel probability measure on . In particular, for , which is Borel with for some by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel, the functions and are bounded and Borel (claim 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions), hence integrable with respect to ; this is the first assertion of claim 3.
Step 8 (Claim 3 for ). Let with representation , and (Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel), and fix a positive . By Step 1(d) applied to and , with ; by Step 1(d) applied to and the constant function , with , with for every (so for , by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §partial for ), and . Following the construction of Step 1(d), with the representations of and of (Step 1(d) with ) lifted by Step 1(b) to a common dimension , has a representation with , where and is the projection onto the first coordinates; in particular for every .
(a) The measure. Put ; by monotonicity and claim 6(a) of Borel Measurability and Bounded Integration on a Metric Space, . Let , a Borel function with and . By claim 3 of Image Measures, Measures with Densities, and Change of Variables, defines a measure on with , so , and for every Borel , is integrable with respect to if and only if is integrable with respect to , in which case . Thus is a density of with respect to , is integrable by Step 7, and has finite relative entropy with respect to (Relative Entropy of Probability Measures §relative-entropy); so .
(b) The entropy. Since with positive, by The Natural Logarithm, so pointwise . By Step 7, and are integrable with respect to , so is defined (The Entropy of a Nonnegative Function with Respect to a Probability Measure §entropy), and by linearity
(c) The relative score. By (F1), and every is integrable with respect to , so The Relative Score with Respect to the Gibbs Measure of an Admissible Cylindrical Potential applies to . The function is of class on , hence continuous on by claim 3 of Euclidean Space is Open in Itself, and Maps are Continuous, and nowhere zero, so is continuous on by claim 2 of Continuity of the Reciprocal of a Nonvanishing Real-Valued Function on a Metric Space and Borel by claims 2 and 3 of Borel Measurability and Bounded Integration on a Metric Space; as is Borel by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §continuity, is Borel by claim 4 of Borel Measurability and Bounded Integration on a Metric Space. For let , which is Borel by Bounded C^1 Cylindrical Functions: Linear Structure, the Gradient and the Partial Derivatives, Bounds and Integrability, and Density in the Square-Integrable Functions §bounded-borel and claim 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions, with ( for ), so that is bounded and Borel, is -integrable with respect to , and its class lies in . Let . By Step 1(d), with , so pointwise
By Step 2, is integrable with respect to with integral , and is bounded and Borel; so is integrable with respect to , and by (a) and linearity
using , the bounded Borel function , and The Lebesgue Space of Square-Integrable Functions is a Real Hilbert Space §inner-product. By The Relative Score with Respect to the Gibbs Measure of an Admissible Cylindrical Potential §score, is the relative score of with respect to .
(d) The Fisher information. By The Lebesgue Space of Square-Integrable Functions is a Real Hilbert Space §inner-product and (a), , the integrand being a product of bounded Borel functions (claim 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions); this is for . So the series converges (its partial sums are constant from the -th on), has finite Fisher information relative to with weights (The Weighted Fisher Information Relative to the Gibbs Measure of an Admissible Cylindrical Potential §information), and, since , monotonicity and The Noise Gradient of a Cylindrical Function and the Noise Tangent Space at a Probability Measure on a Hilbert Space §gradient give
the last integrand being bounded and Borel by that clause.
(e) Conclusion. By (a), (c) and (d), satisfies the hypotheses of claim 1, so by Step 5, (b) and (d)
and multiplying by ,
Step 9 (Claim 3). Apply (8.1) with , . For each , , so by the continuity of (The Function : Continuity, Young's Inequality and Lower Bounds, with the Elementary Bounds for the Exponential and the Logarithm §continuous, unwound through the - condition of Continuous Map Between Metric Spaces); and by Step 7 with , a constant, integrable with respect to . By Dominated Convergence Theorem, . Also by linearity and claim 6(a) of Borel Measurability and Bounded Integration on a Metric Space, so by continuity of . Hence, by The Entropy of a Nonnegative Function with Respect to a Probability Measure §entropy, , and letting in (8.1), whose right-hand side does not depend on ,
This proves claim 3.
Loading…