Following Feyel and Ustunel, the rescaled heads of the source measure are absolutely continuous, so their Euclidean optimal displacements are tangent; their lifts are noise-tangent fields whose graph couplings have noise cost at most the squared noise Wasserstein distance and cluster, by tightness and lower semicontinuity, at the unique noise-optimal coupling. Convergence of norms then upgrades this to strong convergence of the lifts to the optimal displacement, which therefore lies in the closed noise tangent space; the noise map property follows with the noise Brenier theorem.
Each result cited is universally quantified over the data in its own statement. Elementary order and arithmetic of real numbers, square roots and limits of real sequences included, are those of The Real Numbers: Standing Notation and Background §background. The argument is the finite-dimensional approximation of Feyel and "Ust"unel: the noise-optimal displacement is approached by lifts of Euclidean optimal displacements between rescaled heads, which are tangent by the Euclidean theory.
Proof of claim 1. Fix , with a density with respect to in the sense of The Radon-Nikodym Theorem for a Finite Measure and a Sigma-Finite Measure, and Uniqueness of Densities: is Borel, , and for every . Fix and a noise-optimal map from to . By The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §moments, , and by The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §connected the pair is noise-connected. For let be the rescaled head map and the lift of Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space, and put and . By Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §head, applied to and to , is continuous and Borel and . Write for Lebesgue measure on , the measure written in Absolutely Continuous Probability Measure on Euclidean Space and Diagonal Gaussian Measures on Euclidean Space with . Euclidean results below are read with in the role of the dimension .
Step 1 (The heads of are absolutely continuous). Fix . Let be the maps for the diagonal matrices with diagonal entries , respectively (), and off-diagonal entries . They are Borel by Lebesgue Measure under a Triangular or Symmetric Positive Definite Linear Map §borel, and by the matrix-vector product of Real Matrices, Symmetric Matrices and the Semidefinite Ordering: Standing Notation §matrices, and . Hence, comparing with the formula for and with the coordinate map of Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §coordinates, and using ,
The noise weights are positive by the definition of a weight sequence (Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §weights), so the matrix of is lower triangular with positive diagonal entries . Let with , and let . Applying Lebesgue Measure under a Triangular or Symmetric Positive Definite Linear Map §triangular to and , for which , and evaluating the integrals of indicators by The Integral of an Indicator Function is the Measure of the Set, gives with , where is the matrix of , so by the conventions of Measure Spaces and the Lebesgue Integral: Standing Notation §extended. The truncation is a variance vector by Variance Sequences and Their Truncations §truncations; write for the diagonal Gaussian density with variances , a density on unrelated to the reference measure . It is positive and Borel by The Diagonal Gaussian Density on Euclidean Space: Regularity, Gradient, Normalization, Second Moments and Exponential Moments of Diagonal Quadratic Forms §regularity, so is Borel by claims 1 and 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions, and it vanishes off the -null set ; so by Diagonal Gaussian Measures on Euclidean Space §measure and The Lebesgue Integral and Null Sets: Almost-Everywhere Comparison, Markov's Inequality, and Dominated Convergence Almost Everywhere §null-integral
Let , which belongs to since is Borel (Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §continuity) and equals since . By Diagonal Gaussian Measures on a Hilbert Space §measure, . The nonnegative function , Borel by claims 1 and 3 of Arithmetic, Absolute Values, and Pointwise Limits of Measurable Real-Valued Functions, vanishes off the -null set , so by The Lebesgue Integral and Null Sets: Almost-Everywhere Comparison, Markov's Inequality, and Dominated Convergence Almost Everywhere §null-integral
Hence is absolutely continuous.
Step 2 (Euclidean optimal maps and their lifts). For each , Step 1 and Out of an Absolutely Continuous Measure the Optimal Map and the Optimal Displacement are Tangent §uniquely-mapped, applied to , give an optimal map from to ; for each fix one such map (one choice for each ). This fixes the sequences , and defined below, and with them the sequences and of Step 4 used in Steps 5 and 6. Now fix . By the definition of an optimal map, is Borel, , and the coupling is optimal, that is, by Optimal Coupling of Two Probability Measures with Finite Second Moment §optimal, its quadratic cost is , where is the quadratic Wasserstein distance. Let , . It is the composite of the Borel pairing of Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets §pairing with the map of Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets §projections, whose -th component is continuous, since ; so is Borel by claims 3(b) and 5 of The Borel Sigma-Algebra of a Euclidean Space as a Product, and Measurability of Projections, Sequentially Continuous Maps, and Open and Closed Sets and claim 4 of Borel Measurability and Bounded Integration on a Metric Space. Since is the value at of , the change-of-variables formula gives
By Out of an Absolutely Continuous Measure the Optimal Map and the Optimal Displacement are Tangent §tangent, ; since is a linear subspace of by Basic Properties of the Tangent Space: Closed Subspace, the Identity Map Belongs to It, Second-Moment Limits, and Representation of Bounded Functionals on Gradients §closed, it contains , which is the class of . Let . By Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §lift, which applies by (2.1), is Borel from to , and for every ; and by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §lift, with both arguments equal to in its inner-product identity. As on (The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §borel), the change-of-variables formula, the norm of Square-Integrable Vector Fields Against a Probability Measure on Euclidean Space, and Test Functions: Standing Notation §l2mu and (2.1) give
Finally by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §tangent.
Step 3 (The bound ). By The Noise Wasserstein Distance is a Metric on the Measures Noise-Connected to the Reference Measure: Existence of Noise-Optimal Couplings, Comparison with the Quadratic Wasserstein Distance and Lower Semicontinuity §optimal there is a noise-optimal coupling , so . Fix . The maps are Borel by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §product-sigma and claim 4 of Borel Measurability and Bounded Integration on a Metric Space, so their pairing is Borel by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets §pairing; let . Since (Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets §projections), and the image measure under a composite is the image under of the image under (as , push-forwards), and likewise ; so is a coupling. For the -th component of is , and is the -th coordinate of ; so by the definition of the Euclidean norm
where is the function written , with , in The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability. The function on is Borel by Pairs of Euclidean Points: Coordinate Projections, Pairings, the Product Measure on a Euclidean Space, Borel Norm Functions and Finite Sets §functions, applied to the Borel maps and . For one has , so The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §partial-sums gives (The Noise Space is a Real Hilbert Space: Orthonormal Basis, Continuous Embedding, Partial Sums, Closed Balls and Borel Measurability §pairs). As by Couplings of Finite Noise Cost and Their Noise Cost §finite, the complement of is -null, and the change-of-variables formula, The Lebesgue Integral and Null Sets: Almost-Everywhere Comparison, Markov's Inequality, and Dominated Convergence Almost Everywhere §comparison and The Quadratic Wasserstein Distance on Euclidean Space §distance give
Taking nonnegative square roots, for every .
Step 4 (Head-matched targets converge to ). Fix . The map is Borel, as the composite of the Borel pairing (Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §pairing) with the continuous addition of (claims 3 and 4 of Borel Measurability and Bounded Integration on a Metric Space). Let and . Since and, by (2.2), , Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §displacement gives, with Step 3,
Heads: by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §shift, for every , so and, push-forwards under composites being iterated push-forwards as in Step 3, . Since (Step 1), .
Tails: by Lifting Euclidean Tangent Fields of the Rescaled Head to Noise Tangent Fields on a Hilbert Space §shift, , so by the change-of-variables formula , the integrand being continuous, hence Borel, by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §continuity. The sequence is exhausting for and is the orthogonal projection onto , by Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §coordinates; so for every , converges to by Exhausting Sequences of Finite-Dimensional Subspaces in a Separable Real Hilbert Space, and Their Projections §tail, that is, , and hence . Moreover by Borel Sets of a Hilbert Space with an Orthonormal Basis: Coordinates, Determination by Finite-Dimensional Projections, and Pairs §continuity, and is integrable with respect to because (The Second Moment of a Borel Probability Measure on a Hilbert Space and the Probability Measures with Finite Second Moment §space, Measure Spaces and the Lebesgue Integral: Standing Notation §integral). By The Lebesgue Integral and Null Sets: Almost-Everywhere Comparison, Markov's Inequality, and Dominated Convergence Almost Everywhere §dominated, with , and ,
Hence Measures Whose Heads Agree with a Fixed Measure and Whose Tails Vanish Converge in the Quadratic Wasserstein Distance §convergence, applied to and to the sequence in the role of , gives
Step 5 (A cluster point of the couplings is the graph coupling of ). By (4.2) and Wasserstein Convergence on a Hilbert Space: Weak Convergence, Integrals of Continuous Functions of Quadratic Growth, Convergence from Weak Convergence with Uniformly Integrable Second Moments, and Compactness §weak, , so the sequence , that is, the set , is tight by Cauchy Sequences in the Quadratic Wasserstein Space and Weakly Convergent Sequences on a Hilbert Space are Tight §weakly-convergent and the definition of a tight sequence. The set is tight by Ulam's Theorem: a Finite Borel Measure on a Complete Separable Metric Space is Tight §tight, being complete and separable by Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §space. By Couplings on a Hilbert Space: Tightness, Closedness under Weak Convergence, and Lower Semicontinuity of the Quadratic Cost §tight, with and as the two tight sets, the set of all couplings of with some is tight in ; it contains every by (4.1), and a subset of a tight set is tight, the same compact sets serving (Tight Family of Borel Measures on a Metric Space §tight). So is a tight sequence of Borel probability measures on the metric space , and Prokhorov's Theorem on a Metric Space: a Tight Sequence of Borel Probability Measures Has a Weakly Convergent Subsequence §subsequence, applied to this whole sequence, gives a strictly increasing sequence in and with ; the subsequence and the limit coupling are thus chosen after all the couplings , .
By (4.2), read in the metric space , and A Subsequence of a Convergent Sequence Has the Same Limit, , so by Wasserstein Convergence on a Hilbert Space: Weak Convergence, Integrals of Continuous Functions of Quadratic Growth, Convergence from Weak Convergence with Uniformly Integrable Second Moments, and Compactness §weak applied to the sequence . By (4.1) the sequence lies in , so it is bounded, and Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §lsc, with (a constant sequence, which converges weakly to by Weak Convergence of Finite Borel Measures on a Metric Space, its integrals being constant), and , gives and . Each term is at most , so their limit inferior is at most . Together with from The Noise Wasserstein Distance §distance, this gives : is noise-optimal. By Brenier's Theorem in the Noise Norm: Noise-Optimal Couplings out of a Measure with a Density Relative to a Diagonal Gaussian Measure are Induced by a Unique Map §uniquely-mapped, which applies since has a density with respect to , the pair is uniquely noise-mapped: by Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §uniquely-mapped there is a noise-optimal map from to such that every noise-optimal coupling of and equals . The coupling is noise-optimal by Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §map; hence
Step 6 (Strong convergence of the lifted displacements, and tangency). Let and for . By Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §map and its preamble, is Borel, for every and ; by Step 2 and (2.2) each is Borel with values in and . So and every are noise displacements for in the sense of Strong Convergence of Noise Displacement Fields from Weak Convergence of Their Graph Couplings and an Upper Bound on Their Norms. Since and , Step 5 reads
By (2.2), Step 3 and The Noise-Optimal Map: Transport Cost, Stability Along Nearly Optimal Couplings and Stability Under Perturbation of the Source §cost (taking nonnegative square roots), for every , so the norm hypothesis holds with for every positive . Therefore Strong Convergence of Noise Displacement Fields from Weak Convergence of Their Graph Couplings and an Upper Bound on Their Norms §strong-displacement gives : the sequence , which lies in by Step 2, converges to in the metric space (Real Hilbert Space §topology). As is closed in by Linearity of the Noise Gradient, and the Noise Tangent Space is a Closed Linear Subspace §subspace, Sequential Characterization of Closed Subsets of a Metric Space gives , proving claim 1.
Proof of claim 2. By definition . Let and . Since has a density with respect to , the pair is uniquely noise-mapped by Brenier's Theorem in the Noise Norm: Noise-Optimal Couplings out of a Measure with a Density Relative to a Diagonal Gaussian Measure are Induced by a Unique Map §uniquely-mapped; in particular, by Noise-Optimal Maps and Uniquely Noise-Mapped Pairs §uniquely-mapped, there is a noise-optimal map from to , and every such satisfies by claim 1. Hence has the noise map property of The Noise Map Property of a Set of Probability Measures §map-property.
Loading…