The diagonal coupling places the reference measure in its own class and the support bound gives finite second moments; gluing over the reference measure gives noise-connectedness. Noise-optimal couplings arise as weak limits of minimising sequences via tightness, Prokhorov's theorem and lower semicontinuity of the noise cost, and the metric axioms, the comparison with and the lower semicontinuity of then follow from swapping, gluing and the same compactness argument.
Each result cited is universally quantified over the data in its own statement.
Throughout, the notation is that of Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation, whose clause Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §background puts the notation of Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation in force. Since the letters denote the coordinate maps of , couplings in sequences are written ; is the swap of Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §swap, and gluings in the sense of Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §glued are written , with the maps of Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs. Square roots are the nonnegative square roots of Existence and Uniqueness of the Nonnegative Square Root. That is increasing on follows from claim 2 of Monotonicity of Squaring on the Nonnegative Elements of an Ordered Field; for one has , and because and , both by the uniqueness in that theorem; and the Archimedean property is The Archimedean Property of the Real Numbers. These three results are in force by The Real Numbers: Standing Notation and Background §background. For noise-connected we use repeatedly that, by The Noise Wasserstein Distance §distance, is the greatest lower bound of the nonempty set of nonnegative reals and for every .
Preliminaries. We record four elementary facts used below.
Claim (subsequences). Let be or , let for with , and let be strictly increasing in . Then . Indeed, fix a bounded continuous . By Weak Convergence of Finite Borel Measures on a Metric Space the real sequence converges to in the sense of Limit of a Sequence of Real Numbers; this is convergence in the real line of The Absolute Value Metric on the Real Line in the sense of Convergent Sequence in a Metric Space, the two definitions requiring the same inequality for all large . By A Subsequence of a Convergent Sequence Has the Same Limit the subsequence converges to , and as was arbitrary, .
Claim (constant sequences). For the constant sequence with all terms converges weakly to : for every bounded continuous the sequence of integrals is constant, equal to , and converges to it by Constant Sequences and Index-Shifted Sequences of Real Numbers §constant.
Claim (tight subfamilies). A subset of a tight set of Borel measures on is tight, since for each the compact set supplied for the larger set by Tight Family of Borel Measures on a Metric Space §tight serves for the subset; in particular a sequence whose terms all lie in a tight set is tight in the sense of Tight Family of Borel Measures on a Metric Space §sequence.
Claim (Prokhorov on pairs). is a metric space by Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §pairs, and the members of are Borel measures of total mass on it by Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §measures, with weak convergence that of Borel Probability Measures on a Real Hilbert Space with an Orthonormal Basis: Standing Notation §weak. Hence Prokhorov's Theorem on a Metric Space: a Tight Sequence of Borel Probability Measures Has a Weakly Convergent Subsequence §subsequence applies to every tight sequence in : it has a subsequence converging weakly to a member of .
Step 1 (claim 1). By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §displacement, applied with in place of , the coupling belongs to , so is noise-connected by Couplings of Finite Noise Cost and Their Noise Cost §connected, and by The Measures Noise-Connected to the Reference Measure §space. This is the clause reference. For the clause moments, let . Then is nonempty by The Measures Noise-Connected to the Reference Measure §space and Couplings of Finite Noise Cost and Their Noise Cost §connected, and by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §reference; by the last sentence of Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §support-bound, applied to the pair , also .
Step 2 (claim 2). Let . By The Measures Noise-Connected to the Reference Measure §space choose first and then . By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §swap, applied to the pair , . The measures belong to by Step 1 and Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §reference. Apply Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs with its taken to be and its taken to be : by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §glued there is a gluing of and , and by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §noise-triangle . So is noise-connected, and is defined by The Noise Wasserstein Distance §distance. Nothing here requires .
Step 3 (claim 3). Let with noise-connected, and write , the greatest lower bound of the nonempty set , which is bounded below by . For each , by Approximation Property of the Supremum and the Infimum in §epsilon-below with , there is with ; choose one such coupling for each (a countable sequence of choices, made in the order of ). Then for all , so the sequence is bounded, with bound .
The set is tight in by the last sentence of Couplings on a Hilbert Space: Tightness, Closedness under Weak Convergence, and Lower Semicontinuity of the Quadratic Cost §tight, and every lies in it, so is tight by Claim (tight subfamilies). By Claim (Prokhorov on pairs) there are a strictly increasing and with . The constant sequences with terms and converge weakly to and by Claim (constant sequences), and for every , with bounded by . By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §lsc, applied with all , all and the couplings , we get and .
We show that this limit inferior is at most . Write and , as in Limit Inferior of a Bounded Sequence of Real Numbers. Since by Strictly Increasing Sequences of Natural Numbers Dominate Their Index, for every . Fix and ; by the Archimedean property choose with ; then . As was arbitrary, , for every . Thus is an upper bound of , and by Limit Inferior of a Bounded Sequence of Real Numbers. Hence , the last inequality by The Noise Wasserstein Distance §distance. So , and is noise-optimal by Noise-Optimal Couplings §optimal.
Step 4 (claim 8). This step uses only claims 1 to 3. Let . They belong to by Step 1, and is noise-connected by Step 2; by Step 3 choose a noise-optimal , so . Since , The Quadratic Wasserstein Distance on a Hilbert Space §distance gives , and Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §support-bound gives . As by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §weights and , taking square roots gives .
Step 5 (claim 4). Let ; both ordered pairs and are noise-connected by Step 2. Write and . If , then and by Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §swap, so ; the same clause applied to the pair gives . Hence the two sets are equal, so are their greatest lower bounds, and so are the square roots: by The Noise Wasserstein Distance §distance.
Step 6 (claim 5). Let . If , then by Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §displacement the coupling has noise cost , so and . Conversely, if , then Step 4 gives , so ; as by Step 1, The Quadratic Wasserstein Distance is a Metric on the Probability Measures with Finite Second Moment on a Hilbert Space §separation gives .
Step 7 (claim 6). Let . The pairs , and are noise-connected by Step 2. By Step 3 choose first a noise-optimal and then a noise-optimal , so that and . The three measures lie in by Step 1. Apply Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs with its taken to be and its taken to be : by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §glued there is a gluing of and , and by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §noise-triangle with . Since by The Noise Wasserstein Distance §distance, taking square roots gives .
Step 8 (claim 7). By Step 2 and The Noise Wasserstein Distance §distance, is a function from to with nonnegative values, which is condition 1 of Metric Space. Conditions 2, 3 and 4 of that definition are Steps 6, 5 and 7 respectively (with the three points of condition 4 named in that order). Hence this restriction of is a metric on .
Step 9 (claim 9, first part). Let be as in claim 9, and let satisfy for all . Write , defined by Step 2, and . Since for all , by claim 2 of Basic Properties of the Limit Inferior and Limit Superior of a Bounded Real Sequence. For each choose, by Steps 2 and 3, a noise-optimal , so (a countable sequence of choices, in the order of ).
The sequences and converge weakly, hence are tight by Cauchy Sequences in the Quadratic Wasserstein Space and Weakly Convergent Sequences on a Hilbert Space are Tight §weakly-convergent; that is, the sets and are tight. By Couplings on a Hilbert Space: Tightness, Closedness under Weak Convergence, and Lower Semicontinuity of the Quadratic Cost §tight the set of all couplings of a member of with a member of is tight in , and every belongs to .
Fix . By claim 4 of Basic Properties of the Limit Inferior and Limit Superior of a Bounded Real Sequence there are natural numbers with for every . The sequence has all its terms in , so it is tight by Claim (tight subfamilies), and by Claim (Prokhorov on pairs) there are a strictly increasing and with . Put ; is strictly increasing by claim 2 of A Subsequence of a Subsequence is a Subsequence, so and by Claim (subsequences). Moreover , so is bounded, and for every , because . By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §lsc, applied to the sequences , and , we get and ; and by claims 1 and 2 of Basic Properties of the Limit Inferior and Limit Superior of a Bounded Real Sequence.
Consequently is nonempty and is noise-connected by Couplings of Finite Noise Cost and Their Noise Cost §connected, and by The Noise Wasserstein Distance §distance; taking square roots, . As was arbitrary, .
Step 10 (claim 9, clause closed-under-limit). Suppose moreover . By Step 9 choose , and by The Measures Noise-Connected to the Reference Measure §space choose then . Since by Step 1, the last sentence of Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §support-bound, applied to the pair , gives ; and by Probability Measures on a Hilbert Space Transported in the Noise Norm: Standing Notation §reference. By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §swap, . Apply Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs with its taken to be and its taken to be : by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §glued there is a gluing , and by Gluing Two Couplings on a Hilbert Space over a Common Middle Marginal, and the Triangle Inequalities for the Quadratic and Noise Costs §noise-triangle . By Couplings of Finite Noise Cost: the Support Bound, Swap, Displacement Couplings and Lower Semicontinuity of the Noise Cost §swap once more, , so is noise-connected and by The Measures Noise-Connected to the Reference Measure §space.
All nine claims are proved.
Loading…