TheoremBase

Tail Replacement in the Noise Wasserstein Distance: a Measure of Finite Relative Entropy is Approximated by the Gaussian-Tail Extensions of Its Rescaled Heads

Replacing the tail of a measure of finite relative entropy by an independent Gaussian tail costs, in squared noise Wasserstein distance, at most 2 kappa times the relative entropy lost by passing to the rescaled head; hence the Gaussian-tail extensions of the rescaled heads converge to the measure.

Statement

In the setting of A Diagonal Gaussian Reference Measure on the Noise Wasserstein Space, Rescaled Heads and Gaussian Tails: Standing Notation, let κ\kappa be a positive real number with ck≤κ akc_{k}\le\kappa\,a_{k} for every k∈Nk\in\mathbb{N}, and let μ∈P(X)\mu\in\mathcal{P}(X) have finite relative entropy with respect to γc\gamma_{c}. For n∈Nn\in\mathbb{N}, μ~n\tilde{\mu}_{n} has finite relative entropy with respect to γ~n\tilde{\gamma}_{n} by Gaussian-Tail Extensions: the Gaussian Reference Measure, Marginals, Densities, Relative Entropy, Relative Score and the Noise Wasserstein Distance §heads, and En(μ~n)E_{n}(\tilde{\mu}_{n}) is its Gaussian-tail extension at level nn.

1. (Membership) For every n∈Nn\in\mathbb{N}, the measures μ\mu and En(μ~n)E_{n}(\tilde{\mu}_{n}) belong to Pρa\mathcal{P}^{a}_{\rho}, so that Wa(μ,En(μ~n))W_{a}(\mu,E_{n}(\tilde{\mu}_{n})) is defined.

2. (The estimate) For every n∈Nn\in\mathbb{N},

Wa(μ,En(μ~n))2≤2κ (H(μ ∣ γc)−H(μ~n ∣ γ~n)).W_{a}\bigl(\mu,E_{n}(\tilde{\mu}_{n})\bigr)^{2}\le2\kappa\,\bigl(H(\mu\,|\,\gamma_{c})-H(\tilde{\mu}_{n}\,|\,\tilde{\gamma}_{n})\bigr).

3. (Convergence) Wa(μ,En(μ~n))→0W_{a}\bigl(\mu,E_{n}(\tilde{\mu}_{n})\bigr)\to0 as n→∞n\to\infty.

Proofs

Log in to submit a proof.

Loading...

Citations

Loading…

Dependencies

Loading…

Related

0 relations

Curated associations between results. These are editable and subjective — they do not replace the dependency graph, which is derived from the references in the text.

No relations recorded yet.

Comments

Log in to comment.

Loading…