Theorems
A growing collection of mathematical statements with user-submitted proofs.
Thinning: Cell Counts of a Poisson Number of Independent Points
lemmalem:poisson-thinning-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space}, the set of \reftext{def:natural-numbers-2026a}{natural numbers} with , and the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. Let be real, let be a random variable with the \reftext{def:poisson-distribution-2026b}{Poisson distribution} with parameter , let be a probability \reftext{def:measure-measure-space-2026a}{measure} on the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}, and let be random variables each with \reftext{def:distribution-cdf-random-variable-2026a}{distribution} , such that the \reftext{def:family-subfamily-subsets-set-2026a}{family} is \reftext{def:independence-events-rvs-2026a}{independent}. Let and let be pairwise disjoint Borel sets, with . Define if and otherwise (so with probability , since a Poisson variable lies in with probability by \ref{def:poisson-distribution-2026b}), and define the \textbf{cell counts} where is the function equal to on and off , and an empty sum is . Then: \textbf{1.} each is a random variable with all values in , measurable with respect to the \reftext{def:independence-sigma-algebras-2026a}{generated -algebra} ; \textbf{2.} for all , with the \reftext{def:factorial-natural-number-2026a}{factorial} (convention ), the convention , the \reftext{def:exponential-function-real-2026a}{exponential function} , and the \reftext{def:finite-product-notation-2026a}{finite product notation}, \textbf{3.} the random variables are independent, and has the Poisson distribution with parameter .Factorized Joint Probability Mass Function Implies Independence
lemmalem:factorized-pmf-independence-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space}, let be the set of \reftext{def:natural-numbers-2026a}{natural numbers} with , and let . Let be random variables such that for every and every . Suppose that for each there is a function with such that for all , with the \reftext{def:finite-product-notation-2026a}{finite product notation}. Then: \textbf{1.} for every and every \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel set} , the sum over the countable index set being the supremum of its finite partial sums (all terms are nonnegative); in particular ; \textbf{2.} the random variables are \reftext{def:independence-events-rvs-2026a}{independent}.Multinomial Distribution of Cell Counts for Independent Identically Distributed Points
lemmalem:multinomial-cell-counts-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space}, let be the set of \reftext{def:natural-numbers-2026a}{natural numbers} with , and let . Let be \reftext{def:independence-events-rvs-2026a}{independent} random variables, each with the same \reftext{def:distribution-cdf-random-variable-2026a}{distribution} . Let be pairwise disjoint \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel sets} whose union is , the set of \reftext{def:real-numbers-c54-2026c}{real numbers}, and set for . For define the \textbf{cell count} where denotes the function equal to on the event and on its \reftext{def:complement-subset-relative-set-2026a}{complement}. Each is a random variable, as shown in the proof. Then for every with , with the \reftext{def:factorial-natural-number-2026a}{factorial} (convention ), the convention , and the \reftext{def:finite-product-notation-2026a}{finite product notation}.- Let be the set of \reftext{def:natural-numbers-2026a}{natural numbers}, write for the nonnegative integers, and let be the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. We use the \reftext{def:factorial-natural-number-2026a}{factorial} for together with the conventions and for every real , and the \reftext{def:finite-product-notation-2026a}{finite product notation}. Let , let , and let . Then The sum is over the finitely many -tuples of nonnegative integers with entrywise summing to .
- Let be a \reftext{def:probability-space-random-variable-2026a}{probability space}, let be the set of \reftext{def:natural-numbers-2026a}{natural numbers}, let be nonempty, and let be an \reftext{def:independence-events-rvs-2026a}{independent} \reftext{def:family-subfamily-subsets-set-2026a}{family} of random variables on it (for this is an independent \reftext{def:sequence-in-set-2026a}{sequence}). Let be a nonempty set and let be a family of pairwise disjoint nonempty subsets of . Then the family of \reftext{def:independence-sigma-algebras-2026a}{generated -algebras} , , is independent in the sense of \ref{def:independence-sigma-algebras-2026a}. Consequently, if for each a random variable on is -measurable, meaning for every \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel set} , then the family is independent in the sense of \ref{def:independence-events-rvs-2026a}.
Sigma-Algebra Generated by Random Variables and Independence of Sigma-Algebras
definitiondef:independence-sigma-algebras-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space}, let be the set of \reftext{def:real-numbers-c54-2026c}{real numbers}, and let be the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. \textbf{Generated -algebra of a family of random variables.} Let be a nonempty set and let be a \reftext{def:family-subfamily-subsets-set-2026a}{family} of random variables on . The \textbf{-algebra generated by }, written , is the \reftext{def:generated-sigma-algebra-2026a}{generated -algebra} on of the family Since each is a random variable, every member of lies in , and is a \reftext{def:sigma-algebra-measurable-space-2026a}{-algebra} containing ; hence , i.e., it is a \textbf{sub--algebra} of . For a single random variable we write . In this case the family is itself a -algebra: , , and , with and Borel because is a -algebra. Hence . \textbf{Independence of -algebras.} Let be a nonempty set and for each let be a sub--algebra. The family is \textbf{independent} if for every finite nonempty set of distinct indices and every choice of events (), with the \reftext{def:finite-product-notation-2026a}{finite product notation}. Because for every and , the family is independent if and only if every finite subfamily is independent, and events are \reftext{def:independence-events-rvs-2026a}{independent} if and only if the product identity above holds for every choice of indices after inserting for omitted factors; in particular, random variables are independent in the sense of \ref{def:independence-events-rvs-2026a} if and only if the -algebras are independent, since as shown above.Pythagorean Theorem in Euclidean Space
theoremthm:pythagorean-theorem-rn-2026aGeometryMultivariable CalculusLet \reftext{def:natural-numbers-2026a}{}, and let , , be points of \reftext{def:euclidean-space-rn-2026a}{Euclidean space} . Assume that the \reftext{def:dot-product-orthogonality-rn-2026a}{differences} and are \reftext{def:dot-product-orthogonality-rn-2026a}{orthogonal}, that is, Then, with denoting the \reftext{def:euclidean-distance-rn-2026a}{Euclidean distance} on , \textit{In the classical picture, is the vertex of the right angle of a right triangle, and are the lengths of the two legs, and is the length of the hypotenuse.}Difference, Dot Product, and Orthogonality in
definitiondef:dot-product-orthogonality-rn-2026aGeometryMultivariable CalculusLet \reftext{def:natural-numbers-2026a}{}, and let and be points of \reftext{def:euclidean-space-rn-2026a}{Euclidean space} . The \textbf{difference} is the point of defined by where in each coordinate the difference is that of real numbers. 2. The \textbf{dot product} of and is the real number The points and are called \textbf{orthogonal} if .- Let be a \reftext{def:inhomogeneous-poisson-process-2026b}{homogeneous Poisson process} with rate on a \reftext{def:probability-space-random-variable-2026a}{probability space} , so that the mean function of is for all , and let be an intensity function with mean function , in the sense of the same definition, where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. Define Then is an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on the same probability space.
Kolmogorov Forward Equations for the Inhomogeneous Poisson Process
theoremthm:kolmogorov-forward-poisson-2026bProbabilityLet be an intensity function with mean function , and let be an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on a \reftext{def:probability-space-random-variable-2026a}{probability space} . Here denotes the set of \reftext{def:natural-numbers-2026a}{natural numbers}, the set of nonnegative integers, and the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. For define Then the following hold. \textbf{Claim 1 (explicit form).} For every and , with the \reftext{def:exponential-function-real-2026a}{exponential function} and the \reftext{def:factorial-natural-number-2026a}{factorial}, under the conventions and recorded in \ref{def:poisson-distribution-2026b}. \textbf{Claim 2 (forward equations).} Each has a \reftext{def:derivative-interior-point-c54-2026b}{derivative} at every , and a one-sided derivative at given by the same limit restricted to positive increments; with these derivatives the \textbf{Kolmogorov forward equations} hold for all : with the initial values and for . \textbf{Claim 3 (uniqueness).} If is any family of functions , differentiable in the same sense, satisfying the same system of equations and the same initial values, then for every . In particular the functions form the unique solution of this system of ordinary differential equations.Existence of the Inhomogeneous Poisson Process
theoremthm:existence-inhomogeneous-poisson-2026bProbabilityLet be an intensity function in the sense of \ref{def:inhomogeneous-poisson-process-2026b}, where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. Then there exist a \reftext{def:probability-space-random-variable-2026a}{probability space} and an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on it. In particular, for every real there is a homogeneous Poisson process with rate .Stochastic Process, Independent Increments, and Inhomogeneous Poisson Process
definitiondef:inhomogeneous-poisson-process-2026bProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space} and the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. A \textbf{stochastic process} on is a family of random variables on indexed by the nonnegative real numbers. The process has \textbf{independent increments} if for all real the random variables are \reftext{def:independence-events-rvs-2026a}{independent}. (Differences of random variables are random variables: , using \reftext{thm:density-q-rudin-b}{density of the rationals} and the generator criterion of \ref{def:measurable-function-2026a}.) An \textbf{intensity function} is a nonnegative function that is \reftext{def:continuity-closed-interval-c54-2026b}{continuous} on every closed interval . Its \textbf{mean function} is the Riemann integral, which exists by \ref{lem:continuous-implies-riemann-integrable-c54-2026b}, with . By additivity on adjacent intervals (\ref{lem:riemann-integral-additivity-adjacent-intervals-c54-2026a}), for , and this is nonnegative because every lower sum of a nonnegative function is nonnegative (\reftext{def:upper-lower-sums-partition-c54-2026a}{upper and lower sums}); hence is nondecreasing. A stochastic process on is an \textbf{inhomogeneous Poisson process with intensity } if: \textbf{1.} ; \textbf{2.} has independent increments; \textbf{3.} for all , the increment has the \reftext{def:poisson-distribution-2026b}{Poisson distribution} with parameter , in the sense of \ref{def:distribution-cdf-random-variable-2026a}. If is constant with value , then (the Riemann integral of a constant, directly from the \reftext{def:upper-lower-sums-partition-c54-2026a}{upper and lower sums}), and is called a \textbf{homogeneous Poisson process with rate }.- Let be the set of \reftext{def:natural-numbers-2026a}{natural numbers} and write for the set of \textbf{nonnegative integers}; let be the set of \reftext{def:real-numbers-c54-2026c}{real numbers} and the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. We use the \reftext{def:factorial-natural-number-2026a}{factorial} for , extended by the convention (the cited definition covers only ), together with the convention . Fix a real number . The \textbf{Poisson distribution} with parameter is the function with the \reftext{def:exponential-function-real-2026a}{exponential function}. The terms are nonnegative, so the sum over the countable index set is well-defined independently of ordering as the supremum of its finite partial sums; for the full index set this unordered sum agrees with the limit of the partial sums of the series , since those partial sums are nondecreasing and every finite subset of is contained in an initial segment. is a probability \reftext{def:measure-measure-space-2026a}{measure} on . Countable additivity: if are pairwise disjoint Borel sets with union , then every finite subset of meets only finitely many of the , so the supremum of the finite partial sums over equals the sum over of the suprema over the blocks . Total mass: the sum is exactly the defining series of from \ref{def:exponential-function-real-2026a}, so by \ref{thm:exponential-properties-2026a}. In particular, for only the term is nonzero, so if and otherwise; we call the \textbf{unit mass at }. A random variable has the \textbf{Poisson distribution with parameter } if its \reftext{def:distribution-cdf-random-variable-2026a}{distribution} equals ; such a variable lies in with probability , since .
Agreement of the Riemann and Lebesgue Integrals for Continuous Functions on a Closed Interval
lemmalem:riemann-lebesgue-integral-agree-2026aAnalysisLet be \reftext{def:real-numbers-c54-2026c}{real numbers} and let be \reftext{def:continuity-closed-interval-c54-2026b}{continuous on the closed interval} . Define the zero extension by for and otherwise. Then the following hold. \textbf{Claim 1.} is \reftext{def:riemann-integrable-closed-interval-c54-2026b}{Riemann integrable} on , by \ref{lem:continuous-implies-riemann-integrable-c54-2026b}. \textbf{Claim 2.} is \reftext{def:measurable-function-2026a}{measurable} with respect to the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra} and \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure} . \textbf{Claim 3.} The two integrals agree: where the right-hand side is the Riemann integral of claim 1.Moments and Stability of the Standard Normal Distribution
lemmalem:gaussian-stability-2026aProbabilityLet be the set of \reftext{def:real-numbers-c54-2026c}{real numbers} and the set of \reftext{def:natural-numbers-2026a}{natural numbers}. \textbf{Claim 1.} Let be a \reftext{def:standard-normal-distribution-2026a}{standard normal} random variable on a \reftext{def:probability-space-random-variable-2026a}{probability space}. Then , , and are \reftext{def:lebesgue-integral-integrable-2026a}{integrable}, and the \reftext{def:expectation-variance-2026a}{expectation and variance} satisfy \textbf{Claim 2.} If and are \reftext{def:independence-events-rvs-2026a}{independent} standard normal random variables on a common probability space and are positive real numbers with , then is a standard normal random variable. \textbf{Claim 3.} If with and are independent standard normal random variables on a common probability space, then is a standard normal random variable, where denotes the positive \reftext{thm:nonnegative-real-has-unique-square-root-2026a}{square root} of .Existence of Independent Sequences with Prescribed Distributions
theoremthm:existence-independent-sequence-2026aProbabilityLet be a \reftext{def:sequence-in-set-2026a}{sequence} of probability \reftext{def:measure-measure-space-2026a}{measures} on , where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}, is the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}, and is the set of \reftext{def:natural-numbers-2026a}{natural numbers}. Then there exist a \reftext{def:probability-space-random-variable-2026a}{probability space} and a sequence of random variables on it that is \reftext{def:independence-events-rvs-2026a}{independent} and such that has \reftext{def:distribution-cdf-random-variable-2026a}{distribution} for every . One may take , , and the restriction to of \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure}, as in \ref{thm:existence-iid-sequence-2026a}; taking all equal to a fixed probability measure recovers the statement of that theorem.Joint Distribution, Expectations, and Block Independence for Independent Random Variables
theoremthm:independent-block-functions-2026aProbabilityThroughout, is a \reftext{def:natural-numbers-2026a}{natural number} with , is \reftext{def:euclidean-space-rn-2026a}{Euclidean space}, denotes the \reftext{def:real-numbers-c54-2026c}{real numbers}, and the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. Define the \textbf{-fold product Borel -algebra} on iteratively: and, for , , the \reftext{def:product-sigma-algebra-2026a}{product -algebra} on , identifying the \reftext{def:cartesian-product-sets-2026a}{Cartesian product} with via . Given probability \reftext{def:measure-measure-space-2026a}{measures} on , define the probability measure on iteratively by \ref{thm:product-measure-2026a} (probability measures are -finite). Call a function \textbf{jointly Borel} if it is \reftext{def:measurable-function-2026a}{measurable} from to . Let be a \reftext{def:probability-space-random-variable-2026a}{probability space} and let be \reftext{def:independence-events-rvs-2026a}{independent} random variables on it with \reftext{def:distribution-cdf-random-variable-2026a}{distributions} . Then the following hold. \textbf{Claim 1.} The map given by is measurable from to , and its distribution , , is a probability measure equal to . \textbf{Claim 2.} If is jointly Borel and either nonnegative or bounded, then is a random variable and its \reftext{def:expectation-variance-2026a}{expectation} is defined (as an element of in the nonnegative case, and as a real number in the bounded case, where is \reftext{def:lebesgue-integral-integrable-2026a}{integrable}), with In particular this expectation depends only on and the distributions . \textbf{Claim 3 (block independence).} Let and be disjoint nonempty subsets of , and let and be jointly Borel. Then and are independent random variables. \textbf{Claim 4.} Each coordinate projection and the addition map are jointly Borel; moreover, if is jointly Borel and is Borel measurable, then is jointly Borel.Smooth Test Function Criterion for Convergence in Distribution
theoremthm:smooth-test-convergence-distribution-2026aAnalysisProbabilityLet and be \reftext{def:probability-space-random-variable-2026a}{random variables}, not necessarily on a common probability space, and let denote the \reftext{def:real-numbers-c54-2026c}{real numbers}. Call a function an \textbf{admissible test function} if is bounded, is a \reftext{def:ck-map-euclidean-open-set-2026b}{ map} on , and its first, second, and third derivatives are bounded. Then the following hold. For every admissible test function and every random variable , the composition is a random variable with finite \reftext{def:expectation-variance-2026a}{expectation}; in particular and are defined real numbers. If for every admissible test function , then in distribution, in the sense of \ref{def:convergence-modes-2026a}.Taylor Expansion with Third-Order Remainder Bound
lemmalem:taylor-third-order-remainder-2026aAnalysisLet denote the \reftext{def:real-numbers-c54-2026c}{real numbers} and let be a \reftext{def:ck-map-euclidean-open-set-2026b}{ map} on , and suppose its third derivative is bounded: there is with for all , where , , denote the iterated one-dimensional \reftext{def:derivative-interior-point-c54-2026b}{derivatives}. Then for all ,- Let be a \reftext{def:probability-space-random-variable-2026a}{random variable} on a probability space with \reftext{def:distribution-cdf-random-variable-2026a}{distribution} , let denote the \reftext{def:real-numbers-c54-2026c}{real numbers}, and let be \reftext{def:measurable-function-2026a}{measurable} with respect to the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra} on both sides. Then is a random variable (preimages compose), and, with the \reftext{def:expectation-variance-2026a}{expectation} notation : if , then, with integrals as in \ref{def:lebesgue-integral-nonnegative-2026a}, in general, is \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to if and only if is integrable with respect to , and in that case the displayed identity holds in . In particular, \reftext{def:expectation-variance-2026a}{expectations, moments, and variances} of random variables depend only on their distributions, and identically distributed random variables share them.