Theorems
A growing collection of mathematical statements with user-submitted proofs.
Pythagorean Theorem in Euclidean Space
theoremthm:pythagorean-theorem-rn-2026aGeometryMultivariable CalculusLet \reftext{def:natural-numbers-2026a}{}, and let , , be points of \reftext{def:euclidean-space-rn-2026a}{Euclidean space} . Assume that the \reftext{def:dot-product-orthogonality-rn-2026a}{differences} and are \reftext{def:dot-product-orthogonality-rn-2026a}{orthogonal}, that is, Then, with denoting the \reftext{def:euclidean-distance-rn-2026a}{Euclidean distance} on , \textit{In the classical picture, is the vertex of the right angle of a right triangle, and are the lengths of the two legs, and is the length of the hypotenuse.}Difference, Dot Product, and Orthogonality in
definitiondef:dot-product-orthogonality-rn-2026aGeometryMultivariable CalculusLet \reftext{def:natural-numbers-2026a}{}, and let and be points of \reftext{def:euclidean-space-rn-2026a}{Euclidean space} . The \textbf{difference} is the point of defined by where in each coordinate the difference is that of real numbers. 2. The \textbf{dot product} of and is the real number The points and are called \textbf{orthogonal} if .- Let be a \reftext{def:inhomogeneous-poisson-process-2026b}{homogeneous Poisson process} with rate on a \reftext{def:probability-space-random-variable-2026a}{probability space} , so that the mean function of is for all , and let be an intensity function with mean function , in the sense of the same definition, where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. Define Then is an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on the same probability space.
Kolmogorov Forward Equations for the Inhomogeneous Poisson Process
theoremthm:kolmogorov-forward-poisson-2026bProbabilityLet be an intensity function with mean function , and let be an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on a \reftext{def:probability-space-random-variable-2026a}{probability space} . Here denotes the set of \reftext{def:natural-numbers-2026a}{natural numbers}, the set of nonnegative integers, and the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. For define Then the following hold. \textbf{Claim 1 (explicit form).} For every and , with the \reftext{def:exponential-function-real-2026a}{exponential function} and the \reftext{def:factorial-natural-number-2026a}{factorial}, under the conventions and recorded in \ref{def:poisson-distribution-2026b}. \textbf{Claim 2 (forward equations).} Each has a \reftext{def:derivative-interior-point-c54-2026b}{derivative} at every , and a one-sided derivative at given by the same limit restricted to positive increments; with these derivatives the \textbf{Kolmogorov forward equations} hold for all : with the initial values and for . \textbf{Claim 3 (uniqueness).} If is any family of functions , differentiable in the same sense, satisfying the same system of equations and the same initial values, then for every . In particular the functions form the unique solution of this system of ordinary differential equations.Existence of the Inhomogeneous Poisson Process
theoremthm:existence-inhomogeneous-poisson-2026bProbabilityLet be an intensity function in the sense of \ref{def:inhomogeneous-poisson-process-2026b}, where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. Then there exist a \reftext{def:probability-space-random-variable-2026a}{probability space} and an \reftext{def:inhomogeneous-poisson-process-2026b}{inhomogeneous Poisson process} with intensity on it. In particular, for every real there is a homogeneous Poisson process with rate .Stochastic Process, Independent Increments, and Inhomogeneous Poisson Process
definitiondef:inhomogeneous-poisson-process-2026bProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space} and the set of \reftext{def:real-numbers-c54-2026c}{real numbers}. A \textbf{stochastic process} on is a family of random variables on indexed by the nonnegative real numbers. The process has \textbf{independent increments} if for all real the random variables are \reftext{def:independence-events-rvs-2026a}{independent}. (Differences of random variables are random variables: , using \reftext{thm:density-q-rudin-b}{density of the rationals} and the generator criterion of \ref{def:measurable-function-2026a}.) An \textbf{intensity function} is a nonnegative function that is \reftext{def:continuity-closed-interval-c54-2026b}{continuous} on every closed interval . Its \textbf{mean function} is the Riemann integral, which exists by \ref{lem:continuous-implies-riemann-integrable-c54-2026b}, with . By additivity on adjacent intervals (\ref{lem:riemann-integral-additivity-adjacent-intervals-c54-2026a}), for , and this is nonnegative because every lower sum of a nonnegative function is nonnegative (\reftext{def:upper-lower-sums-partition-c54-2026a}{upper and lower sums}); hence is nondecreasing. A stochastic process on is an \textbf{inhomogeneous Poisson process with intensity } if: \textbf{1.} ; \textbf{2.} has independent increments; \textbf{3.} for all , the increment has the \reftext{def:poisson-distribution-2026b}{Poisson distribution} with parameter , in the sense of \ref{def:distribution-cdf-random-variable-2026a}. If is constant with value , then (the Riemann integral of a constant, directly from the \reftext{def:upper-lower-sums-partition-c54-2026a}{upper and lower sums}), and is called a \textbf{homogeneous Poisson process with rate }.- Let be the set of \reftext{def:natural-numbers-2026a}{natural numbers} and write for the set of \textbf{nonnegative integers}; let be the set of \reftext{def:real-numbers-c54-2026c}{real numbers} and the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. We use the \reftext{def:factorial-natural-number-2026a}{factorial} for , extended by the convention (the cited definition covers only ), together with the convention . Fix a real number . The \textbf{Poisson distribution} with parameter is the function with the \reftext{def:exponential-function-real-2026a}{exponential function}. The terms are nonnegative, so the sum over the countable index set is well-defined independently of ordering as the supremum of its finite partial sums; for the full index set this unordered sum agrees with the limit of the partial sums of the series , since those partial sums are nondecreasing and every finite subset of is contained in an initial segment. is a probability \reftext{def:measure-measure-space-2026a}{measure} on . Countable additivity: if are pairwise disjoint Borel sets with union , then every finite subset of meets only finitely many of the , so the supremum of the finite partial sums over equals the sum over of the suprema over the blocks . Total mass: the sum is exactly the defining series of from \ref{def:exponential-function-real-2026a}, so by \ref{thm:exponential-properties-2026a}. In particular, for only the term is nonzero, so if and otherwise; we call the \textbf{unit mass at }. A random variable has the \textbf{Poisson distribution with parameter } if its \reftext{def:distribution-cdf-random-variable-2026a}{distribution} equals ; such a variable lies in with probability , since .
Agreement of the Riemann and Lebesgue Integrals for Continuous Functions on a Closed Interval
lemmalem:riemann-lebesgue-integral-agree-2026aAnalysisLet be \reftext{def:real-numbers-c54-2026c}{real numbers} and let be \reftext{def:continuity-closed-interval-c54-2026b}{continuous on the closed interval} . Define the zero extension by for and otherwise. Then the following hold. \textbf{Claim 1.} is \reftext{def:riemann-integrable-closed-interval-c54-2026b}{Riemann integrable} on , by \ref{lem:continuous-implies-riemann-integrable-c54-2026b}. \textbf{Claim 2.} is \reftext{def:measurable-function-2026a}{measurable} with respect to the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra} and \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure} . \textbf{Claim 3.} The two integrals agree: where the right-hand side is the Riemann integral of claim 1.Moments and Stability of the Standard Normal Distribution
lemmalem:gaussian-stability-2026aProbabilityLet be the set of \reftext{def:real-numbers-c54-2026c}{real numbers} and the set of \reftext{def:natural-numbers-2026a}{natural numbers}. \textbf{Claim 1.} Let be a \reftext{def:standard-normal-distribution-2026a}{standard normal} random variable on a \reftext{def:probability-space-random-variable-2026a}{probability space}. Then , , and are \reftext{def:lebesgue-integral-integrable-2026a}{integrable}, and the \reftext{def:expectation-variance-2026a}{expectation and variance} satisfy \textbf{Claim 2.} If and are \reftext{def:independence-events-rvs-2026a}{independent} standard normal random variables on a common probability space and are positive real numbers with , then is a standard normal random variable. \textbf{Claim 3.} If with and are independent standard normal random variables on a common probability space, then is a standard normal random variable, where denotes the positive \reftext{thm:nonnegative-real-has-unique-square-root-2026a}{square root} of .Existence of Independent Sequences with Prescribed Distributions
theoremthm:existence-independent-sequence-2026aProbabilityLet be a \reftext{def:sequence-in-set-2026a}{sequence} of probability \reftext{def:measure-measure-space-2026a}{measures} on , where is the set of \reftext{def:real-numbers-c54-2026c}{real numbers}, is the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}, and is the set of \reftext{def:natural-numbers-2026a}{natural numbers}. Then there exist a \reftext{def:probability-space-random-variable-2026a}{probability space} and a sequence of random variables on it that is \reftext{def:independence-events-rvs-2026a}{independent} and such that has \reftext{def:distribution-cdf-random-variable-2026a}{distribution} for every . One may take , , and the restriction to of \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure}, as in \ref{thm:existence-iid-sequence-2026a}; taking all equal to a fixed probability measure recovers the statement of that theorem.Joint Distribution, Expectations, and Block Independence for Independent Random Variables
theoremthm:independent-block-functions-2026aProbabilityThroughout, is a \reftext{def:natural-numbers-2026a}{natural number} with , is \reftext{def:euclidean-space-rn-2026a}{Euclidean space}, denotes the \reftext{def:real-numbers-c54-2026c}{real numbers}, and the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. Define the \textbf{-fold product Borel -algebra} on iteratively: and, for , , the \reftext{def:product-sigma-algebra-2026a}{product -algebra} on , identifying the \reftext{def:cartesian-product-sets-2026a}{Cartesian product} with via . Given probability \reftext{def:measure-measure-space-2026a}{measures} on , define the probability measure on iteratively by \ref{thm:product-measure-2026a} (probability measures are -finite). Call a function \textbf{jointly Borel} if it is \reftext{def:measurable-function-2026a}{measurable} from to . Let be a \reftext{def:probability-space-random-variable-2026a}{probability space} and let be \reftext{def:independence-events-rvs-2026a}{independent} random variables on it with \reftext{def:distribution-cdf-random-variable-2026a}{distributions} . Then the following hold. \textbf{Claim 1.} The map given by is measurable from to , and its distribution , , is a probability measure equal to . \textbf{Claim 2.} If is jointly Borel and either nonnegative or bounded, then is a random variable and its \reftext{def:expectation-variance-2026a}{expectation} is defined (as an element of in the nonnegative case, and as a real number in the bounded case, where is \reftext{def:lebesgue-integral-integrable-2026a}{integrable}), with In particular this expectation depends only on and the distributions . \textbf{Claim 3 (block independence).} Let and be disjoint nonempty subsets of , and let and be jointly Borel. Then and are independent random variables. \textbf{Claim 4.} Each coordinate projection and the addition map are jointly Borel; moreover, if is jointly Borel and is Borel measurable, then is jointly Borel.Smooth Test Function Criterion for Convergence in Distribution
theoremthm:smooth-test-convergence-distribution-2026aAnalysisProbabilityLet and be \reftext{def:probability-space-random-variable-2026a}{random variables}, not necessarily on a common probability space, and let denote the \reftext{def:real-numbers-c54-2026c}{real numbers}. Call a function an \textbf{admissible test function} if is bounded, is a \reftext{def:ck-map-euclidean-open-set-2026b}{ map} on , and its first, second, and third derivatives are bounded. Then the following hold. For every admissible test function and every random variable , the composition is a random variable with finite \reftext{def:expectation-variance-2026a}{expectation}; in particular and are defined real numbers. If for every admissible test function , then in distribution, in the sense of \ref{def:convergence-modes-2026a}.Taylor Expansion with Third-Order Remainder Bound
lemmalem:taylor-third-order-remainder-2026aAnalysisLet denote the \reftext{def:real-numbers-c54-2026c}{real numbers} and let be a \reftext{def:ck-map-euclidean-open-set-2026b}{ map} on , and suppose its third derivative is bounded: there is with for all , where , , denote the iterated one-dimensional \reftext{def:derivative-interior-point-c54-2026b}{derivatives}. Then for all ,- Let be a \reftext{def:probability-space-random-variable-2026a}{random variable} on a probability space with \reftext{def:distribution-cdf-random-variable-2026a}{distribution} , let denote the \reftext{def:real-numbers-c54-2026c}{real numbers}, and let be \reftext{def:measurable-function-2026a}{measurable} with respect to the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra} on both sides. Then is a random variable (preimages compose), and, with the \reftext{def:expectation-variance-2026a}{expectation} notation : if , then, with integrals as in \ref{def:lebesgue-integral-nonnegative-2026a}, in general, is \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to if and only if is integrable with respect to , and in that case the displayed identity holds in . In particular, \reftext{def:expectation-variance-2026a}{expectations, moments, and variances} of random variables depend only on their distributions, and identically distributed random variables share them.
- Let be a \reftext{def:independence-events-rvs-2026a}{sequence of independent and identically distributed random variables} on a probability space such that and have finite \reftext{def:expectation-variance-2026a}{expectation}, and suppose ; write , for the positive square root of (\ref{thm:nonnegative-real-has-unique-square-root-2026a}), and . Then where is a \reftext{def:standard-normal-distribution-2026a}{standard normal} random variable; explicitly, in the sense of \ref{def:convergence-modes-2026a}, the convergence holding at every because is continuous everywhere by claim 3 of \ref{thm:gaussian-integral-2026a}.
The Gaussian Weight Defines a Probability Distribution
theoremthm:gaussian-integral-2026aAnalysisProbabilityLet with the \reftext{def:exponential-function-real-2026a}{exponential function}, let be \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure}, and for a \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel set} let the integral of \ref{def:lebesgue-integral-nonnegative-2026a} of the \reftext{def:measurable-function-2026a}{measurable} function . Then: is a \reftext{def:measure-measure-space-2026a}{measure} on (countable additivity follows from \ref{thm:monotone-convergence-2026a} applied to the partial sums of indicators); the total mass is a finite positive real number; in particular the normalization of \ref{def:standard-normal-distribution-2026a} is a probability measure; the function is \reftext{def:continuous-at-point-c54-2026b}{continuous} at every point of (single points have -mass ), so the cumulative distribution function of the standard normal distribution is continuous on all of ; with defined as the value of the \reftext{thm:product-measure-2026a}{product measure} on the closed unit disk (a Borel subset of the plane for the \reftext{def:product-sigma-algebra-2026a}{product -algebra}), the total mass satisfies by \ref{thm:tonelli-fubini-2026a} applied to .- Define by , with the \reftext{def:exponential-function-real-2026a}{exponential function}; is \reftext{def:continuous-map-at-point-euclidean-2026a}{continuous} (a composition of continuous maps, by \ref{thm:composition-continuous-euclidean-2026a} and claim 3 of \ref{thm:exponential-properties-2026a}), hence \reftext{def:measurable-function-2026a}{measurable} with respect to the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra} by the generator criterion there (preimages of open sets are open). By claim 2 of \ref{thm:gaussian-integral-2026a}, the quantity (the integral of \ref{def:lebesgue-integral-nonnegative-2026a} with respect to \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure} ) is a finite positive real number. The \textbf{standard normal distribution} is the function with the indicator of \ref{def:simple-function-integral-2026a}. By claims 1 and 2 of \ref{thm:gaussian-integral-2026a}, is a probability \reftext{def:measure-measure-space-2026a}{measure} on . Its \reftext{def:distribution-cdf-random-variable-2026a}{cumulative distribution function} is denoted and is continuous at every point (claim 3 of \ref{thm:gaussian-integral-2026a}). A random variable is called \textbf{standard normal} (or \textbf{standard Gaussian}) if its distribution is .
Strong Law of Large Numbers under a Fourth Moment Bound
theoremthm:strong-law-large-numbers-fourth-moment-2026aProbabilityLet be a \reftext{def:independence-events-rvs-2026a}{sequence of independent and identically distributed random variables} on a probability space such that has finite \reftext{def:expectation-variance-2026a}{expectation} (hence so do , , and , since for and every real , and monotonicity applies by \ref{thm:linearity-monotonicity-integral-2026a}). Write and for . Then in the sense of \ref{def:convergence-modes-2026a}. The proof rests on the fourth-moment bound for a constant depending only on the distribution of , together with \ref{lem:markov-chebyshev-2026a} applied to and the first \reftext{lem:borel-cantelli-2026a}{BorelβCantelli lemma}.- Let be a \reftext{def:independence-events-rvs-2026a}{sequence of independent and identically distributed random variables} on a probability space such that and have finite \reftext{def:expectation-variance-2026a}{expectation}, and write . For let Then in the sense of \ref{def:convergence-modes-2026a}. Explicitly, for every and every , which tends to as ; the bound combines \ref{lem:markov-chebyshev-2026a} with the additivity of the variance over independent summands from \ref{lem:expectation-product-independent-2026a}.
Expectation of a Product of Independent Random Variables
lemmalem:expectation-product-independent-2026aProbabilityLet and be \reftext{def:independence-events-rvs-2026a}{independent} \reftext{def:probability-space-random-variable-2026a}{random variables} on a probability space , each with finite \reftext{def:expectation-variance-2026a}{expectation}. Then the product (a random variable, since and sums, differences, and squares of random variables are random variables by Step 0(a) of the proof of \ref{thm:linearity-monotonicity-integral-2026a} and the power argument of \ref{def:expectation-variance-2026a}) has finite expectation, and Consequently, if are independent random variables each having finite expectation and finite second moment, then for , and the \reftext{def:expectation-variance-2026a}{variance} is additive over independent summands: