Theorems
A growing collection of mathematical statements with user-submitted proofs.
- Let and be \reftext{def:probability-space-random-variable-2026a}{random variables} on a common probability space, with the modes of convergence of \ref{def:convergence-modes-2026a}. Then: if almost surely, then in probability; if in probability, then in distribution; if and in distribution (with regarded as the constant random variable, whose cumulative distribution function is for and for ), then in probability.
Almost Sure Convergence, Convergence in Probability, and Convergence in Distribution
definitiondef:convergence-modes-2026aProbabilityLet and be \reftext{def:probability-space-random-variable-2026a}{random variables} on a common probability space (for convergence in distribution, a common space is not required). converges to \textbf{almost surely} if with pointwise convergence in the sense of \ref{def:limit-sequence-real-c54-2026a}; the set in question is an event, since it equals over , and is a random variable by Step 0(a) of the proof of \ref{thm:linearity-monotonicity-integral-2026a}. converges to \textbf{in probability} if for every , converges to \textbf{in distribution} if for every at which the \reftext{def:distribution-cdf-random-variable-2026a}{cumulative distribution function} is \reftext{def:continuous-at-point-c54-2026b}{continuous}.- Let be a \reftext{def:probability-space-random-variable-2026a}{probability space} and let be a \reftext{def:sequence-in-set-2026a}{sequence} of events. Define an event by the closure properties of \ref{def:sigma-algebra-measurable-space-2026a}; it consists of exactly those that belong to for infinitely many . \textbf{First BorelβCantelli lemma.} If (sum as in \ref{def:measure-measure-space-2026a}), then \textbf{Second BorelβCantelli lemma.} If the events are \reftext{def:independence-events-rvs-2026a}{independent} and , then
- Let be a \reftext{def:probability-space-random-variable-2026a}{random variable} on a probability space and let . \textbf{Markov's inequality.} If pointwise, then with the \reftext{def:expectation-variance-2026a}{expectation} in (the inequality being trivial when the right side is infinite). \textbf{Chebyshev's inequality.} If and have finite expectation, then with the \reftext{def:expectation-variance-2026a}{variance} as defined there.
Existence of Independent and Identically Distributed Sequences
theoremthm:existence-iid-sequence-2026aProbabilityLet be a probability \reftext{def:measure-measure-space-2026a}{measure} on , with the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. Then there exist a \reftext{def:probability-space-random-variable-2026a}{probability space} and a \reftext{def:sequence-in-set-2026a}{sequence} of random variables on it that is \reftext{def:independence-events-rvs-2026a}{independent and identically distributed} with common \reftext{def:distribution-cdf-random-variable-2026a}{distribution} . One may take , , and the restriction to of \reftext{thm:lebesgue-measure-real-line-2026a}{Lebesgue measure}, which is a probability measure since the interval has Lebesgue measure .Independence of Events and of Random Variables
definitiondef:independence-events-rvs-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{probability space}. Events are \textbf{independent} if for every nonempty subset , with the \reftext{def:finite-product-notation-2026a}{finite product notation}. A \reftext{def:sequence-in-set-2026a}{sequence} (or arbitrary family) of events is independent if every finite subfamily is independent. Random variables on are \textbf{independent} if for all \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel sets} the events are independent. A sequence (or family) of random variables is independent if every finite subfamily is independent. A sequence of random variables is \textbf{independent and identically distributed} (\textbf{iid}) if it is independent and all have the same \reftext{def:distribution-cdf-random-variable-2026a}{distribution}.- Let be a \reftext{def:probability-space-random-variable-2026a}{random variable} on a probability space . If pointwise, the \textbf{expectation} of is , the integral of \ref{def:lebesgue-integral-nonnegative-2026a}. If is \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to , then and is said to have \textbf{finite expectation}. For \reftext{def:natural-numbers-2026a}{}, the power is a random variable: for , equals for odd and for even (roots exist by \ref{thm:nth-root-rudin-b}); for , it equals for even and for odd ; in all cases this is an event by the criterion of \ref{def:measurable-function-2026a}. If has finite expectation, is the \textbf{th moment} of . If and have finite expectation, the \textbf{variance} of is which is finite and equals by \ref{thm:linearity-monotonicity-integral-2026a}.
Distribution and Cumulative Distribution Function of a Random Variable
definitiondef:distribution-cdf-random-variable-2026aProbabilityLet be a \reftext{def:probability-space-random-variable-2026a}{random variable} on a probability space . The \textbf{distribution} (or \textbf{law}) of is the function on the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}. It is a probability \reftext{def:measure-measure-space-2026a}{measure} on : , , and countable additivity holds because preimages of pairwise disjoint sets are pairwise disjoint and taking preimages commutes with countable unions. The \textbf{cumulative distribution function} of is Two random variables (possibly on different probability spaces) are \textbf{identically distributed} if their distributions are equal.Probability Space, Event, and Random Variable
definitiondef:probability-space-random-variable-2026aProbabilityA \textbf{probability space} is a \reftext{def:measure-measure-space-2026a}{measure space} whose measure is a probability measure in the sense of that definition, that is, . Members of are called \textbf{events}, and is the \textbf{probability} of the event . A \textbf{random variable} on is a \reftext{def:measurable-function-2026a}{measurable} function (with respect to and the \reftext{def:borel-sigma-algebra-real-line-2026a}{Borel -algebra}). For a Borel set one writes for the event , and analogously , , , and so on, for the preimages of the corresponding Borel sets; probabilities of such events are written , , etc.- By claim 5 of \ref{thm:exponential-properties-2026a}, the \reftext{def:exponential-function-real-2026a}{exponential function} is a \reftext{def:bijection-sets-2026a}{bijection} from onto the \reftext{def:interval-real-line-c54-2026c}{interval} . The \textbf{natural logarithm} is its inverse function By claim 3 of \ref{thm:exponential-properties-2026a} and the \reftext{thm:smooth-local-inverse-euclidean-2026b}{smooth inverse function theorem} (with ; the Jacobian determinant of at is ), is smooth on with derivative , and by claim 1 it satisfies for all .
- Let be the \reftext{def:exponential-function-real-2026a}{exponential function}. Then: and for all ; for every , and ; is differentiable at every point with , where the \reftext{def:derivative-interior-point-c54-2026b}{derivative} is the one-dimensional one; consequently is a \reftext{def:smooth-map-euclidean-open-set-2026a}{smooth map} on ; is strictly increasing, for , and as in the sense that for every there is with for all ; is a \reftext{def:bijection-sets-2026a}{bijection} from onto .
- The \textbf{exponential function} is defined by with \reftext{def:factorial-natural-number-2026a}{factorials} and the convention . The series converges for every \reftext{def:real-numbers-c54-2026c}{}: for indices the terms are dominated in absolute value by a geometric sequence with ratio , so the partial sums form a \reftext{def:cauchy-sequence-real-c54-2026a}{Cauchy sequence} and converge by \ref{thm:cauchy-sequence-converges-real-c54-2026a}; the same comparison shows the series of absolute values converges, so the convergence is absolute. One writes .
- Let and be -finite \reftext{def:measure-measure-space-2026a}{measure spaces} and let be the \reftext{thm:product-measure-2026a}{product measure} on the \reftext{def:product-sigma-algebra-2026a}{product -algebra}. \textbf{Sections.} For measurable with respect to (in the sense of \ref{def:lebesgue-integral-nonnegative-2026a}) and , the section , , is measurable with respect to ; symmetrically for sections in the other variable. \textbf{Tonelli.} For every -measurable , the function is -measurable, the symmetric function is -measurable, and all integrals being those of \ref{def:lebesgue-integral-nonnegative-2026a} with values in . \textbf{Fubini.} If is \reftext{def:lebesgue-integral-integrable-2026a}{integrable} with respect to , then for every outside a set with the section is integrable with respect to ; the function equal to off and to on is integrable with respect to ; and the displayed identity of iterated integrals holds for , with the symmetric statement in the other order.
- Let and be \reftext{def:measure-measure-space-2026a}{measure spaces}, and suppose that both and are -finite. Then there exists exactly one measure on the \reftext{def:product-sigma-algebra-2026a}{product -algebra} such that for every and , with the product in understood with the conventions of \ref{def:measure-measure-space-2026a}. The measure is itself -finite and is called the \textbf{product measure}. Uniqueness rests on \ref{lem:dynkin-pi-lambda-2026a} applied to the -system of measurable rectangles.
- Let be a set. A \reftext{def:family-subfamily-subsets-set-2026a}{family} of subsets of is a \textbf{-system} if it is nonempty and closed under finite intersections: implies . A family of subsets of is a \textbf{-system} if: (1) ; (2) if and , then the \reftext{def:complement-subset-relative-set-2026a}{relative complement} ; (3) for every nondecreasing \reftext{def:sequence-in-set-2026a}{sequence} in (that is, for all ), . \textbf{Theorem.} If is a -system, is a -system, and , then the \reftext{def:generated-sigma-algebra-2026a}{generated -algebra} satisfies
- Let and be \reftext{def:sigma-algebra-measurable-space-2026a}{measurable spaces}. A \textbf{measurable rectangle} is a subset of the \reftext{def:cartesian-product-sets-2026a}{Cartesian product} of the form with and . The \textbf{product -algebra} on is the \reftext{def:generated-sigma-algebra-2026a}{-algebra generated} by the family of all measurable rectangles.
Linearity and Monotonicity of the Lebesgue Integral
theoremthm:linearity-monotonicity-integral-2026aAnalysisProbabilityLet be a \reftext{def:measure-measure-space-2026a}{measure space}. (Nonnegative case.) Let be \reftext{def:lebesgue-integral-nonnegative-2026a}{measurable} and let . Then and are measurable, and with the conventions of \ref{def:measure-measure-space-2026a}; and if for all then . (Integrable case.) Let be \reftext{def:lebesgue-integral-integrable-2026a}{integrable} and let . Then is integrable and Moreover , and if for all then .- Let be a \reftext{def:measure-measure-space-2026a}{measure space}, and let be a \reftext{def:sequence-in-set-2026a}{sequence} of \reftext{def:measurable-function-2026a}{measurable} functions such that for every the sequence \reftext{def:limit-sequence-real-c54-2026a}{converges} to , for a function . Suppose there is an \reftext{def:lebesgue-integral-integrable-2026a}{integrable} function with for every and every . Then: is measurable and integrable; as ; consequently .
- Let be a \reftext{def:measure-measure-space-2026a}{measure space} and let be a \reftext{def:sequence-in-set-2026a}{sequence} of \reftext{def:lebesgue-integral-nonnegative-2026a}{measurable} functions . For define where the \reftext{def:lower-bound-infimum-c54-2026a}{infimum} and \reftext{def:upper-bound-supremum-c54-2026b}{supremum} are taken in with the conventions of \ref{def:measure-measure-space-2026a}, and define for a sequence in in the same way. Then is measurable, and
- Let be a \reftext{def:measure-measure-space-2026a}{measure space} and let be a \reftext{def:sequence-in-set-2026a}{sequence} of \reftext{def:lebesgue-integral-nonnegative-2026a}{measurable} functions such that for every and every . Define pointwise by , the \reftext{def:upper-bound-supremum-c54-2026b}{least upper bound} in (equal to when the values are unbounded). Then is measurable, and the integrals being those of \ref{def:lebesgue-integral-nonnegative-2026a}; equivalently, the nondecreasing sequence of integrals converges to in .