Law of large numbers: X̄_ n → μ as n → ∞ with probability 1
Law of large numbers
Law of large numbers: X̄_ n → μ as n → ∞ with probability 1
The law of large numbers is a fundamental concept in probability theory that assures the convergence of sample means to the true mean with a high degree of certainty. This law is crucial for understanding long-term stability in random events.
The law of large numbers guarantees that as the number of independent and identically distributed random samples increases, the average of these samples will converge to the true mean. This principle is essential for predicting outcomes in various fields, such as finance, insurance, and many others.
It is important to note that the law of large numbers only applies when a large number of observations are considered. Small sample sizes do not provide the same level of certainty, and relying on them can lead to incorrect conclusions.
Example
In a casino, while a single spin of a roulette wheel can result in a loss for the house, the law of large numbers ensures that over a large number of spins, the house will earn a predictable percentage of the total bets placed.
Remember this
Understanding the law of large numbers helps individuals and businesses make informed decisions based on long-term trends rather than short-term fluctuations.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
the optional stopping theorem says about martingales and stopping times
Martingale: E[X_{n+1} | X_1, X_2, ..., X_n] = X_n
Cross-entropy H(p,q) = -Σ p(x) log q(x) measures how well q approximates p
Ever wondered how well we can guess the outcome of a random event?
List of unsolved problems in mathematics
Why do random points in high dimensions seem to be evenly spaced?
Kolmogorov complexity
Kolmogorov complexity is uncomputable
Chebyshev's inequality says: P(|X-μ| ≥ kσ) ≤ 1/k²
Chebyshev's inequality states P(|X-μ| ≥ kσ) ≤ 1/k²
Glossary of probability and statistics
Ever wonder why your average score on quizzes improves with more quizzes?
Swipe through 100 ML concepts daily
Open Pocket Polymath