Chebyshev's inequality states P(|X-μ| ≥ kσ) ≤ 1/k²
Image: Pavel Kazachkov from Moscow, Russia, CC BY 2.0, via Wikimedia Commons
Chebyshev's inequality states P(|X-μ| ≥ kσ) ≤ 1/k²
Chebyshev's inequality provides an upper bound on the probability of deviation from the mean for any random variable with finite variance.
Example
If a random variable X has a mean μ of 50 and a standard deviation σ of 10, Chebyshev's inequality tells us that the probability of X deviating from its mean by more than 20 units is at most 1/4 or 25%.
Remember this
Chebyshev's inequality is useful for proving the weak law of large numbers and can be applied to any probability distribution with defined mean and variance.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Markov's inequality
Ever wondered how math can predict unlikely events?
the union bound says: P(A∪B) ≤ P(A) + P(B)
The union bound states: P(A∪B) ≤ P(A) + P(B)
KL divergence is always ≥ 0 and equals 0 only when P = Q exactly
Why can't we just compare two things directly?
Law of large numbers
Law of large numbers: X̄_ n → μ as n → ∞ with probability 1
Norm (mathematics)
L∞ norm equals max absolute value
Chebyshev's inequality
Chebyshev's inequality limits the probability of deviation from the mean
Swipe through 100 ML concepts daily
Open Pocket Polymath