Ever wonder how likely it is to deviate from the average?
Image: Pavel Kazachkov from Moscow, Russia, CC BY 2.0, via Wikimedia Commons
Ever wonder how likely it is to deviate from the average?
Imagine you're at a carnival, and there's a game where you roll a die. The prize is awarded if you roll a number more than 2 standard deviations away from the average roll.
Chebyshev's inequality tells us that even without knowing the exact distribution of the rolls, we can say there's a certain chance of winning the prize if we roll a number that's unusually high or low compared to the average.
Example
If the average roll is 3.5 and the standard deviation is 1, rolling a 7 or lower is an unusual outcome.
Remember this
Chebyshev's inequality helps us understand the likelihood of rare events happening in random situations.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Markov's inequality
Ever wondered how math can predict unlikely events?
Hidden Markov model
Ever wondered how you can predict outcomes without seeing all the details?
Chebyshev's inequality
Chebyshev's inequality limits the probability of deviation from the mean
KL divergence is always ≥ 0 and equals 0 only when P = Q exactly
Why can't we just compare two things directly?
Hoeffding's inequality
Hoeffding's inequality bounds tail probability for sums of bounded random variables
the L1 norm is not differentiable at zero
Absolute value's kink makes it non-differentiable at zero
Swipe through 100 ML concepts daily
Open Pocket Polymath