Robust statistics

How can we estimate the center and spread of data even when it's messy?

Imagine you're trying to find the average height and variation in height of students in a school, but some students have unusual heights that don't fit the pattern.

We want to find a way to look at the heights that isn't thrown off by those few students who are much taller or shorter than everyone else. The technical term for this is "sufficient statistics."

Example

Let's say most students are 150 cm tall with a variation of 10 cm, but there's one student who's 190 cm tall. We still want to find the average height and variation that represents the typical student.

Remember this

Sufficient statistics help us estimate the true characteristics of a dataset without being misled by unusual values.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

to standardize: when you need zero mean and unit variance for gradient-based optimization

Why do we need to make data uniform before training a model?

the multivariate Gaussian is parameterized by: mean vector μ and covariance matrix Σ

Ever wondered how weather patterns or stock market trends can be predicted with surprising accuracy?

Maximum likelihood estimation

How do we find the best-fitting parameters for a model?

Algorithms for calculating variance

Ever wondered how scientists measure the spread of data points?

Bootstrapping (statistics)

Small sample sizes can mislead standard error estimates

Exponential distribution

Why do we sometimes need to predict rare events?

Swipe through more Machine Learning concepts

Open Pocket Polymath