Ever wondered how weather patterns or stock market trends can be predicted with surprising accuracy?
Image: NOAA Photo Library, Public domain, via Wikimedia Commons
Ever wondered how weather patterns or stock market trends can be predicted with surprising accuracy?
Imagine you're planning a picnic and want to know the best day based on weather forecasts. You have data on temperature, humidity, and wind speed for the past week, but it's all mixed up.
Think of the weather data as a tangled web. The multivariate Gaussian helps us untangle it by showing us how these factors usually behave together, pointing us to the most likely sunny day for your picnic.
Example
If temperatures (T), humidity (H), and wind speed (W) from last week show a pattern where sunny days often have moderate temperatures and low wind speeds, the multivariate Gaussian can predict a sunny day when T is mild and W is calm.
Remember this
The multivariate Gaussian, parameterized by mean vector μ and covariance matrix Σ, helps us predict complex scenarios like weather patterns by understanding how different variables usually interact.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Bias vs variance: high bias = underfitting, high variance = overfitting
Can a perfect fit to past data predict future events?
Principal component analysis
Eigenvectors point along maximum variance
Adam optimizer weight update with m and v terms
Ever wondered how we can predict complex financial markets with high accuracy?
Markov chain Monte Carlo
MCMC samples from complex posterior distributions
Expectation–maximization algorithm
EM algorithm iteratively maximizes likelihood estimates with latent variables
Fisher information
Fisher information measures information about unknown parameters
Swipe through 100 ML concepts daily
Open Pocket Polymath