Maximum a posteriori estimation

Maximum a posteriori (MAP) estimate maximizes the posterior density

MAP estimation in Bayesian statistics aims to find the most probable value of an unknown quantity by maximizing the posterior density. This approach combines observed data with prior beliefs about the quantity being estimated. The posterior density is derived from Bayes' theorem, which updates the probability estimate as more evidence becomes available.

Example

Suppose we want to estimate the mean of a normally distributed population. We have prior knowledge that the mean is around 50 with a standard deviation of 10. After observing new data, we update our estimate using MAP estimation, resulting in a new mean that reflects both the prior knowledge and the new evidence.

Remember this

Understanding MAP estimation is crucial for integrating prior knowledge with observed data, leading to more accurate and informed estimates in various fields.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Maximum likelihood estimation

How do we find the best-fitting parameters for a model?

Expectation–maximization algorithm

EM algorithm iteratively maximizes likelihood estimates with latent variables

Markov chain Monte Carlo

MCMC samples from complex posterior distributions

Akaike information criterion

How do we choose the best model for our data?

Exponential distribution

Why do we sometimes need to predict rare events?

Prior probability

Why do we sometimes need to start with an educated guess before diving into new data?

Swipe through more Machine Learning concepts

Open Pocket Polymath