Maximum a posteriori estimation

Maximum a posteriori (MAP) estimate maximizes the posterior density

MAP estimation in Bayesian statistics aims to find the most probable value of an unknown quantity by maximizing the posterior density. This approach combines observed data with prior beliefs about the quantity being estimated. The posterior density is derived from Bayes' theorem, which updates the probability estimate as more evidence becomes available.

Example

Suppose we want to estimate the mean of a normally distributed population. We have prior knowledge that the mean is around 50 with a standard deviation of 10. After observing new data, we update our estimate using MAP estimation, resulting in a new mean that reflects both the prior knowledge and the new evidence.

Remember this

Understanding MAP estimation is crucial for integrating prior knowledge with observed data, leading to more accurate and informed estimates in various fields.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Expectation–maximization algorithm

EM algorithm iteratively maximizes likelihood estimates with latent variables

Markov chain Monte Carlo

MCMC samples from complex posterior distributions

Top-k vs top-p sampling: top-k fixes candidate count, top-p fixes cumulative probability mass

Top-k sampling fixes candidate count; top-p sampling fixes cumulative probability mass

Minimum-variance unbiased estimator

MVUE achieves lower variance than any other unbiased estimator

importance sampling does: reweights samples from proposal to estimate target expectation

Importance sampling estimates target expectations using samples from a different distribution

Sufficient statistic

Sufficiency captures all information about θ in the data

Swipe through 100 ML concepts daily

Open Pocket Polymath