Moment generating function

Moment generating function uniquely determines a distribution

The moment generating function (MGF) uniquely determines a probability distribution because it encodes all the moments of the distribution. By taking derivatives of the MGF at zero, we can find the moments of the distribution.

Example

For a random variable X with MGF M(t) = exp(tX), the first moment (mean) is M'(0) = X, the second moment is M''(0) = X^2 + X, and so on.

Remember this

Understanding the MGF's role in determining distributions is crucial for deriving properties and moments of the distribution analytically.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Characteristic function (probability theory)

Characteristic function φ(t) = E[e^(itX)] is the Fourier transform of the PDF

Expected value

Expected value formula: E[X] = Σ [x * P(x)]

Langevin dynamics does: adds noise to gradient descent to sample from a distribution

Langevin dynamics uses stochastic differential equations

Softmax function

Softmax converts real numbers into a probability distribution

temperature T in softmax(x/T) controls entropy: T→0 is argmax, T→∞ is uniform

How does adjusting T affect the certainty of choices?

Poisson distribution

Poisson distribution formula: P(k; λ) = (λ^k * e^(-λ)) / k!

Swipe through 100 ML concepts daily

Open Pocket Polymath