Gaussian function

Ever wondered why some things seem more unpredictable than others?

Imagine you're trying to listen to music through a noisy radio. Sometimes the static is barely noticeable, but other times it's overwhelming and makes it hard to hear anything at all.

The "static" in your radio is like Gaussian noise. The amount of static (or noise) you experience depends on a value called σ². A higher σ² means more noise, which makes the music harder to understand, just like more unpredictable outcomes in a Gaussian distribution.

Example

If the σ² value is low, you might hear a faint buzz, but with a high σ², the buzz becomes loud and chaotic, drowning out the music.

Remember this

Higher σ² in Gaussian noise means more unpredictability and interference in what you're trying to hear.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Langevin dynamics does: adds noise to gradient descent to sample from a distribution

How can we simulate randomness in physics?

Entropy H = -Σ p(x) log₂ p(x) measures average surprise in bits

How do we measure uncertainty in everyday decisions?

Bias vs variance: high bias = underfitting, high variance = overfitting

Can a perfect fit to past data predict future events?

temperature T in softmax(x/T) controls entropy: T→0 is argmax, T→∞ is uniform

How does adjusting T affect the certainty of choices?

Minimum-variance unbiased estimator

MVUE achieves lower variance than any other unbiased estimator

Rényi entropy

How do we measure the unpredictability of an event?

Swipe through more Machine Learning concepts

Open Pocket Polymath