Can you imagine a crowd spreading out evenly in a room?
Diffusion
Can you imagine a crowd spreading out evenly in a room?
Imagine you're at a concert, and the crowd starts to thin out as people leave. The goal is to spread the crowd evenly across the venue.
Think of the crowd as a substance diffusing from a high concentration (the stage) to a lower concentration (the exits). The crowd naturally moves to fill the space evenly.
Example
If there are 100 people at the stage and 400 people in the room, they will move to fill the space evenly, reducing the crowd density.
Remember this
The crowd spreads out evenly to reduce concentration differences, similar to how substances diffuse to balance concentrations.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
Stable Diffusion
Stable Diffusion generates images from text descriptions
the reverse process learns: p_θ(x_{t-1}|x_t)
Can we trace back the roots of life?
Diffusion model
q(x_t|x_{t-1}) adds Gaussian noise at each step
score matching does: learns the gradient of the log-density without normalizing
Ever wonder how we can compare apples and oranges fairly in studies?
Langevin dynamics does: adds noise to gradient descent to sample from a distribution
How can we simulate randomness in physics?
the Dirichlet distribution does: distribution over probability simplices
How do we predict the likelihood of various outcomes in uncertain situations?
Swipe through 100 ML concepts daily
Open Pocket Polymath