Can you imagine a crowd spreading out evenly in a room?
Diffusion
Can you imagine a crowd spreading out evenly in a room?
Imagine you're at a concert, and the crowd starts to thin out as people leave. The goal is to spread the crowd evenly across the venue.
Think of the crowd as a substance diffusing from a high concentration (the stage) to a lower concentration (the exits). The crowd naturally moves to fill the space evenly.
Example
If there are 100 people at the stage and 400 people in the room, they will move to fill the space evenly, reducing the crowd density.
Remember this
The crowd spreads out evenly to reduce concentration differences, similar to how substances diffuse to balance concentrations.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
Stable Diffusion
Stable Diffusion generates images from text descriptions
Diffusion model
q(x_t|x_{t-1}) adds Gaussian noise at each step
the Dirichlet distribution does: distribution over probability simplices
How do we predict the likelihood of various outcomes in uncertain situations?
rejection sampling does: samples from target by accepting/rejecting proposals
Rejection sampling generates observations from a target distribution
Langevin dynamics does: adds noise to gradient descent to sample from a distribution
Langevin dynamics uses stochastic differential equations
Chebyshev's inequality
Chebyshev's inequality limits the probability of deviation from the mean
Swipe through 100 ML concepts daily
Open Pocket Polymath