How do tiny differences grow over time in chaotic systems?
Image: Andrew Magill, CC BY 2.0, via Wikimedia Commons
How do tiny differences grow over time in chaotic systems?
Imagine you're planting seeds in a garden. If two seeds start just a millimeter apart, under certain conditions, they might end up miles apart after a while.
In our garden, the seeds' final distance apart shows how much they spread out. This spreading rate tells us how chaotic the garden's growth is.
Example
If seeds start 1mm apart and after a month they're 10km apart, the garden's growth is extremely chaotic.
Remember this
The Lyapunov exponent measures how quickly tiny differences grow, indicating chaos.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Chaos theory
Butterfly effect demonstrates sensitive dependence on initial conditions
Markov chain
Why does flipping a coin repeatedly get predictable?
Langevin dynamics does: adds noise to gradient descent to sample from a distribution
How can we simulate randomness in physics?
Entropy H = -Σ p(x) log₂ p(x) measures average surprise in bits
How do we measure uncertainty in everyday decisions?
Rényi entropy
How do we measure the unpredictability of an event?
Convergence of random variables
Ever wonder why flipping a coin repeatedly doesn't always predict the next flip?
Swipe through more Machine Learning concepts
Open Pocket Polymath