How does air flow change volume?
How does air flow change volume?
Imagine you're heating a balloon filled with air. As the air inside warms up, it expands and pushes outward. How does this relate to the concept of divergence in vector fields?
Think of divergence as a measure of how much a vector field like air flow is spreading out or converging at a point. It's like seeing how much the air inside the balloon bulges at different spots when it gets warmer.
Example
If the air expands uniformly in all directions, the divergence at any point inside the balloon would be positive, indicating a spreading out flow.
Remember this
Divergence quantifies the rate at which a vector field spreads out or converges at a point.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
the momentum term does: v_t = βv_{t-1} + ∇L, accumulates gradient direction
Momentum term accelerates convergence in the gradient direction
the volume of a unit ball approaches zero as dimensions increase
How does a coastline's length change with different measuring sticks?
Surface tension
High surface tension in water
KL divergence is always ≥ 0 and equals 0 only when P = Q exactly
Why can't we just compare two things directly?
the trace equals the sum of eigenvalues: tr(A) = Σλ_i
How can a vector stay the same after a transformation?
the Lp norm ball shape changes as p goes from 1 to 2 to infinity
How does the shape of a ball change as we measure distance differently?
Swipe through 100 ML concepts daily
Open Pocket Polymath