parallel transport does: moves vectors along a curve while preserving their properties

Parallel transport preserves vector properties along curves

Parallel transport allows vectors to move along curves while maintaining their properties, such as direction and magnitude, relative to the manifold's connection. This concept is crucial in differential geometry as it provides a way to compare geometrical data at different points on a manifold.

Example

Imagine a vector at point A on a surface. As you move the vector along a curve to point B, parallel transport ensures that the vector's direction and magnitude remain consistent with the surface's geometry.

Remember this

Understanding parallel transport is fundamental in fields like physics and engineering, where it helps in analyzing and predicting the behavior of systems with curved spaces.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Vanishing gradient problem

Residual connections help by allowing gradient flow through the skip connection

Pre-LN transformers are easier to train

Pre-LN transformers use residual connections, allowing gradients to flow more smoothly during backpropagation

most transformer operations are memory-bound, not compute-bound

Why do computers sometimes get tired?

non-convex loss landscapes are hard: many local minima and saddle points

Why do some hills have more tricky paths than others?

the trace equals the sum of eigenvalues: tr(A) = Σλ_i

How can a vector stay the same after a transformation?

the dot product measures alignment: it equals |a||b|cos(θ)

Why do vectors sometimes "agree" with each other?

Swipe through 100 ML concepts daily

Open Pocket Polymath