a CDN does: caches content at edge locations close to users

Ever wondered why YouTube videos load instantly even in remote areas?

Imagine you're in a remote village with slow internet, trying to watch a YouTube video.

A CDN stores popular videos closer to you, so your video loads faster even with a weak connection. The punchline is: CDN caches content at edge locations close to users.

Example

You watch a video in a remote village, and it loads instantly because it's stored nearby, not on the slow village server.

Remember this

A CDN speeds up content delivery by storing it closer to users.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

paged attention (vLLM) improves serving throughput

Paged attention (vLLM) improves serving throughput by reducing latency through non-contiguous KV-cache pages, enabling faster data retrieval

Triton auto-tunes BLOCK_SIZE: different sizes optimize for different hardware

Rate-distortion optimization balances video quality and file size

GQA reduces KV-cache memory by the group factor

Ever wondered how websites stay fresh in search results?

Pre-LN

Why is normalizing data like tuning instruments before a concert?

Load balancing (computing)

Load balancing distributes tasks efficiently across resources

Overdrawn at the Memory Bank

Overdrawn at the Memory Bank was shot on videotape due to budget constraints

Swipe through 100 ML concepts daily

Open Pocket Polymath