Ever wondered how your computer speeds up?
Image: Erik Christensen, CC BY-SA 3.0, via Wikimedia Commons
HBM (High Bandwidth Memory) provides: stacked DRAM with much higher bandwidth than DDR
Ever wondered how your computer speeds up?
Imagine you're streaming your favorite show, but the video keeps buffering. Frustrating, right?
High Bandwidth Memory (HBM) is like upgrading from a narrow road to a multi-lane highway for data to travel on your computer, making everything faster and smoother.
Example
Instead of 2 lanes (DDR), HBM opens up to 4 lanes (HBM), reducing traffic jams in data transfer.
Remember this
HBM's multi-lane data highway significantly boosts your computer's performance.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
2024–present global memory supply shortage
Global DRAM shortage began in 2024
NVIDIA's H100 has: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
NVIDIA H100 features: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
Delay-line memory
CPU speed grows faster than memory speed
NVIDIA's A100 has: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
NVIDIA's A100 features: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
Von Neumann architecture
CPU must fetch both data and instructions from memory
Dynamic random-access memory
DRAM requires periodic refreshing to maintain data integrity
Swipe through 100 ML concepts daily
Open Pocket Polymath