HBM provides stacked DRAM with much higher bandwidth than DDR
Image: Erik Christensen, CC BY-SA 3.0, via Wikimedia Commons
HBM (High Bandwidth Memory) provides: stacked DRAM with much higher bandwidth than DDR
HBM provides stacked DRAM with much higher bandwidth than DDR
HBM has had an unprecedented demand increase, and in general, DRAM (DDR4, DDR, and flash memory/NAND) price has experienced compounded increases, some exceeding 200%, since early 2025. This is due to the unprecedented demand for HBM.
Example
The NEC SX-Aurora TSUBASA and Fujitsu A64FX CPUs utilize HBM as on-package cache or RAM.
Remember this
Understanding HBM's high bandwidth capabilities and its impact on DRAM prices is crucial for making informed decisions in the tech industry.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
2024–present global memory supply shortage
Global DRAM shortage began in 2024
NVIDIA's H100 has: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
NVIDIA H100 features: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
Delay-line memory
CPU speed grows faster than memory speed
NVIDIA's A100 has: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
NVIDIA's A100 features: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
Von Neumann architecture
CPU must fetch both data and instructions from memory
Memory hierarchy
Memory hierarchy levels: registers → L1 → L2 → L3 → RAM → SSD → HDD (each ~10× slower)
Swipe through 100 ML concepts daily
Open Pocket Polymath