Delay-line memory

CPU speed grows faster than memory speed

The memory wall problem highlights the growing gap between CPU and memory speeds, which can hinder the overall performance of computing systems. As CPUs become faster, the slower memory speeds can become a bottleneck, limiting the potential for further advancements in processing power and efficiency.

Example

In early computing systems, delay-line memory had capacities of a few thousand bits with recirculation times measured in microseconds. As CPUs evolved, their processing speeds increased significantly, while memory speeds lagged behind, creating a bottleneck in data transfer and processing.

Remember this

Understanding the memory wall problem is crucial for designing efficient computing systems that can fully utilize the advancements in CPU technology without being hindered by slower memory speeds.

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Von Neumann architecture

CPU must fetch both data and instructions from memory

Loop nest optimization

Can speeding up your computer make tasks quicker?

Triton differs from CUDA

Why does a super-fast computer sometimes run slower than a regular one?

Overdrawn at the Memory Bank

Overdrawn at the Memory Bank was shot on videotape due to budget constraints

Flashbulb memory

Flashbulb memories are vivid but not always accurate

CPU cache

L1/L2 cache hierarchy reduces global memory latency

Swipe through 100 ML concepts daily

Open Pocket Polymath