Warp divergence causes threads to execute non-uniformly, leading to idle cycles and reduced throughput
Image: Robert M. Lavinsky, CC BY-SA 3.0, via Wikimedia Commons
warp divergence kills performance
Warp divergence causes threads to execute non-uniformly, leading to idle cycles and reduced throughput
Related concepts
History of general-purpose CPUs
Why can't computers talk to each other as fast as we want?
Loop nest optimization
Can speeding up your computer make tasks quicker?
occupancy means in GPU programming
Occupancy = Active Warps / Max Warps
Triton differs from CUDA
Why does a super-fast computer sometimes run slower than a regular one?
Flashbulb memory
Flashbulb memories are vivid but not always accurate
instruction-level parallelism (ILP) achieves: multiple operations per clock cycle
Ever wondered how computers can do so many tasks at once?
Swipe through 100 ML concepts daily
Open Pocket Polymath