AtomicAdd adds values to shared or global memory atomically

List of gay characters in animation

AtomicAdd adds values to shared or global memory atomically

Text adapted from Wikipedia, licensed under CC BY-SA 4.0.

Related concepts

Thread block (CUDA programming)

Thread blocks can contain up to 1024 threads as of March 2010

__syncthreads() does in CUDA: synchronizes all threads within a block

__syncthreads() synchronizes all threads within a block

Dynamic random-access memory

DRAM requires periodic refreshing to maintain data integrity

CUDA

CUDA enables parallel computation on GPUs

cooperative groups enable in CUDA: flexible thread synchronization patterns

Cooperative groups enable flexible thread synchronization patterns in CUDA

CPU cache

L1/L2 cache hierarchy reduces global memory latency

Swipe through 100 ML concepts daily