GRU: 2 gates, faster; LSTM: 3 gates, longer dependencies
Image: Marc Mongenet, CC BY-SA 4.0, via Wikimedia Commons
GRU: 2 gates, faster; LSTM: 3 gates, longer dependencies
BFS vs DFS: BFS finds shortest path in unweighted graphs, DFS uses less memory
BFS finds shortest path in unweighted graphs; DFS uses less memory
Triton differs from CUDA
Why does a super-fast computer sometimes run slower than a regular one?
CPU cache
L1/L2 cache hierarchy reduces global memory latency
LSM trees optimize: write-heavy workloads by buffering writes in memory
LSM trees buffer writes in memory for write-heavy workloads
Greedy vs dynamic programming: greedy makes locally optimal choices, DP considers all subproblems
Greedy: locally optimal choices; DP: considers all subproblems
tl.load and tl.store do in Triton: read/write tensors from/to GPU global memory
`tl.load` reads tensors from GPU memory; `tl.store` writes tensors to GPU memory
Swipe through 100 ML concepts daily
Open Pocket Polymath