GRU vs LSTM: GRU uses 2 gates and is faster, LSTM uses 3 gates and captures longer dependencies

BFS vs DFS: BFS finds shortest path in unweighted graphs, DFS uses less memory

BFS finds shortest path in unweighted graphs; DFS uses less memory

Triton differs from CUDA

Why does a super-fast computer sometimes run slower than a regular one?

CPU cache

L1/L2 cache hierarchy reduces global memory latency

torch.compile does in PyTorch 2.0: traces and optimizes the computation graph

Ever wondered how computers speed up learning?

High dynamic range

Does typing affect computer memory?

Greedy vs dynamic programming: greedy makes locally optimal choices, DP considers all subproblems

Greedy: locally optimal choices; DP: considers all subproblems