tl.where(mask, x, 0) does: conditional select to handle boundary conditions

KL divergence is always ≥ 0 and equals 0 only when P = Q exactly

Why can't we just compare two things directly?

classifier-free guidance does: interpolates between conditional and unconditional generation

"Classifies samples as either conditioned or unconditioned, guiding generation towards desired outcomes."

Bloom filter

Bloom filters check if an element is possibly in a set with high probability, avoiding false negatives

tl.program_id(0) returns: the index of the current parallel block

tl.program_id(0) returns: the index of the current parallel block

the condition number κ(A) measures: sensitivity of Ax=b to perturbations

Condition number κ(A) measures sensitivity of Ax=b to perturbations

sinusoidal position encoding works: each dimension has a different frequency

Sinusoidal position encoding assigns unique frequencies to each dimension, enabling the model to distinguish positions effectively