wavelets provide over Fourier: both time and frequency localization

Wavelet transform

Ever wondered why some sounds change pitch while others stay constant?

Short-time Fourier transform

STFT divides a signal into shorter segments for analysis

Glossary of engineering: A–L

Can you hear colors?

sinusoidal position encoding works: each dimension has a different frequency

Sinusoidal position encoding assigns unique frequencies to each dimension, enabling the model to distinguish positions effectively

L1 vs L2 regularization: L1 gives sparsity (feature selection), L2 gives small weights

L1 regularization: L1 = L2 + sparsity; L2 regularization: L2 = L1 + small weights

Singular value decomposition

Ever wondered how to compress images without losing quality?