GPTQ vs AWQ: GPTQ uses Hessian-based quantization, AWQ preserves activation-important weights

AWQ does differently

AWQ selectively retains weights crucial for model performance, unlike traditional quantization

GPTQ quantization does

Post-training quantization using second-order information for model compression

PCA vs t-SNE: PCA preserves global variance linearly, t-SNE preserves local structure nonlinearly

How can we teach computers to understand what we like?

grouped query attention (GQA) does

GQA shares KV heads across multiple Q heads for efficient parameter usage

batch size affects generalization: larger batches find sharper minima

Larger batch sizes lead to sharper minima, enhancing generalization by providing more accurate gradient estimates

Boosting (machine learning)

Boosting reduces bias in ML models