batch size affects generalization: larger batches find sharper minima

gradient accumulation simulates larger batch sizes without more memory

Can you train a machine like you do with a computer?

LAMB optimizer does: layer-wise adaptive learning rates for large batch training

LAMB optimizer adjusts learning rates layer-wise for large batch training

data augmentation does for generalization: artificially expands training set

How can you teach a computer to see better?

Proximal gradient methods for learning

Why can't we always find the best path in a maze?

to standardize: when you need zero mean and unit variance for gradient-based optimization

Why do we need to make data uniform before training a model?

Convolutional neural network

Can a neural network learn too well?