batch size affects generalization: larger batches find sharper minima

gradient accumulation simulates larger batch sizes without more memory

Can you train a machine like you do with a computer?

LAMB optimizer does: layer-wise adaptive learning rates for large batch training

LAMB optimizer adjusts learning rates layer-wise for large batch training

data augmentation does for generalization: artificially expands training set

How can you teach a computer to see better?

Overfitting

Why does fitting too much detail to data ruin predictions?

Fine-tuning (deep learning)

Why can we make a big change with just a tiny tweak?

Cellular neural network

Why do image processing tasks take longer as images get bigger?