BLEU vs ROUGE: BLEU measures precision of n-grams, ROUGE measures recall

Evaluation of machine translation

Can we truly measure how good a machine translation is?

BLEU

Ever wondered how computers know if a translation makes sense?

MAP (mean average precision) measures: area under the precision-recall curve averaged across queries

Ever wondered how search engines rank your queries?

word error rate (WER) measures: edit distance between predicted and reference transcriptions

Ever wondered how machines understand speech as we do?

the condition number κ(A) measures: sensitivity of Ax=b to perturbations

How small changes affect big outcomes

L1 vs L2 regularization: L1 gives sparsity (feature selection), L2 gives small weights

L1 regularization: L1 = L2 + sparsity; L2 regularization: L2 = L1 + small weights