expected calibration error (ECE) measures: gap between confidence and accuracy

calibration means: a model predicting 80% should be correct 80% of the time

How can we trust a coin flip to predict the weather?

Brier score

Brier score measures mean squared error of probability predictions

Binomial proportion confidence interval

Binomial proportion confidence interval estimates success probability

word error rate (WER) measures: edit distance between predicted and reference transcriptions

Ever wondered how machines understand speech as we do?

to normalize features: when features have different scales and you use distance-based methods

Why do some things need to be adjusted to compare fairly?

the condition number κ(A) measures: sensitivity of Ax=b to perturbations

How small changes affect big outcomes