expected calibration error (ECE) measures: gap between confidence and accuracy

calibration means: a model predicting 80% should be correct 80% of the time

How can we trust a coin flip to predict the weather?

Brier score

Brier score measures mean squared error of probability predictions

F-score

Why is one metric not enough to judge a binary classification model's performance?

Errors and residuals

Ever wonder how accurate predictions are measured?

Binomial proportion confidence interval

Binomial proportion confidence interval estimates success probability

word error rate (WER) measures: edit distance between predicted and reference transcriptions

Ever wondered how machines understand speech as we do?