Matthews correlation coefficient (MCC) measures balanced metric even with class imbalance
Image: NormanEinstein, CC BY-SA 3.0, via Wikimedia Commons
Matthews correlation coefficient (MCC) measures balanced metric even with class imbalance
The Matthews correlation coefficient (MCC) is a balanced metric that accounts for true and false positives and negatives, making it effective even when classes are imbalanced.
MCC considers all four combinations of the predicted and actual binary classifications: true positives, true negatives, false positives, and false negatives. This comprehensive approach ensures that the performance metric reflects the actual effectiveness of a binary classification model.
Unlike other metrics that may favor the majority class, MCC provides a balanced view of model performance across both classes. This makes it particularly useful for evaluating models in scenarios where class imbalance is present.
Example
In a binary classification problem with 100 positive cases and 900 negative cases, a model with an MCC of 0.7 indicates good balanced performance across both classes, regardless of the imbalance.
Remember this
Understanding MCC helps in choosing the right metric for evaluating model performance in imbalanced datasets, ensuring accurate and fair assessment.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Evaluation of binary classifiers
Why can't we just use one score for everything?
Kendall rank correlation coefficient
Ever wonder how to measure if two rankings are similar?
Pearson correlation coefficient
Pearson correlation coefficient formula: r = Σ[(xi - x̄)(yi - ȳ)] / [√(Σ(xi - x̄)²) * √(Σ(yi - ȳ)²)]
F-score
Why is one metric not enough to judge a binary classification model's performance?
to use F1 score: when classes are imbalanced and both FP and FN matter
Why might a sports team need a different score to judge their performance?
Binary classification
Why is it important to know if something is a disease or not?
Swipe through more Machine Learning concepts
Open Pocket Polymath