Expand description
Model calibration for confidence estimation.
Calibration ensures model confidence matches actual accuracy.
§Methods
- Temperature Scaling: Single parameter post-hoc calibration
- Platt Scaling: Logistic regression on logits
- Expected Calibration Error (ECE): Calibration metric
Structs§
- Isotonic
Regression - Isotonic Regression calibrator.
- Platt
Scaling - Platt scaling: fits logistic regression on logits.
- Temperature
Scaling - Temperature scaling calibrator. Divides logits by learned temperature T before softmax.
Functions§
- brier_
score - Brier score - measures calibration quality.
- expected_
calibration_ error - Expected Calibration Error (ECE) - measures calibration quality.
- maximum_
calibration_ error - Maximum Calibration Error (MCE).
- reliability_
diagram - Generate reliability diagram data.