Expand description
§tsai_analysis
Analysis utilities for tsai-rs: confusion matrix, top losses, permutation importance.
This crate provides tools for analyzing model performance:
- Confusion matrix computation and visualization
- Top losses identification
- Feature and step importance via permutation
- Calibration analysis (ECE, MCE, temperature scaling)
- Classification report (per-class precision, recall, F1)
- Time series feature extraction (tsfresh-style)
Re-exports§
pub use features::extract_features;pub use features::extract_multivariate_features;pub use features::FeatureExtractor;pub use features::FeatureSet;
Modules§
- features
- Time series feature extraction similar to tsfresh.
Structs§
- Calibration
Result - Calibration analysis results.
- Class
Metrics - Per-class classification metrics.
- Classification
Report - Classification report with per-class and aggregate metrics.
- Confusion
Matrix - Confusion matrix for classification evaluation.
- Permutation
Importance - Importance score for a feature or time step.
- TopLoss
- A sample with its loss value.
Functions§
- calibration_
from_ probs - Compute calibration from probability matrix.
- classification_
report - Compute a classification report from predictions and targets.
- compute_
calibration - Compute calibration metrics for classification predictions.
- confusion_
matrix - Compute confusion matrix from predictions and targets.
- feature_
importance - Compute feature (variable) importance via permutation.
- find_
optimal_ temperature - Find optimal temperature for calibration.
- step_
importance - Compute time step importance via permutation.
- temperature_
scale - Temperature scaling for calibration.
- top_
losses - Get the top losses (samples with highest loss).