Module quality

Module quality 

Source
Expand description

§Quality Metrics Collection System

Comprehensive quality tracking across all ThinkTools modules. Provides dashboards, trends, and improvement recommendations.

§Metrics Collected

CategoryMetrics
AccuracyGSM8K, MATH, ARC-C benchmark scores
CalibrationBrier score, ECE, overconfidence ratio
ReasoningPRM scores, ToT success rate, step validity
VerificationTriangulation score, fact-check accuracy
DebateWin rate, argument strength, verdict confidence

§Usage

use reasonkit::thinktool::quality::{QualityDashboard, QualityMetric};

let mut dashboard = QualityDashboard::new();
dashboard.record_metric(QualityMetric::Accuracy { benchmark: "GSM8K", score: 0.859 });
dashboard.record_metric(QualityMetric::Calibration { brier: 0.15, ece: 0.08 });

let report = dashboard.generate_report();
println!("{}", report.format());

Structs§

MetricRecord
Timestamped metric record
QualityDashboard
Quality dashboard for tracking and reporting
QualityReport
QualityScore
Quality score aggregation
QualityTargets
Quality targets for comparison
TargetViolation

Enums§

QualityGrade
QualityMetric
Individual quality metric
Trend