Skip to main content

Module quality

Module quality 

Source
Expand description

Model/runtime quality aggregation from Karvi execution events.

Groups execution_event entries by (model, runtime) and computes success rate, average cost, average latency, and token totals.

Structs§

ModelQuality
Per-(model, runtime) quality summary.
QualityReport
Full quality aggregation result.

Functions§

model_quality_from_events
Compute quality metrics from a slice of events (typically execution_event type).