Skip to main content

Module metrics

Module metrics 

Source
Expand description

Provider metrics wrapper

Wraps any Provider to automatically record latency, throughput, and tokens-per-second via the global PROVIDER_METRICS registry.

Structsยง

MetricsProvider
A provider wrapper that instruments every call with performance metrics.