Module proxy_value_metrics 

Per-session value metrics for proxied completions.

The proxy records prompt-compression measurements and a per-request input cost estimate for each completion.

Structs

ProxyValueMetrics

Aggregate value metrics for the proxy process’s current session.

Functions

compression_ratio

Returns the fraction of original tokens removed during the current session.

record_completion

Records a completed proxy request in the current process session.

reset_session

Clears all value metrics for the current proxy session.

session_metrics

Returns a snapshot of value metrics accumulated for the current session.