Struct CohortUsage 

pub struct CohortUsage {
    pub requests: u64,
    pub input_tokens: u64,
    pub output_tokens: u64,
    pub sum_sq_output: u64,
    pub prompt_tokens: u64,
    pub sum_sq_prompt: u64,
}

Cumulative holdout cohort totals. Keyed by arm name: "control" | "treatment" for output savings (#895 Track B), "compression:control" | "compression:treatment" for input compression (#1905). The average tokens per turn are *_tokens / requests. Only populated while a holdout is active.

Fields

requests: u64

input_tokens: u64

output_tokens: u64

sum_sq_output: u64

Sum of squared per-turn output tokens, enabling an online sample variance (and therefore a confidence interval) without retaining every turn. #[serde(default)] keeps pre-#895 files loadable.

prompt_tokens: u64

Whole prompt per turn — billed input plus cache reads and writes (#1905). Compression shrinks the prompt wherever it is billed, so the input-compression comparison uses this, not input_tokens alone. #[serde(default)] keeps earlier files loadable.

sum_sq_prompt: u64

Sum of squared per-turn prompt_tokens, for its confidence interval.

Implementations

impl CohortUsage

pub fn merge(&mut self, other: &Self)

Adds another cohort’s running totals — every field, so the sums of squares (and with them the variance / CI) survive a proxy restart.

pub fn avg_output(&self) -> Option<f64>

Average output tokens per turn, or None with no observations.

pub fn variance_output(&self) -> Option<f64>

Unbiased sample variance of per-turn output tokens, or None with < 2 observations. Computed from the running sum / sum-of-squares (clamped at 0 to absorb floating-point error on near-constant samples).

Trait Implementations

impl Clone for CohortUsage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CohortUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CohortUsage

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CohortUsage

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for CohortUsage

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CohortUsage

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CohortUsage