pub struct TestReadout {
pub due: bool,
pub checks: u64,
pub control: u64,
pub refused: u64,
pub sessions: u32,
pub kept: u64,
pub by_asked: Vec<(u16, Estimate)>,
pub ask_free: Option<Estimate>,
}Expand description
The question-count test’s readout (module doc), from the summary’s fold (select/summary.rs
Experiment, Check::xk): its checks that drew a count (randomised), of them the control arm’s,
those the gate refused (the fixed rule played) and the sessions with a drawn one, all-time; once
due (TEST_CHECKS, TEST_SESSIONS), and only then, its estimates over the drawn checks the summary
still holds (kept: compaction drops the oldest checks, select/summary.rs compact, never the
counts), refused ones included, each with its session’s bootstrap 95% interval (ope::snips).
Each a Horvitz–Thompson mean over every unit that could go either way, so a unit’s outcome y·ω
(unit_outcome) counts even when it is 0: a verdict weighed by its inverse chance of one (policy.rs
judged, the monitor’s), a lesson never delivered 0 (it changed nothing), one closed without a
verdict 0 (its route’s judged ones stand in for it), one still open out until it closes.
by_asked, dilution, per m ≥ 2: the test’s top lesson (the first of select/policy.rstested, asked at every s ≥ 1) asked with m of the test’s questions against asked alone, over the drawn checks with k ≥ m: Σ (k + 1)·([s = m] − [s = 1])·y·ω / n. s is uniform in 0..=k, so the same lesson’s two draws differ in the number asked alone (grade mix, the 3s and k do not enter); by the drawn s, a count the gate refused played as the fixed rule (intention to treat).ask_free, asking a 2 against handing it over: Σ([asked]·y·ω/p − [free]·y·ω/pf)/n over the 2s that could go either way (0 < p, pf; the logged propensities are the draw’s, a refused count’s routes the fixed rule’s, select/policy.rschoose), a difference of change rates.
Fields§
§due: bool§checks: u64§control: u64§refused: u64§sessions: u32§kept: u64The drawn checks the summary still holds, which the estimates read.
by_asked: Vec<(u16, Estimate)>§ask_free: Option<Estimate>