Skip to main content

DevSamp

Type Alias DevSamp 

Source
pub type DevSamp = (f32, u64, u32, i32, f32, f32);
Expand description

Device-sample request for one batched row: (temp, seed, ctr, top_k, top_p, min_p). top_k=0 / top_p>=1.0 / min_p<=0.0 = that filter off. Greedy = temp<=0 (device argmax); pure temperature = seeded gumbel; any filter on = filter_stats floor + the filtered gumbel draw. Penalty configs never reach device sampling (worker eligibility).