Struct DevSamp 

pub struct DevSamp {
    pub temp: f32,
    pub seed: u64,
    pub ctr: u32,
    pub top_k: i32,
    pub top_p: f32,
    pub min_p: f32,
    pub penalty: Option<DevPenalty>,
}

Device-sample request for one batched row. top_k=0 / top_p>=1.0 / min_p<=0.0 = that filter off. Greedy = temp<=0 (device argmax); pure temperature = seeded gumbel; any filter on = filter_stats floor + the filtered gumbel draw. penalty carries host-maintained sparse counts for the exact active history window; the epilogue applies them on device before filters and sampling.

Fields

temp: f32

seed: u64

ctr: u32

top_k: i32

top_p: f32

min_p: f32

penalty: Option<DevPenalty>

Implementations

impl DevSamp

pub fn new( temp: f32, seed: u64, ctr: u32, top_k: i32, top_p: f32, min_p: f32, ) -> Self

pub fn with_penalty(self, penalty: DevPenalty) -> Self

Trait Implementations

impl Clone for DevSamp

fn clone(&self) -> DevSamp

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DevSamp

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.