Struct DevPenalty 

pub struct DevPenalty { /* private fields */ }

Implementations

impl DevPenalty

pub fn try_new( repeat: f32, freq: f32, present: f32, counts: Vec<(u32, u32)>, ) -> Result<Self, &'static str>

Checked constructor for callers that do not already own a unique count map.

pub unsafe fn from_unique_counts_unchecked( repeat: f32, freq: f32, present: f32, counts: Vec<(u32, u32)>, ) -> Self

Zero-copy validation seam for a producer that already owns a unique count map.

Safety

counts must contain each token id at most once and every count must be positive. The batched kernel assigns one CUDA thread to each entry and performs a non-atomic read/modify/write of that token’s logit.

Trait Implementations

impl Clone for DevPenalty

fn clone(&self) -> DevPenalty

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DevPenalty

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.