Skip to main content

typical_sample

Function typical_sample 

Source
pub fn typical_sample(
    logits: &[f64],
    cfg: &TypicalConfig,
    rng: &mut LcgRng,
) -> SeqResult<usize>
Expand description

Sample a single token id from logits using typical decoding.

ยงErrors