pub fn typical_sample(
logits: &[f64],
cfg: &TypicalConfig,
rng: &mut LcgRng,
) -> SeqResult<usize>Expand description
Sample a single token id from logits using typical decoding.
ยงErrors
SeqError::EmptyInputiflogitsis empty.SeqError::InvalidConfiguration/SeqError::InvalidParameterifcfgis malformed.