Function typical_sample_batch 

pub fn typical_sample_batch(
    logits: &[f64],
    n: usize,
    vocab: usize,
    cfg: &TypicalConfig,
    rng: &mut LcgRng,
) -> SeqResult<Vec<usize>>

Batch variant of typical_sample for n independent rows of length vocab in a flat logits buffer.

Errors

• SeqError::EmptyInput if logits is empty, n == 0, or vocab == 0.
• SeqError::ShapeMismatch if logits.len() != n * vocab.