Struct Candidates 

pub struct Candidates { /* private fields */ }

Reusable token candidates and stage scratch storage.

Implementations

impl Candidates

pub const fn new() -> Self

Creates an empty candidate set.

pub fn with_capacity(n_vocab: usize) -> Self

Creates an empty candidate set sized for n_vocab logits.

pub fn load(&mut self, logits: &[f32]) -> Result<(), Error>

Validates and loads logits while retaining allocated storage.

pub fn as_slice(&self) -> &[Candidate]

Returns the current candidates in stage order.

pub fn selected(&self) -> Option<u32>

Returns the selected token from the last terminal stage.

Trait Implementations

impl Clone for Candidates

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Candidates

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Candidates

fn default() -> Self

Returns the “default value” for a type.