Struct BeamSearchConfig 

pub struct BeamSearchConfig {
    pub beam_width: usize,
    pub max_length: usize,
    pub eos_token_id: Option<usize>,
    pub length_penalty: f64,
    pub min_length: usize,
    pub vocab_size: usize,
    pub temperature: f64,
    pub top_k_filter: Option<usize>,
}

Configuration for beam search decoding.

Fields

beam_width: usize

Number of beams to keep at each step.

max_length: usize

Maximum sequence length (inclusive).

eos_token_id: Option<usize>

Optional end-of-sequence token ID. When a beam generates this token it is moved to the completed list (subject to min_length).

length_penalty: f64

Length penalty exponent α: score = log_prob / length^α. 1.0 gives simple length normalisation; 0.0 disables it.

min_length: usize

Minimum sequence length before EOS is allowed to terminate a beam.

vocab_size: usize

Number of tokens in the vocabulary.

temperature: f64

Temperature for logit scaling before softmax. 1.0 = no change.

top_k_filter: Option<usize>

Optional top-k filter: only the top-k logits are kept per step.

Trait Implementations

impl Clone for BeamSearchConfig

fn clone(&self) -> BeamSearchConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BeamSearchConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BeamSearchConfig

fn default() -> Self

Returns the “default value” for a type.