Struct DecodingConfig 

pub struct DecodingConfig {
    pub beam_size: usize,
    pub temperatures: Vec<f32>,
    pub length_penalty: f32,
    pub no_speech_threshold: f32,
    pub max_length: usize,
    pub language: String,
    pub task: Task,
    pub compression_ratio_threshold: f32,
    pub log_prob_threshold: f32,
}

Configuration for beam search decoding

Fields

beam_size: usize

Beam size for beam search (1 = greedy, 5 = default, 10+ = very accurate)

temperatures: Vec<f32>

Temperature fallback sequence (tried in order; retry at next temp if quality fails)

length_penalty: f32

Length penalty to prevent repeating short sequences (0.0 = no penalty)

no_speech_threshold: f32

Threshold for no-speech detection based on cross-attention (0.0 to 1.0)

max_length: usize

Maximum tokens to generate

language: String

Language token (e.g., “en” for English; “auto” for first-token detection)

task: Task

Decode task: Transcribe (output in language) or Translate (X → English only).

compression_ratio_threshold: f32

Gzip compression ratio threshold — ratio above this signals a hallucination loop (default 2.4)

log_prob_threshold: f32

Average log-probability threshold — below this signals low-confidence output (default -1.0)

Implementations

impl DecodingConfig

pub fn fast() -> Self

Create a fast decoding config (greedy, minimal processing)

pub fn balanced() -> Self

Create a balanced decoding config (good quality/speed tradeoff)

pub fn accurate() -> Self

Create an accurate decoding config (highest quality, slowest)

pub fn with_beam_size(self, beam_size: usize) -> Self

Set beam size

pub fn with_temperature(self, temperature: f32) -> Self

Override temperatures with a single value (disables fallback sequence)

pub fn with_length_penalty(self, penalty: f32) -> Self

Set length penalty

pub fn with_no_speech_threshold(self, threshold: f32) -> Self

Set no-speech threshold

pub fn with_language(self, language: String) -> Self

Set language

pub fn with_task(self, task: Task) -> Self

Set decode task (transcribe vs translate-to-English)

Trait Implementations

impl Clone for DecodingConfig

fn clone(&self) -> DecodingConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DecodingConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DecodingConfig

fn default() -> Self

Returns the “default value” for a type.