Struct TextEncoderConfig 

pub struct TextEncoderConfig {
    pub position_stride: usize,
    pub ngram_size: Option<usize>,
    pub lowercase: bool,
    pub code_aware: bool,
}

Configuration for the text encoder.

Fields

position_stride: usize

Number of positions to shift for position encoding. Default: 1 (each token position shifts by 1 permutation).

ngram_size: Option<usize>

Whether to include character n-grams for typo robustness. Default: false.

lowercase: bool

Whether to lowercase text before encoding. Default: true.

code_aware: bool

Enable code-aware tokenization (split on _, -, ., /, ::). Default: false.

Trait Implementations

impl Clone for TextEncoderConfig

fn clone(&self) -> TextEncoderConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TextEncoderConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TextEncoderConfig

fn default() -> Self

Returns the “default value” for a type.