Struct TextGenerationConfig 

pub struct TextGenerationConfig { /* private fields */ }

Portable sampling inputs for one text-generation session.

Implementations

impl TextGenerationConfig

pub const fn new(sampling: ResolvedGenerationConfig) -> Self

Uses resolved checkpoint/request sampling with deterministic seed zero.

pub const fn with_seed(self, seed: u64) -> Self

Selects the deterministic root seed used by a stochastic backend.

pub fn with_mirostat_v2( self, tau: f32, eta: f32, ) -> Result<Self, GenerationError>

Selects adaptive Mirostat V2 sampling.

pub const fn sampling(&self) -> ResolvedGenerationConfig

Returns the validated sampling configuration.

pub const fn seed(&self) -> u64

Returns the deterministic root seed.

pub const fn strategy(&self) -> TextSamplingStrategy

Returns the selected backend-neutral sampling strategy.

Trait Implementations

impl Clone for TextGenerationConfig

fn clone(&self) -> TextGenerationConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TextGenerationConfig

impl Debug for TextGenerationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TextGenerationConfig

fn eq(&self, other: &TextGenerationConfig) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TextGenerationConfig