Struct SamplingParams 

pub struct SamplingParams { /* private fields */ }

Owned sampling configuration for one generation request.

Implementations

impl SamplingParams

pub fn greedy() -> Self

Returns deterministic argmax sampling with native defaults otherwise.

pub fn temperature(self, value: f32) -> Self

pub fn top_p(self, value: f32) -> Self

pub fn top_k(self, value: i32) -> Self

pub fn min_p(self, value: f32) -> Self

pub fn max_tokens(self, value: u32) -> Self

Sets a finite generation limit.

Zero is invalid; use unbounded to request native unbounded generation explicitly.

pub fn unbounded(self) -> Self

Removes the generation limit.

pub fn seed(self, value: u64) -> Self

pub fn clear_seed(self) -> Self

pub fn presence_penalty(self, value: f32) -> Self

pub fn frequency_penalty(self, value: f32) -> Self

pub fn repetition_penalty(self, value: f32) -> Self

pub fn min_tokens(self, value: u32) -> Self

pub fn ignore_eos(self, value: bool) -> Self

pub fn stop(self, value: impl Into<String>) -> Self

pub fn stop_all<I, S>(self, values: I) -> Self

where I: IntoIterator<Item = S>, S: Into<String>,

pub fn structured_output(self, value: StructuredOutput) -> Self

pub fn logits_processor<F>(self, processor: F) -> Self

where F: Fn(&[i32], &mut [f32]) + Send + Sync + 'static,

Installs a host-side processor that can inspect generated token IDs and mutate one request’s logits before each sampling step.

The processor may run concurrently for different requests, so it must be Send + Sync. Cloned parameters share the processor. A panic is contained before the C boundary and reported as Error::LogitsProcessorPanicked after the bounded generation call or from crate::Request::wait. The callback state remains registered through the call or request lifetime; stale native invocations after cleanup become no-ops.

pub fn clear_logits_processor(self) -> Self

Removes a previously configured custom logits processor.

Trait Implementations

impl Clone for SamplingParams

fn clone(&self) -> SamplingParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingParams

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for SamplingParams

fn eq(&self, other: &SamplingParams) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SamplingParams