Struct SamplingOverrides 

pub struct SamplingOverrides {
    pub temperature: Option<f32>,
    pub top_p: Option<f32>,
    pub max_tokens: Option<u32>,
}

Per-call sampling overrides for ChatProvider methods.

Backends that support per-call sampling (e.g. LlamaCppProvider) apply these overrides on top of the defaults configured at provider construction. Backends that do not support per-call overrides (the default trait impl) silently ignore overrides — passing Some(SamplingOverrides::...) is safe against any backend.

None on any field means “use the provider default” (no override). Passing sampling: None to the _and_sampling methods is equivalent to calling the non-sampling-aware method (no behaviour change).

Fields

temperature: Option<f32>

Temperature override. None = use provider default.

top_p: Option<f32>

Top-p (nucleus sampling) override. None = use provider default.

max_tokens: Option<u32>

Max output tokens override. None = use provider default.

Implementations

impl SamplingOverrides

pub fn empty() -> Self

All overrides unset. Equivalent to SamplingOverrides::default — included for call-site readability when explicitly opting out.

pub fn with_temperature(temperature: f32) -> Self

Convenience constructor: override only temperature.

pub fn with_top_p(top_p: f32) -> Self

Convenience constructor: override only top_p.

pub fn with_max_tokens(max_tokens: u32) -> Self

Convenience constructor: override only max_tokens.

Trait Implementations

impl Clone for SamplingOverrides

fn clone(&self) -> SamplingOverrides

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingOverrides

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingOverrides

fn default() -> SamplingOverrides

Returns the “default value” for a type.

impl PartialEq for SamplingOverrides

fn eq(&self, other: &SamplingOverrides) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SamplingOverrides