Struct SamplingParams 

pub struct SamplingParams {
    pub temperature: f32,
    pub top_p: f32,
    pub top_k: u32,
    pub min_p: f32,
    pub repetition_penalty: f32,
    pub presence_penalty: f32,
    pub frequency_penalty: f32,
    pub stop_sequences: Vec<String>,
    pub max_tokens: u32,
    pub seed: Option<u64>,
}

Parameters controlling text generation sampling.

Fields

temperature: f32

Temperature for sampling (0.0 = greedy, higher = more random). Default: 1.0

top_p: f32

Top-p (nucleus) sampling threshold. Default: 1.0

top_k: u32

Top-k sampling (0 = disabled). Default: 0

min_p: f32

Minimum probability for min-p sampling (0.0 = disabled). Default: 0.0

repetition_penalty: f32

Repetition penalty (1.0 = no penalty). Default: 1.0

presence_penalty: f32

Presence penalty (-2.0 to 2.0). Default: 0.0

frequency_penalty: f32

Frequency penalty (-2.0 to 2.0). Default: 0.0

stop_sequences: Vec<String>

Stop sequences that halt generation.

max_tokens: u32

Maximum number of tokens to generate. Default: 256

seed: Option<u64>

Random seed for reproducibility.

Implementations

impl SamplingParams

pub fn greedy() -> Self

Creates greedy sampling parameters (temperature = 0).

pub fn balanced() -> Self

Creates balanced sampling parameters.

pub fn creative() -> Self

Creates creative sampling parameters.

pub fn with_temperature(self, temperature: f32) -> Self

Sets the temperature.

pub fn with_top_p(self, top_p: f32) -> Self

Sets the top-p value.

pub fn with_top_k(self, top_k: u32) -> Self

Sets the top-k value.

pub fn with_max_tokens(self, max_tokens: u32) -> Self

Sets the maximum tokens.

pub fn with_stop(self, stop: impl Into<String>) -> Self

Adds a stop sequence.

pub fn with_seed(self, seed: u64) -> Self

Sets the random seed.

pub fn validate(&self) -> Result<(), String>

Validates the sampling parameters.

Errors

Returns an error if any parameter is out of valid range.

Trait Implementations

impl Clone for SamplingParams

fn clone(&self) -> SamplingParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingParams

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SamplingParams

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for SamplingParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.