Struct SamplingParams 

pub struct SamplingParams {
    pub temperature: f32,
    pub top_p: f32,
    pub min_p: f32,
    pub top_k: usize,
    pub repetition_penalty: f32,
    pub penalty_last_n: usize,
    pub presence_penalty: f32,
    pub frequency_penalty: f32,
}

Sampling parameters for one generation request. temperature <= 0.0 means “sample nothing, take the greedy argmax” – the same deterministic behavior ferrox always had before this module existed.

Fields

temperature: f32

top_p: f32

Nucleus sampling threshold in (0.0, 1.0]. 1.0 disables top-p filtering (every token with nonzero probability is eligible).

min_p: f32

Keep only candidates at least min_p times as likely as the most likely one. 0.0 disables it; llama.cpp’s --min-p, whose default is 0.05 (common/common.h:231) rather than off.

That default is why this is a parity item and not a feature: llama.cpp truncates with min-p on every run nobody configured, so without it ferrox could not reproduce llama.cpp’s own out-of-the-box output for any prompt.

The struct default here stays 0.0 (disabled) for the same reason temperature defaults to greedy: SamplingParams::default is ferrox’s “do nothing the caller did not ask for” baseline, and llama.cpp’s CLI numbers live on the CLI flags.

top_k: usize

Keep only the top_k highest-probability tokens before sampling. 0 disables top-k filtering.

repetition_penalty: f32

1.0 discourages repeating a token already in history; 1.0 disables repetition penalty. Uses the standard convention (divide positive logits, multiply negative ones) so the penalty always pushes toward less likely, regardless of logit sign.

penalty_last_n: usize

How many of the most recent tokens the penalties look at, as llama.cpp’s penalty_last_n (common/common.h:238, default 64).

0 disables the penalties entirely. ferrox had no window at all and scanned the WHOLE history, so on a long generation it penalised a steadily growing set of tokens where llama.cpp penalises the last 64 – the divergence grew with output length, which is exactly when a repetition penalty matters most.

presence_penalty: f32

OpenAI-style presence penalty: subtract from logits of tokens that already appeared in history (once per distinct token).

frequency_penalty: f32

OpenAI-style frequency penalty: subtract frequency_penalty * count from logits for each token id seen in history.

Trait Implementations

impl Clone for SamplingParams

fn clone(&self) -> SamplingParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingParams

fn default() -> Self

Greedy decoding: identical behavior to ferrox’s original argmax-only generation loop.