Struct CrispasrChatGenerateParams 

#[repr(C)]
pub struct CrispasrChatGenerateParams {
    pub max_tokens: c_int,
    pub temperature: c_float,
    pub top_k: c_int,
    pub top_p: c_float,
    pub min_p: c_float,
    pub repeat_penalty: c_float,
    pub repeat_last_n: c_int,
    pub seed: u32,
    pub stop: *const *const c_char,
    pub n_stop: usize,
    pub prefill_only: bool,
}

Per-call, sampler-level generate params. Fill via crispasr_chat_generate_params_default before overriding fields.

Fields

max_tokens: c_int

temperature: c_float

0.0 = greedy (short-circuits the rest of the sampler chain).

top_k: c_int

top_p: c_float

min_p: c_float

repeat_penalty: c_float

repeat_last_n: c_int

seed: u32

0xFFFFFFFF = random.

stop: *const *const c_char

Array of n_stop NUL-terminated stop strings; null = none.

n_stop: usize

prefill_only: bool

Prefill the prompt but suppress assistant generation.

Trait Implementations

impl Clone for CrispasrChatGenerateParams

fn clone(&self) -> CrispasrChatGenerateParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CrispasrChatGenerateParams

impl Debug for CrispasrChatGenerateParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CrispasrChatGenerateParams

fn default() -> Self

Returns the “default value” for a type.