Struct CrispasrChatOpenParams 

#[repr(C)]
pub struct CrispasrChatOpenParams {
    pub n_threads: c_int,
    pub n_threads_batch: c_int,
    pub n_ctx: c_int,
    pub n_batch: c_int,
    pub n_ubatch: c_int,
    pub n_gpu_layers: c_int,
    pub use_mmap: bool,
    pub use_mlock: bool,
    pub embeddings: bool,
    pub chat_template: *const c_char,
}

Per-session, model-level open params. Fill via crispasr_chat_open_params_default before overriding fields — the C side reads every one of them.

Fields

n_threads: c_int

n_threads_batch: c_int

n_ctx: c_int

Context window in tokens; 0 = the model’s own default.

n_batch: c_int

n_ubatch: c_int

n_gpu_layers: c_int

-1 = offload all layers, 0 = CPU only.

use_mmap: bool

use_mlock: bool

embeddings: bool

chat_template: *const c_char

Overrides the template baked into the GGUF; null reads tokenizer.chat_template from the model. Copied by the callee.

Trait Implementations

impl Clone for CrispasrChatOpenParams

fn clone(&self) -> CrispasrChatOpenParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CrispasrChatOpenParams

impl Debug for CrispasrChatOpenParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CrispasrChatOpenParams

fn default() -> Self

Returns the “default value” for a type.