Skip to main content

Module common

Module common 

Source
Expand description

Manual wrapper for values in llama.cpp/common/common.h

common_sampler_params mirrors upstream’s common_params_sampling (kept in sync with llama.cpp b10470). It is a plain Rust convenience struct, not an FFI type: grammar and logit_bias are simplified to owned Rust values rather than upstream’s common_grammar / llama_logit_bias, and the server/CLI-only fields (reasoning budget, grammar triggers) are omitted.

Structs§

common_sampler_params
common sampler params

Constants§

COMMON_SAMPLER_TYPE_ADAPTIVE_P
COMMON_SAMPLER_TYPE_DRY
COMMON_SAMPLER_TYPE_INFILL
COMMON_SAMPLER_TYPE_MIN_P
COMMON_SAMPLER_TYPE_NONE
COMMON_SAMPLER_TYPE_PENALTIES
COMMON_SAMPLER_TYPE_TEMPERATURE
COMMON_SAMPLER_TYPE_TOP_K
COMMON_SAMPLER_TYPE_TOP_N_SIGMA
COMMON_SAMPLER_TYPE_TOP_P
COMMON_SAMPLER_TYPE_TYPICAL_P
COMMON_SAMPLER_TYPE_XTC

Type Aliases§

common_sampler_type