Skip to main content

Module common

Module common 

Source
Expand description

Exposes a small subset of llama.cpp common/ helpers and parameter structs.

§Upstream common_init_from_params

llama.cpp’s common_init_from_params loads a model and context (and samplers) from a parsed CLI-style common_params. Its second argument, model_only, skips context creation when true (used by tests that construct contexts manually).

This crate does not wrap the full C++ common_params tree. The Rust equivalent of model_only = true is crate::model::LlamaModel::load_from_file followed by crate::model::LlamaModel::new_context when you need inference.

Structs§

CommonParams
Struct containing common parameters for processing.
common_sampler_params
common sampler params

Constants§

COMMON_SAMPLER_TYPE_DRY
COMMON_SAMPLER_TYPE_INFILL
COMMON_SAMPLER_TYPE_MIN_P
COMMON_SAMPLER_TYPE_NONE
COMMON_SAMPLER_TYPE_TEMPERATURE
COMMON_SAMPLER_TYPE_TFS_Z
COMMON_SAMPLER_TYPE_TOP_K
COMMON_SAMPLER_TYPE_TOP_P
COMMON_SAMPLER_TYPE_TYPICAL_P
COMMON_SAMPLER_TYPE_XTC

Type Aliases§

common_sampler_type