Expand description
Exposes a small subset of llama.cpp common/ helpers and parameter structs.
§Upstream common_init_from_params
llama.cpp’s common_init_from_params
loads a model and context (and samplers) from a parsed CLI-style
common_params.
Its second argument, model_only, skips context creation when true (used
by tests that construct contexts manually).
This crate does not wrap the full C++ common_params tree. The Rust
equivalent of model_only = true is crate::model::LlamaModel::load_from_file
followed by crate::model::LlamaModel::new_context when you need inference.
Structs§
- Common
Params - Struct containing common parameters for processing.
- common_
sampler_ params - common sampler params
Constants§
- COMMON_
SAMPLER_ TYPE_ DRY - COMMON_
SAMPLER_ TYPE_ INFILL - COMMON_
SAMPLER_ TYPE_ MIN_ P - COMMON_
SAMPLER_ TYPE_ NONE - COMMON_
SAMPLER_ TYPE_ TEMPERATURE - COMMON_
SAMPLER_ TYPE_ TFS_ Z - COMMON_
SAMPLER_ TYPE_ TOP_ K - COMMON_
SAMPLER_ TYPE_ TOP_ P - COMMON_
SAMPLER_ TYPE_ TYPICAL_ P - COMMON_
SAMPLER_ TYPE_ XTC