Skip to main content

Module params

Module params 

Source
Expand description

A safe wrapper around llama_model_params.

Modules§

fit_result
kv_override_value_iterator
kv_overrides
Key-value overrides for a model.
param_override_value
unknown_kv_override_tag

Structs§

LlamaModelParams
A safe wrapper around llama_model_params.

Constants§

LLAMA_CPP_MAX_DEVICES
The maximum number of devices supported.