Expand description
A safe wrapper around llama_model_params.
Modules§
- kv_
overrides - Key-value overrides for a model.
- param_
override_ value
Structs§
- Llama
Model Params - A safe wrapper around
llama_model_params.
Constants§
- LLAMA_
CPP_ MAX_ DEVICES - The maximum number of devices supported.