Expand description
A safe wrapper around llama_model_params.
Modules§
- kv_
overrides - Key-value overrides for a model.
Structs§
- FitResult
- Result of
LlamaModelParams::fit_params, containing the fitted context size. - Llama
Model Params - A safe wrapper around
llama_model_params. - Llama
Split Mode Parse Error - An error that occurs when unknown split mode is encountered.
Enums§
- FitError
- Error returned by
LlamaModelParams::fit_params. - Llama
Split Mode - A rusty wrapper around
llama_split_mode.
Constants§
- LLAMA_
CPP_ MAX_ DEVICES - The maximum number of devices supported.