Module params 

A safe wrapper around llama_model_params.

Modules

kv_overrides

Key-value overrides for a model.

Structs

LlamaModelParams

A safe wrapper around llama_model_params.

LlamaSplitModeParseError

An error that occurs when unknown split mode is encountered.

Enums

LlamaSplitMode

A rusty wrapper around llama_split_mode.

Constants

LLAMA_CPP_MAX_DEVICES

The maximum number of devices supported.