Skip to main content

Module params

llama_cpp_4::model

Module params 

Source
Expand description

A safe wrapper around llama_model_params.

Modules§

kv_overrides
Key-value overrides for a model.

Structs§

LlamaModelParams
A safe wrapper around llama_model_params.

Enums§

LlamaLazyMode
Whether tensors the architecture marks as lazy are read on demand rather than up front.
LlamaLoadMode
Exact model-file loading strategy exposed by llama.cpp.