Module params

llama_cpp_2::context

Module params 

Source
Expand description

A safe wrapper around llama_context_params.

Structs§

LlamaContextParams
A safe wrapper around llama_context_params.

Enums§

KvCacheType
A rusty wrapper around ggml_type for KV cache types.
LlamaPoolingType
A rusty wrapper around LLAMA_POOLING_TYPE.
RopeScalingType
A rusty wrapper around rope_scaling_type.