Skip to main content

Module params

ik_llama_cpp_2::context

Module params 

Source
Expand description

Context parameters (LlamaContextParams) over ik’s llama_context_params.

Structs§

LlamaContextParams
Parameters controlling a crate::LlamaContext.

Enums§

LlamaContextType
The kind of context to create.