Skip to main content

Module params

llama_cpp_bindings::context

Module params 

Source
Expand description

A safe wrapper around llama_context_params.

Re-exports§

pub use crate::context::kv_cache_type::KvCacheType;
pub use crate::context::llama_attention_type::LlamaAttentionType;
pub use crate::context::llama_pooling_type::LlamaPoolingType;
pub use crate::context::rope_scaling_type::RopeScalingType;

Structs§

LlamaContextParams
A safe wrapper around llama_context_params.