Module context 

Safe wrapper around llama_context (LlamaContext).

Re-exports

pub use params::LlamaContextParams;

Modules

embeddings

Embeddings + reranker support: the llama_get_embeddings* accessors.

kv_cache

utilities for working with the kv cache

params

Context parameters (LlamaContextParams) over ik’s llama_context_params.

session

utilities for working with session files

Structs

LlamaContext

An inference context bound to a LlamaModel.