Module context 

Safe wrapper around llama_context.

Modules

kv_cache

utilities for working with the kv cache

params

A safe wrapper around llama_context_params.

perf

Safe wrapper around llama_perf_context_data.

session

utilities for working with session files

tensor_capture

Capture intermediate tensor outputs during decode via the cb_eval callback.

Structs

LlamaContext

A safe wrapper around the llama_context C++ context.