Module context

Expand description

Safe wrapper around llama_context.

Modules§

kv_cache: utilities for working with the kv cache
llama_state_seq_flags: Flags for extended state sequence operations on hybrid/recurrent models.
load_seq_state_error: Error type for sequence state file load operations.
load_session_error: Error type for session file load operations.
params: A safe wrapper around llama_context_params.
save_seq_state_error: Error type for sequence state file save operations.
save_session_error: Error type for session file save operations.
session: utilities for working with session files