Module llama_cpp_2::context

source ·
Expand description

Safe wrapper around llama_context.

Modules

  • kv_cache
    utilities for working with the kv cache
  • params
    A safe wrapper around llama_context_params.
  • sample
    Sampling functions for the context.

Structs