Module llama_cpp_2::context::kv_cache

source ·
Expand description

utilities for working with the kv cache

Structs§

  • KVCacheView
    An updateable view of the KV cache. (use only for debugging purposes)
  • KVCacheViewCell
    Information associated with an individual cell in the KV cache view.