Skip to main content

LLM_KV_ATTENTION_VALUE_LENGTH_SWA

Constant LLM_KV_ATTENTION_VALUE_LENGTH_SWA 

Source
pub const LLM_KV_ATTENTION_VALUE_LENGTH_SWA: llm_kv = 128;