Skip to main content

LLM_KV_ATTENTION_KEY_LENGTH_MLA

Constant LLM_KV_ATTENTION_KEY_LENGTH_MLA 

Source
pub const LLM_KV_ATTENTION_KEY_LENGTH_MLA: llm_kv = 125;