Skip to main content

LLM_KV_ATTENTION_KEY_LENGTH

Constant LLM_KV_ATTENTION_KEY_LENGTH 

Source
pub const LLM_KV_ATTENTION_KEY_LENGTH: llm_kv = 100;