Skip to main content

LLM_KV_ATTENTION_HEAD_COUNT

Constant LLM_KV_ATTENTION_HEAD_COUNT 

Source
pub const LLM_KV_ATTENTION_HEAD_COUNT: llm_kv = 96;