Skip to main content

LLM_KV_ATTENTION_OUTPUT_GROUP_COUNT

Constant LLM_KV_ATTENTION_OUTPUT_GROUP_COUNT 

Source
pub const LLM_KV_ATTENTION_OUTPUT_GROUP_COUNT: llm_kv = 145;