Skip to main content

LLM_KV_ATTENTION_INDEXER_BLOCK_SIZE

Constant LLM_KV_ATTENTION_INDEXER_BLOCK_SIZE 

Source
pub const LLM_KV_ATTENTION_INDEXER_BLOCK_SIZE: llm_kv = 135;