ferrum-kv 0.7.4

KV cache management with PagedAttention for Ferrum inference
Documentation