Struct DflashKv 

pub struct DflashKv {
    pub k: Vec<CudaSlice<f32>>,
    pub v: Vec<CudaSlice<f32>>,
    pub len: usize,
    pub cap: usize,
}

Draft KV cache (round-cost fix, 2026-07-13): per-layer normed+roped ctx K and raw ctx V, append-only in committed order. Block K/V land TRANSIENTLY at [len..len+b] each round (never committed — the reference crops them identically). Kills the per-round full-ctx projection recompute (first light was O(ctx)/round -> 7 tok/s).

Fields

k: Vec<CudaSlice<f32>>

v: Vec<CudaSlice<f32>>

len: usize

cap: usize

Implementations

impl DflashKv

pub fn new( e: &Engine, cfg: &DflashCfg, cap: usize, ) -> Result<Self, Box<dyn Error>>