Expand description
RoPE-aware bit allocation for KV-cache quantization.
Provides CPU-side, deterministic infrastructure for assigning variable bit-widths to RoPE frequency blocks. The greedy energy heuristic is experimental and inspired by block-level frequency analysis; it does not claim equivalence with any published algorithm.
Structs§
- Rope
BitAllocation - Bit-width assignment for every RoPE block in a head.
- Rope
Block - A contiguous pair of head dimensions forming one RoPE frequency block.
- Rope
Block Energy - Energy estimate for one RoPE block.
Functions§
- allocate_
rope_ bits - Greedily allocate bits across RoPE blocks.
- rope_
block_ energies - Compute per-block energy from a set of key vectors.
- rope_
blocks - Partition
head_diminto contiguous 2-D RoPE blocks.