Structs§
- Physical
Block - Represents a physical memory block storing KV-tensors for a fixed number of tokens.
Constants§
- DEFAULT_
BLOCK_ SIZE - Size of a block in number of tokens (typically 16, 32, or 64).
Type Aliases§
- Physical
Block Id - Unique physical block index in the memory pool.