Struct DecompressedLayer 

pub struct DecompressedLayer {
    pub layer_index: u32,
    pub num_tokens: usize,
    pub num_heads: usize,
    pub head_dim: usize,
    pub keys: Vec<Vec<f32>>,
    pub values: Vec<Vec<f32>>,
}

Reconstructed K/V tensors for one layer of the shared pool.

All vectors are in the original (head × token × head_dim) layout but flat per head: keys[head_idx][token_idx * head_dim + j]. This matches the HuggingFace DynamicCache per-layer access pattern (cache.layers[layer_idx].keys[:, head_idx, :, :] flattened along the last two dims).

Fields

layer_index: u32

Original layer index in the model.

num_tokens: usize

Number of tokens in this layer (= pool’s num_shared_tokens).

num_heads: usize

Number of KV heads (= pool’s num_kv_heads).

head_dim: usize

Per-head dimension.

keys: Vec<Vec<f32>>

Decoded K vectors: keys[head_idx] is a flat Vec<f32> of length num_tokens * head_dim in token order.

values: Vec<Vec<f32>>

Decoded V vectors, same layout as keys.

Trait Implementations

impl Clone for DecompressedLayer

fn clone(&self) -> DecompressedLayer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DecompressedLayer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for DecompressedLayer

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for DecompressedLayer

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.