Skip to main content

encode_kv_tensor

fib_quant::kv::codec

Function encode_kv_tensor 

Source 
pub fn encode_kv_tensor(
    shape: KvTensorShapeV1,
    layout: KvCacheLayoutV1,
    profile: KvCompressionProfileV1,
    values: &[f32],
) -> Result<KvEncodedTensorV1>
Expand description

Encode a canonical contiguous f32 KV tensor.