Struct EmbedHost 

pub struct EmbedHost {
    pub raw: Vec<u8>,
    pub ggml_type: GgmlType,
    pub n_embd: usize,
}

Host-resident embedding table for row gather (dequant only the needed token rows).

Fields

raw: Vec<u8>

ggml_type: GgmlType

n_embd: usize

Implementations

impl EmbedHost

pub fn from_gguf(g: &GgufFile, name: &str) -> Self

pub fn from_source(src: &dyn TensorSource, name: &str) -> Self

pub fn qt_and_row_bytes(&self, n_embd: usize) -> (i32, usize)

QT int + row_bytes for this embed table’s dtype (for the device embed-gather kernel). CUDA-GRAPH-PLAN Phase 1. Mirrors the GpuTensor qtype mapping.

pub fn gather(&self, n_embd: usize, tokens: &[u32]) -> Vec<f32>

Gather rows for tokens -> [T, n_embd] f32. Dequant per-row from raw bytes.