Struct GemmaEncoder 

pub struct GemmaEncoder {
    pub hidden: usize,
    /* private fields */
}

Gemma-2 encoder: exact f32 from a diffusers directory, or CMF-quantized (mmap-resident, per-token embed dequant) from a packaged file.

Fields

hidden: usize

Implementations

impl GemmaEncoder

pub fn load_dir(dir: &Path) -> Result<Self, String>

pub fn from_cmf(model: &Arc<CmfModel>) -> Result<Self, String>

Load from a packaged imagegen .cmf (te.* tensors + te.config_json). Quantized projections stay mmap-resident; embeddings dequantize per token.

pub fn encode( &self, ids: &[u32], keep_layer_inputs: bool, ) -> (Vec<f32>, Vec<Vec<f32>>)

Full-sequence causal forward. Returns the FINAL-normed hidden states [n, hidden] and, if keep_layer_inputs, the residual stream entering every layer (what hidden_states[i] means in HF — index nl equals the pre-final-norm stream).