Struct Sam3CompiledDecoder 

pub struct Sam3CompiledDecoder {
    pub batch: usize,
    pub hw: usize,
    pub seq: usize,
    /* private fields */
}

Compile-once-per-layer decoder, runnable across many frames.

Fields

batch: usize

hw: usize

seq: usize

Implementations

impl Sam3CompiledDecoder

pub fn new( weights: &Sam3DecoderWeights, batch: usize, hw: usize, seq: usize, device: Device, ) -> Result<Sam3CompiledDecoder, Error>

pub fn new_with_profile( weights: &Sam3DecoderWeights, batch: usize, hw: usize, seq: usize, device: Device, profile: &CompileProfile, ) -> Result<Sam3CompiledDecoder, Error>

pub fn new_with_profile_and_gguf( weights: &Sam3DecoderWeights, batch: usize, hw: usize, seq: usize, device: Device, profile: &CompileProfile, gguf_packed: Option<&GgufPackedParams>, ) -> Result<Sam3CompiledDecoder, Error>

pub fn run( &mut self, memory: &[f32], memory_pos: &[f32], text_seq_first: &[f32], text_kpm: &[u8], h: usize, w: usize, ) -> Result<(Vec<f32>, Vec<f32>, Vec<f32>, Vec<f32>), Error>

Run the decoder. Inputs are batch-first: memory [B, hw, D], memory_pos [B, hw, D], text [B, seq, D] (note: text is batch-first here, not seq-first), text_kpm (1 = PAD).