Struct FusedTransformer 

pub struct FusedTransformer { /* private fields */ }

A complete N-layer fused transformer. All ops bypass candle.

Implementations

impl FusedTransformer

pub fn new( cfg: TransformerConfig, layers: Vec<LayerWeights>, norm_w: Vec<f32>, ) -> Self

Create from pre-extracted layer weights.

pub fn forward(&mut self, input: &[f32], tokens: usize) -> Vec<f32>

Forward: input [tokens, hidden] → output [tokens, hidden] (f32 vecs).

pub fn create_gpu_buffer(&self, data: &[f32]) -> Option<GpuBuffer>

Create a Metal buffer from f32 data (shared memory, zero-copy on Apple Silicon). Returns None if Metal not available. Create a GPU buffer from f32 data. Returns None if GPU not available.

pub fn reset(&mut self)