Skip to main content

BlockDiffusionForward

Trait BlockDiffusionForward 

Source
pub trait BlockDiffusionForward {
    // Required method
    fn forward_block(
        &mut self,
        token_ids: &[u32],
        seq_len: usize,
        refresh_experts: bool,
    ) -> Result<BlockForwardOutput, Error>;
}
Expand description

Forward callback: refresh_experts flag is set per TIDE policy before each call.

Required Methods§

Source

fn forward_block( &mut self, token_ids: &[u32], seq_len: usize, refresh_experts: bool, ) -> Result<BlockForwardOutput, Error>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§