Skip to main content

Engine

ferrox_models::engine

Trait Engine 

Source 
pub trait Engine {
    type State;

    // Required methods
    fn new_state(&self) -> Self::State;
    fn vocab_size(&self) -> usize;
    fn forward_token(
        &self,
        token_id: usize,
        pos: usize,
        state: &mut Self::State,
    ) -> Vec<f32>;
}
Expand description

A decoder that can run one incremental forward step given a token id and position, updating its own per-layer state in place.

Required Associated Types§

Source

type State

Required Methods§

Source

fn new_state(&self) -> Self::State

Builds fresh (empty) per-layer state for a new request.

Source

fn vocab_size(&self) -> usize

Source

fn forward_token( &self, token_id: usize, pos: usize, state: &mut Self::State, ) -> Vec<f32>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§