Trait Generator 

pub trait Generator {
    type Shardable: Forwarder;

    const MODEL_NAME: &'static str;

    // Required method
    fn load<'life0, 'async_trait>(
        context: &'life0 mut Context,
    ) -> Pin<Box<dyn Future<Output = Result<Option<Box<Self>>>> + Send + 'async_trait>>
       where Self: 'async_trait,
             'life0: 'async_trait;
}

A model must implement this trait in order to be usable by the Cake framework.

Required Associated Constants

const MODEL_NAME: &'static str

The model name.

Required Associated Types

type Shardable: Forwarder

This associated type determines which part of the model can be sharded.

Required Methods

fn load<'life0, 'async_trait>( context: &'life0 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Option<Box<Self>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Load the model from the context.

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors

impl Generator for LLama

const MODEL_NAME: &'static str = "llama3"

type Shardable = Transformer

impl Generator for Qwen2

const MODEL_NAME: &'static str = "qwen2"

type Shardable = Transformer

impl Generator for Qwen3_5

const MODEL_NAME: &'static str = "qwen3_5"

type Shardable = Qwen3_5Block

impl Generator for SD

const MODEL_NAME: &'static str = "stable-diffusion"

type Shardable = SDShardable