Enum ModelScale 

pub enum ModelScale {
    Small {
        layers: usize,
        model_dim: usize,
        heads: usize,
    },
    Medium {
        layers: usize,
        model_dim: usize,
        heads: usize,
    },
    Large {
        layers: usize,
        model_dim: usize,
        heads: usize,
    },
    ExtraLarge {
        layers: usize,
        model_dim: usize,
        heads: usize,
    },
}

Model scale variants

Variants

Small

Small model (< 1B parameters)

Fields

layers: usize

model_dim: usize

heads: usize

Medium

Medium model (1B - 10B parameters)

Fields

layers: usize

model_dim: usize

heads: usize

Large

Large model (10B - 100B parameters)

Fields

layers: usize

model_dim: usize

heads: usize

ExtraLarge

XL model (> 100B parameters)

Fields

layers: usize

model_dim: usize

heads: usize

Trait Implementations

impl Clone for ModelScale

fn clone(&self) -> ModelScale

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelScale

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.