Enum BlockRole 

pub enum BlockRole {
    Single,
    First,
    Middle,
    Last,
}

Where a rank sits in the pipeline. Drives whether it embeds tokens, just transforms hidden states, or produces logits.

Variants

Single

world == 1: this rank runs the whole model (embed → layers → head).

First

Highest rank: owns the first layers, embeds the input tokens, and sends hidden states toward rank 0.

Middle

Interior rank: receives hidden states, runs its layers, forwards.

Last

Rank 0: owns the last layers, runs the final norm + LM head, and produces logits to sample from.

Trait Implementations

impl Clone for BlockRole

fn clone(&self) -> BlockRole

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for BlockRole

impl Debug for BlockRole

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for BlockRole

impl PartialEq for BlockRole

fn eq(&self, other: &BlockRole) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for BlockRole