Enum ParameterRole 

pub enum ParameterRole {
    Replicated,
    ColumnProjection,
    RowProjection,
    Vocabulary,
    AttentionHeads,
    FeedForwardIntermediate,
    ExpertIntermediate,
    Channels,
    Segmented,
}

Semantic role of a logical parameter group.

Variants

Replicated

Small or otherwise non-partitioned state.

ColumnProjection

Projection whose output features are rank-local.

RowProjection

Projection whose input features are rank-local and whose output is reduced.

Vocabulary

Token embedding or output projection partitioned by vocabulary.

AttentionHeads

Query, key, or value heads.

FeedForwardIntermediate

Dense feed-forward intermediate channels shared by input and output projections.

ExpertIntermediate

Routed or shared expert intermediate channels.

Channels

State-space, convolution, or recurrent channels.

Segmented

A fused tensor containing independently partitioned segments.

Trait Implementations

impl Clone for ParameterRole

fn clone(&self) -> ParameterRole

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ParameterRole

impl Debug for ParameterRole

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ParameterRole

impl PartialEq for ParameterRole

fn eq(&self, other: &ParameterRole) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ParameterRole