Struct EncoderSpec 

pub struct EncoderSpec {
    pub ffn: BertFfn,
    pub topology: BertTopology,
    pub rope_interleaved: bool,
    pub final_norm_name: &'static str,
}

The architectures this loader builds, with the FFN each one runs.

Both share bert.cpp’s graph; what differs is two lines of it, and both are read from the architecture because upstream reads them that way: the rotation at :126-133 and the FFN at :179-201. A row here is a promise that every OTHER line of that graph is the same, which is why nomic-bert-moe is not in it (its moe_every_n_layers layers are a second FFN shape) and jina-bert-v2 is not either (a second attention norm). One architecture’s row on this loader: the FFN, where the norms sit, and which rotation (if any) the attention uses.

Fields

ffn: BertFfn

topology: BertTopology

rope_interleaved: bool

true for the NORM (interleaved) rotation: llama_model_rope_type answers that for neo-bert and NEOX for the others.

final_norm_name: &'static str

The tensor the FINAL norm is stored under, for the pre-norm shape. neo-bert.cpp:23 uses enc.output_norm and eurobert.cpp:16 plain output_norm – one fact, two spellings, which is the attn_output_norm case again.

Trait Implementations

impl Clone for EncoderSpec

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for EncoderSpec

impl Debug for EncoderSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for EncoderSpec

impl PartialEq for EncoderSpec

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for EncoderSpec