Struct EncoderConfig 

pub struct EncoderConfig {
    pub d: usize,
    pub inter: usize,
    pub heads: usize,
    pub layers: usize,
    pub vocab: usize,
    pub global: Vec<bool>,
    pub window: usize,
    pub rope_global: f64,
    pub rope_local: f64,
    pub norm_eps: f64,
}

The encoder’s shape, from encoder/config.json (a HF ModernBERT config).

Fields

d: usize

Hidden size.

inter: usize

GeGLU inner size. mlp.Wi has twice as many rows.

heads: usize

Attention heads.

layers: usize

Encoder layers.

vocab: usize

Vocabulary size, the rows of the embedding table.

global: Vec<bool>

Whether each layer attends globally, false meaning the sliding window.

window: usize

Sliding window width in tokens, 128 for both published encoders.

rope_global: f64

RoPE base on global layers.

rope_local: f64

RoPE base on sliding window layers.

norm_eps: f64

LayerNorm epsilon.

Implementations

impl EncoderConfig

pub fn from_json(v: &Value) -> Result<Self, Error>

Reads a HF ModernBERT config. Both the transformers 5 layout (layer_types, rope_parameters) and the older one (global_attn_every_n_layers, global_rope_theta, local_rope_theta) are accepted, since checkpoints in the wild have either.

Errors

Error::Format naming the missing or bad field.

Trait Implementations

impl Clone for EncoderConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EncoderConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for EncoderConfig

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for EncoderConfig