Struct MdlmConfig 

pub struct MdlmConfig {
    pub hidden_dim: usize,
    pub n_blocks: usize,
    pub n_heads: usize,
    pub head_dim: usize,
    pub cond_dim: usize,
    pub vocab_size: usize,
    pub model_length: usize,
    pub mlp_ratio: usize,
    pub rope_theta: f64,
    pub norm_eps: f64,
    pub mask_token_id: u32,
    pub time_conditioning: bool,
}

MDLM masked-diffusion model configuration.

Parsed from the upstream config.json. The released mdlm-owt checkpoint is time-independent (time_conditioning = false), so the DiT conditioning vector is a constant computed once at load time.

Fields

hidden_dim: usize

Hidden dimension (d_model; upstream key hidden_dim).

n_blocks: usize

Number of DiT blocks (upstream key n_blocks).

n_heads: usize

Number of attention heads (upstream key n_heads).

head_dim: usize

Per-head dimension (hidden_dim / n_heads).

cond_dim: usize

Conditioning dimension fed to the adaLN modulation (upstream key cond_dim).

vocab_size: usize

Vocabulary size, including the [MASK] token (upstream key vocab_size).

model_length: usize

Maximum sequence length (upstream key model_length).

mlp_ratio: usize

Feed-forward expansion ratio (MDLM uses 4; not stored in config.json).

rope_theta: f64

Rotary base frequency (MDLM hard-codes 10000).

norm_eps: f64

LayerNorm epsilon (MDLM uses 1e-5).

mask_token_id: u32

Token id of the absorbing [MASK] state (vocab_size - 1).

time_conditioning: bool

Whether the network conditions on diffusion time. The released checkpoint sets this false, so the conditioning vector is constant.

Implementations

impl MdlmConfig

pub fn from_hf_config(config: &Value) -> Result<Self>

Parse an MdlmConfig from a HuggingFace config.json value.

Errors

Returns MIError::Config if a required key (hidden_dim, n_blocks, n_heads, cond_dim, vocab_size) is missing or not a non-negative integer, or if hidden_dim is not divisible by n_heads.

Trait Implementations

impl Clone for MdlmConfig

fn clone(&self) -> MdlmConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MdlmConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.