Struct MimoVisionGeom 

pub struct MimoVisionGeom {

    pub depth: usize,
    pub hidden: usize,
    pub intermediate: usize,
    pub heads: usize,
    pub kv_heads: usize,
    pub head_dim: usize,
    pub out_hidden: usize,
    pub in_channels: usize,
    pub patch: usize,
    pub temporal_patch: usize,
    pub merge: usize,
    pub fullatt: Vec<usize>,
    pub window_types: Vec<i64>,
    pub band: usize,
    pub use_sink: bool,
    pub rms_eps: f64,
}

ViT geometry (config.vision_config, HF MiMoVisionTransformer).

Fields

depth: usize

hidden: usize

Residual width (1280).

intermediate: usize

heads: usize

kv_heads: usize

head_dim: usize

qk_channels, default 64 — NOT hidden/heads (= 40).

out_hidden: usize

LLM hidden the merger projects to (4096).

in_channels: usize

patch: usize

temporal_patch: usize

merge: usize

fullatt: Vec<usize>

Blocks with full (per-frame) attention.

window_types: Vec<i64>

vit_window_attn_types (−1 full, 0 row order, 1 column order).

band: usize

Band half-width visual_token_window_size (|i−j| ≤ 64).

use_sink: bool

rms_eps: f64

Implementations

impl MimoVisionGeom

pub fn from_config(cfg: &Value) -> Result<Self, String>

pub fn qkv_rows(&self) -> usize

Rows of the fused qkv: (heads + 2·kv_heads)·head_dim.

pub fn merge_width(&self) -> usize

Width of one merge unit: hidden·merge².

pub fn patch_width(&self) -> usize

Values per patch row: in_channels·temporal_patch·patch².

pub fn has_sink(&self, i: usize) -> bool

Block i carries a key-0 sink (every non-full block when use_sink).

Trait Implementations

impl Clone for MimoVisionGeom

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MimoVisionGeom

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for MimoVisionGeom

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for MimoVisionGeom