Skip to main content

MROPE_SECTIONS

Constant MROPE_SECTIONS 

Source
pub const MROPE_SECTIONS: usize = _ /* 4usize */;
Expand description

Positions an embedding entry carries on an M-RoPE or interleaved-M-RoPE model: [t, y, x, z], where t doubles as the KV-cache position.

Mirrors GGML_MROPE_SECTIONS. A model with any other RoPE type uses a single position per entry; LlamaBatchExt::n_pos_per_embd reports which applies.