Struct LlamaDecodeLayerSpec 

pub struct LlamaDecodeLayerSpec {
    pub num_heads: usize,
    pub head_dim: usize,
    pub n_rot: usize,
    pub num_kv_heads: usize,
    pub kv_group_size: usize,
    pub eps: f32,
    pub use_custom_mask: bool,
    pub hidden_shape: Shape,
    pub rope_style: RopeStyle,
}

Fields

num_heads: usize

head_dim: usize

n_rot: usize

Leading per-head dims that get rotary-rotated (head_dim unless partial RoPE — Phi-3 / long-context variants).

num_kv_heads: usize

kv_group_size: usize

eps: f32

use_custom_mask: bool

hidden_shape: Shape

rope_style: RopeStyle

RoPE pairing flavor. GGUF Llama weights need rlx_ir::RopeStyle::GptJ; HF-safetensors checkpoints use rlx_ir::RopeStyle::NeoX (default).

Trait Implementations

impl Clone for LlamaDecodeLayerSpec

fn clone(&self) -> LlamaDecodeLayerSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaDecodeLayerSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.