Struct KimiRealHparams 

pub struct KimiRealHparams {

    pub hidden_dim: usize,
    pub kda_num_heads: usize,
    pub kda_head_dim: usize,
    pub mla_num_heads: usize,
    pub mla_q_lora_rank: usize,
    pub mla_kv_lora_rank: usize,
    pub mla_qk_nope_head_dim: usize,
    pub mla_qk_rope_head_dim: usize,
    pub mla_v_head_dim: usize,
    pub dense_intermediate_dim: usize,
    pub moe_hidden_dim: usize,
    pub moe_intermediate_dim: usize,
    pub n_experts: usize,
    pub num_shared_experts: usize,
}

Kimi K3’s real per-layer hyperparameters needed to load any layer (not tied to ferrox_moe::MoeLayerConfig/ferrox_models::ModelConfig, neither of which model the “latent MoE” down-projected dimension or the dense leading layer’s own intermediate size – kept as a small, dedicated struct here rather than widening those shared types for one model’s real values).

Fields

hidden_dim: usize

kda_num_heads: usize

kda_head_dim: usize

mla_num_heads: usize

mla_q_lora_rank: usize

mla_kv_lora_rank: usize

mla_qk_nope_head_dim: usize

mla_qk_rope_head_dim: usize

mla_v_head_dim: usize

dense_intermediate_dim: usize

moe_hidden_dim: usize

moe_intermediate_dim: usize

n_experts: usize

num_shared_experts: usize

Implementations

impl KimiRealHparams

pub fn real() -> Self

Kimi K3’s real published values (config.json).