Struct LlmRuntimeConfig 

pub struct LlmRuntimeConfig {
    pub hidden_size: usize,
    pub num_layers: usize,
    pub num_kv_heads: usize,
    pub head_dim: usize,
    pub vocab_size: usize,
    pub max_seq_len: usize,
}

Runtime configuration every decoder-only LLM must expose.

This is the execution-facing config — the bare minimum the surrounding engine needs (KV cache sizing, sampler vocab bounds, scheduler quotas). It deliberately does not include architecture details like num_heads or intermediate_size; those stay private to the model implementation.

Fields

hidden_size: usize

num_layers: usize

num_kv_heads: usize

head_dim: usize

vocab_size: usize

max_seq_len: usize

Trait Implementations

impl Clone for LlmRuntimeConfig

fn clone(&self) -> LlmRuntimeConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmRuntimeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.