Struct RoutedRequest 

pub struct RoutedRequest {
    pub id: u64,
    pub kind: RequestKind,
    pub inputs: Vec<Vec<u32>>,
    pub max_tokens: u32,
    pub temperature: f32,
    pub stream: bool,
    pub adapter: Option<String>,
    pub model: String,
}

Internal canonical request shape. Every wire protocol parses into this; downstream schedulers / engines consume only this type.

Fields

id: u64

kind: RequestKind

inputs: Vec<Vec<u32>>

Pre-tokenized input (one entry per text in a batched embed request). For chat completion: the system + user history flattened into a single token list.

max_tokens: u32

temperature: f32

stream: bool

adapter: Option<String>

Optional LoRA adapter name; passed through to crate::lora_scheduler::LoraRequest::adapter.

model: String

Model name from the wire request — kept for telemetry / validation; the actual model selection happens upstream.

Trait Implementations

impl Clone for RoutedRequest

fn clone(&self) -> RoutedRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RoutedRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.