Struct RoutedExpertRequest 

pub struct RoutedExpertRequest<'a, T> {
    pub layer: usize,
    pub input: &'a T,
    pub routes: &'a GroupSelection<T>,
    pub pass: ExpertPass,
}

One architecture route batch submitted to a runtime expert provider.

Fields

layer: usize

Global decoder layer requesting experts.

input: &'a T

Flattened token rows submitted to the selected experts.

routes: &'a GroupSelection<T>

Backend-native selected expert IDs, scores, and weights.

pass: ExpertPass

Whether this route batch belongs to prefill or decode.

Implementations

impl<T> RoutedExpertRequest<'_, T>

pub const fn parameter_bank_access(&self) -> ParameterBankAccess

Projects architecture execution semantics into the storage workload class exposed to backend parameter-bank mechanisms.