pub struct RouterOutput {
pub expert_ids: Vec<u32>,
pub expert_weights: Vec<f32>,
}Expand description
Result of routing one batch: parallel arrays indexed [b * top_k + k].
Fields§
§expert_ids: Vec<u32>Selected expert indices. expert_ids[b * top_k + k] ∈ [0, num_experts).
expert_weights: Vec<f32>Combine weights. Same shape as expert_ids. If
norm_topk_prob was true, the K weights for each token sum to 1;
otherwise they’re the raw (post-softmax) probabilities of the
selected experts.
Implementations§
Source§impl RouterOutput
impl RouterOutput
Sourcepub fn empty() -> Self
pub fn empty() -> Self
Empty RouterOutput with no allocation. Use Self::reset before
reuse — this is the cheap constructor for putting it in a scratch
struct.
Trait Implementations§
Source§impl Clone for RouterOutput
impl Clone for RouterOutput
Source§fn clone(&self) -> RouterOutput
fn clone(&self) -> RouterOutput
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RouterOutput
impl Debug for RouterOutput
Source§impl PartialEq for RouterOutput
impl PartialEq for RouterOutput
Source§fn eq(&self, other: &RouterOutput) -> bool
fn eq(&self, other: &RouterOutput) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for RouterOutput
Auto Trait Implementations§
impl Freeze for RouterOutput
impl RefUnwindSafe for RouterOutput
impl Send for RouterOutput
impl Sync for RouterOutput
impl Unpin for RouterOutput
impl UnsafeUnpin for RouterOutput
impl UnwindSafe for RouterOutput
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more