Struct DefaultMoERouter 

pub struct DefaultMoERouter { /* private fields */ }

Default hash-based MoE router

Routes inputs consistently using hash-based sharding. Same input always routes to the same expert (assuming stable expert count).

Implementations

impl DefaultMoERouter

pub fn new() -> Self

Create a new default router

pub fn with_virtual_shards(self, shards: usize) -> Self

Create with virtual sharding for better distribution

Trait Implementations

impl Clone for DefaultMoERouter

fn clone(&self) -> DefaultMoERouter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DefaultMoERouter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DefaultMoERouter

fn default() -> DefaultMoERouter

Returns the “default value” for a type.

impl MoERouter for DefaultMoERouter

fn route<'life0, 'life1, 'async_trait>( &'life0 self, input: &'life1 str, num_experts: usize, ) -> Pin<Box<dyn Future<Output = RouteResult> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Route an input to an expert

fn name(&self) -> &str

Get router name for metrics/logging

fn route_with_experts<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, input: &'life1 str, experts: &'life2 [Expert], ) -> Pin<Box<dyn Future<Output = RouteResult> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Route with expert health information