Struct ModelRouter 

pub struct ModelRouter {
    pub model_routes: Vec<ModelRoute>,
    pub embedding_routes: Vec<EmbeddingRoute>,
    pub classification_rules: Vec<ClassificationRule>,
    pub classification_enabled: bool,
}

The model router resolves hints and classifies queries to select routes.

Fields

model_routes: Vec<ModelRoute>

embedding_routes: Vec<EmbeddingRoute>

classification_rules: Vec<ClassificationRule>

classification_enabled: bool

Implementations

impl ModelRouter

pub fn resolve_hint(&self, hint: &str) -> Option<ResolvedRoute>

Resolve a model route by explicit hint name.

pub fn resolve_embedding_hint( &self, hint: &str, ) -> Option<ResolvedEmbeddingRoute>

Resolve an embedding route by explicit hint name.

pub fn classify_query(&self, query: &str) -> Option<String>

Classify a query and return the best matching hint.

pub fn route_query(&self, query: &str) -> Option<ResolvedRoute>

Classify a query and resolve to a model route in one step.

Trait Implementations

impl Clone for ModelRouter

fn clone(&self) -> ModelRouter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelRouter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelRouter

fn default() -> ModelRouter

Returns the “default value” for a type.