Crate llm_edge_routing

Crate llm_edge_routing 

Source
Expand description

Intelligent routing engine for LLM Edge Agent

Provides:

  • Cost-based routing
  • Latency-based routing
  • Hybrid routing (multi-factor scoring)
  • Circuit breakers
  • Fallback chains

Re-exports§

pub use error::RoutingError;
pub use error::RoutingResult;
pub use strategy::RoutingDecision;
pub use strategy::RoutingStrategy;

Modules§

circuit_breaker
Circuit breaker implementation
error
strategy
Routing strategies