Expand description
APR Federation - Smart Model Routing & Catalog
Enterprise-grade model federation for distributed inference.
§Architecture
┌─────────────────┐
│ Gateway │
│ (Router) │
└────────┬────────┘
│
┌────────────────────┼────────────────────┐
▼ ▼ ▼
┌──────────┐ ┌──────────┐ ┌──────────┐
│ Region A │ │ Region B │ │ Region C │
└──────────┘ └──────────┘ └──────────┘§Design Principles
- Capability-based routing - Route by what models can do, not where they are
- Policy-driven - Latency, cost, privacy, compliance as first-class citizens
- Zero-copy where possible - Streaming responses without buffering
- Graceful degradation - Circuit breakers, fallbacks, retries
Re-exports§
pub use catalog::ModelCatalog;pub use catalog::ModelEntry;pub use gateway::FederationGateway;pub use gateway::GatewayBuilder;pub use gateway::GatewayConfig;pub use health::CircuitBreaker;pub use health::HealthChecker;pub use health::HealthConfig;pub use health::HealthStatus;pub use policy::CompositePolicy;pub use policy::RoutingPolicy;pub use policy::SelectionCriteria;pub use routing::RouteDecision;pub use routing::Router;pub use routing::RouterBuilder;pub use routing::RouterConfig;pub use tui::render_federation_dashboard;pub use tui::FederationApp;pub use tui::FederationTab;pub use traits::*;
Modules§
- catalog
- Model Catalog - Registry of available models across the federation
- gateway
- Federation Gateway - Main entry point for distributed inference
- health
- Health Checker - Monitors node health across the federation
- policy
- Routing policies for federation
- routing
- Router - Intelligent node selection for inference requests
- traits
- Core trait definitions for APR Federation
- tui
- Federation Gateway TUI Dashboard