Module federation

Module federation 

Source
Expand description

APR Federation - Smart Model Routing & Catalog

Enterprise-grade model federation for distributed inference.

§Architecture

                    ┌─────────────────┐
                    │   Gateway       │
                    │  (Router)       │
                    └────────┬────────┘
                             │
        ┌────────────────────┼────────────────────┐
        ▼                    ▼                    ▼
  ┌──────────┐        ┌──────────┐        ┌──────────┐
  │ Region A │        │ Region B │        │ Region C │
  └──────────┘        └──────────┘        └──────────┘

§Design Principles

  1. Capability-based routing - Route by what models can do, not where they are
  2. Policy-driven - Latency, cost, privacy, compliance as first-class citizens
  3. Zero-copy where possible - Streaming responses without buffering
  4. Graceful degradation - Circuit breakers, fallbacks, retries

Re-exports§

pub use catalog::ModelCatalog;
pub use catalog::ModelEntry;
pub use gateway::FederationGateway;
pub use gateway::GatewayBuilder;
pub use gateway::GatewayConfig;
pub use health::CircuitBreaker;
pub use health::HealthChecker;
pub use health::HealthConfig;
pub use health::HealthStatus;
pub use policy::CompositePolicy;
pub use policy::RoutingPolicy;
pub use policy::SelectionCriteria;
pub use routing::RouteDecision;
pub use routing::Router;
pub use routing::RouterBuilder;
pub use routing::RouterConfig;
pub use tui::render_federation_dashboard;
pub use tui::FederationApp;
pub use tui::FederationTab;
pub use traits::*;

Modules§

catalog
Model Catalog - Registry of available models across the federation
gateway
Federation Gateway - Main entry point for distributed inference
health
Health Checker - Monitors node health across the federation
policy
Routing policies for federation
routing
Router - Intelligent node selection for inference requests
traits
Core trait definitions for APR Federation
tui
Federation Gateway TUI Dashboard