Expand description
Federation Gateway - Main entry point for distributed inference
The gateway orchestrates the full inference lifecycle: routing, execution, retries, and response handling.
Structsยง
- Federation
Gateway - The main federation gateway
- Gateway
Builder - Builder for creating federation gateways
- Gateway
Config - Configuration for the federation gateway
- Logging
Middleware - Logging middleware
- Rate
Limit Middleware - Rate limiting middleware