1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
//! Core functionality for the Gateway
//!
//! This module contains the core business logic and data structures.
// A2A (Agent-to-Agent) Protocol Gateway
// Agent Coordinator for managing agent lifecycles
// Audio API (transcription, translation, speech)
// Audit logging system
// pub mod base_provider; // Removed: unused dead code
// Budget management system
// Canonical deterministic cache subsystem (DualCache / LLMCache)
// Core completion API
// Unified cost calculation system
// Core embedding API (Python LiteLLM compatible)
// Fine-tuning API
// Function calling support for AI providers
// Content safety and validation system
// Health monitoring system
// External integrations (Langfuse, etc.)
// IP-based access control
// API Key Management System
// MCP (Model Context Protocol) Gateway
// Advanced observability and monitoring
// Rate limiting system
// Realtime WebSocket API
// Rerank API for RAG systems
// Secret management system
// Semantic similarity cache (vector-based)
// Team management module
// DB methods implemented as stubs in storage/database/seaorm_db/user_management_ops.rs
// Database methods implemented as stubs in storage/database/seaorm_db/virtual_key_ops.rs