Struct AppState 

pub struct AppState {
    pub config: Arc<AtomicValue<Config>>,
    pub auth: Arc<AuthSystem>,
    pub storage: Arc<StorageLayer>,
    pub pricing: Arc<PricingService>,
    pub budget_limits: Arc<UnifiedBudgetLimits>,
    pub budget_manager: Arc<BudgetManager>,
    pub team_manager: Arc<TeamManager>,
    pub key_manager: RuntimeVirtualKeyManager,
    pub callbacks: RuntimeObservability,
    pub audit_logger: Arc<AuditLogger>,
    pub ip_access: Arc<IpAccessControl>,
    /* private fields */
}

HTTP server state shared across handlers

This struct contains shared resources that need to be accessed across multiple request handlers. All fields are wrapped in Arc for efficient sharing across threads.

config uses AtomicValue so callers can explicitly swap the entire configuration at runtime while readers obtain lock-free Arc<Config> snapshots. This type does not start a file watcher by itself.

Router, guardrails, and response cache are published together through Self::apply_runtime. Self::pin_runtime holds one generation for a request lifecycle. Live accessors load from that same bundle so HTTP traffic never stays on construction-time Arcs after a successful apply.

Fields

config: Arc<AtomicValue<Config>>

Gateway configuration (atomically swappable by explicit callers)

auth: Arc<AuthSystem>

Authentication system

storage: Arc<StorageLayer>

Storage layer

pricing: Arc<PricingService>

Unified pricing service

budget_limits: Arc<UnifiedBudgetLimits>

Budget limits for provider and model cost tracking

budget_manager: Arc<BudgetManager>

General budget manager for keyed budget scopes such as API key budgets

team_manager: Arc<TeamManager>

Team manager for team lifecycle operations (shared, in-memory by default)

key_manager: RuntimeVirtualKeyManager

API key manager for /v1/keys route handlers (shared across requests)

callbacks: RuntimeObservability

Non-blocking external request lifecycle callback dispatcher

audit_logger: Arc<AuditLogger>

Explicitly configured request audit logger.

ip_access: Arc<IpAccessControl>

IP policy consumed by the outer HTTP middleware.

Implementations

impl AppState

pub fn config_sync_status(&self) -> ConfigSyncStatus

Current node’s revision and sanitized synchronization diagnostics.

impl AppState

pub fn new_with_unified_router( config: Config, auth: AuthSystem, unified_router: UnifiedRouter, storage: StorageLayer, pricing: Arc<PricingService>, budget_limits: Arc<UnifiedBudgetLimits>, ) -> Self

Create a new AppState with unified router

pub fn new_with_runtime( revision: RuntimeRevision, auth: AuthSystem, storage: StorageLayer, pricing: Arc<PricingService>, budget_limits: Arc<UnifiedBudgetLimits>, ) -> Self

Create AppState from a fully built runtime revision.

pub fn with_callbacks(self, callbacks: RuntimeObservability) -> Self

Attach a configured callback dispatcher.

pub fn with_audit_logger(self, audit_logger: Arc<AuditLogger>) -> Self

Attach the request audit logger built during startup.

pub fn with_request_policies( self, guardrails: Arc<GuardrailEngine>, ip_access: Arc<IpAccessControl>, ) -> Self

Attach validated content and network policy engines.

pub fn pin_runtime(&self) -> Arc<RuntimeRevision>

Lock-free pin of the active runtime generation.

Clone the returned Arc (or clone this pin) to keep router, guardrails, cache, config, and generation stable for the rest of a request even if Self::apply_runtime publishes a newer revision.

pub fn unified_router(&self) -> Arc<UnifiedRouter>

Live router for the current generation.

pub fn guardrails(&self) -> Arc<GuardrailEngine>

Live guardrail engine for the current generation.

pub fn response_cache(&self) -> Option<Arc<LLMCache>>

Live response cache for the current generation.

pub async fn apply_runtime(&self, candidate: Config) -> Result<u64>

Validate and build a complete candidate revision, then publish it atomically.

Any build failure leaves the previous revision fully active. On success, router, provider health, guardrails, response cache, generation, and Self::config observe one consistent generation. Pricing is reused from Self::pricing rather than rebuilt.

pub fn config(&self) -> Arc<Config>

Load a snapshot of the current gateway configuration.

Returns an Arc<Config> that is valid for the lifetime of the caller — subsequent explicit swaps will not affect already-loaded snapshots.

Trait Implementations

impl Clone for AppState

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.