Struct AppState 

pub struct AppState {
    pub proxy_state: ProxyState,
    pub exec_ctx: Arc<ExecutionContext>,
    pub llm_readiness_client: Client,
    pub readiness_tracker: ReadinessTracker,
    pub shutdown_token: CancellationToken,
    pub websocket_tracker: WebSocketTracker,
    pub llm_api_base: String,
    pub skip_llm_ready_check: bool,
    pub openai_api_key: Option<String>,
}

Shared application state injected into every handler.

Both states are always present:

• proxy_state handles store=false requests (direct passthrough to vLLM)
• exec_ctx handles store=true requests (stateful executor with DB)

Fields

proxy_state: ProxyState

exec_ctx: Arc<ExecutionContext>

llm_readiness_client: Client

Dedicated no-redirect client for inference-service health probes.

readiness_tracker: ReadinessTracker

Prevents public probes from multiplying dependency work and tracks transitions.

shutdown_token: CancellationToken

Shared cancellation signal used to drain long-lived handlers.

websocket_tracker: WebSocketTracker

Tracks upgraded WebSocket tasks, which Axum does not await during HTTP drain.

llm_api_base: String

vLLM base URL — used by the /ready health probe.

skip_llm_ready_check: bool

Whether /ready should omit the upstream health check.

openai_api_key: Option<String>

Server-configured API key; used as fallback when the request carries no Authorization header on the executor path.

Trait Implementations

impl Clone for AppState

fn clone(&self) -> AppState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.