Struct GatewayRouteState 

pub struct GatewayRouteState { /* private fields */ }

Shared, cloneable state threaded into every route handler.

Bundles the run store, plan cache, model runner registry, federation registry, and API key table; clones share the same underlying store and cache through interior mutability.

Implementations

impl GatewayRouteState

pub fn new(store: MemoryGatewayStore) -> Self

Returns route state wrapping store with a fresh cache, runners, and federation.

pub fn with_cache(store: MemoryGatewayStore, cache: OpenAiPlanCache) -> Self

Returns route state wrapping store and a preseeded plan cache.

pub fn with_runners(self, runners: OpenAiRunnerRegistry) -> Self

Returns the state with its model runner registry replaced by runners.

pub fn with_federation(self, federation: OpenAiFederation) -> Self

Returns the state with its federation registry replaced by federation.

pub fn with_keys(self, keys: OpenAiKeyTable) -> Self

Returns the state with its API key table replaced by keys.

pub fn memory() -> Self

Returns route state backed by a fresh in-memory store.

pub fn store(&self) -> &Arc<Mutex<MemoryGatewayStore>>

Returns the shared run store.

pub fn cache(&self) -> &Arc<Mutex<OpenAiPlanCache>>

Returns the shared plan cache.

pub fn runners(&self) -> &OpenAiRunnerRegistry

Returns the model runner registry.

pub fn federation(&self) -> &OpenAiFederation

Returns the federation registry.

pub fn keys(&self) -> &OpenAiKeyTable

Returns the API key table.

Trait Implementations

impl Clone for GatewayRouteState

fn clone(&self) -> GatewayRouteState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.