Skip to main content

AppState

Struct AppState 

Source
pub struct AppState {
    pub functions: Arc<DashMap<Uuid, FunctionRecord>>,
    pub jobs: Arc<DashMap<Uuid, JobRecord>>,
    pub metrics: Arc<TensorWasmMetrics>,
    pub executor: Arc<TensorWasmExecutor>,
    pub kernel_registry: Option<Arc<dyn KernelRegistry>>,
    pub openai_model_map: ModelMap,
    pub app_config: AppConfig,
}
Expand description

Process-global state shared by every handler.

Arc<AppState> is cloned into the router via with_state; the inner DashMaps sit behind their own Arc so cheap clones of the maps remain possible across the codebase.

Fields§

§functions: Arc<DashMap<Uuid, FunctionRecord>>

Deployed-function registry, keyed by id.

§jobs: Arc<DashMap<Uuid, JobRecord>>

Async-job registry, keyed by id.

§metrics: Arc<TensorWasmMetrics>

Shared metrics registry. Cloned into the executor so spawn/terminate counters and the /metrics scrape view the same atomics.

§executor: Arc<TensorWasmExecutor>

Wasm executor driving the synchronous /invoke path.

§kernel_registry: Option<Arc<dyn KernelRegistry>>

Optional kernel registry (B6.4 / roadmap feature #3). None when TENSOR_WASM_API_KERNEL_HMAC_KEY is unset; the /kernels routes return 503 kernel_registry_not_configured in that case so client tools can detect feature availability without inspecting the URL surface. Only compiled when the kernel-registry-api feature is enabled — the default build keeps the lean dep graph.

§openai_model_map: ModelMap

OpenAI model → FunctionId resolution map (T41). Read from TENSOR_WASM_API_OPENAI_MODEL_MAP at startup; empty map means every OpenAI request returns 404 model_not_found. See crate::openai_translator for the env-var grammar.

§app_config: AppConfig

Top-level AppConfig carrying the snapshot HMAC signing key and the require_signature toggle (M5).

Read from the environment (TENSOR_WASM_API_SNAPSHOT_HMAC_KEY / TENSOR_WASM_API_SNAPSHOT_REQUIRE_SIGNATURE) in build_router and threaded here so the /snapshot/save and /snapshot/restore handlers can sign and verify blobs with the operator’s configured key. When the key is None the snapshot routes return 503 snapshot_signing_not_configured — mirroring the kernel-registry posture so a client can detect the feature being disabled without inspecting the URL surface.

Implementations§

Source§

impl AppState

Source

pub fn with_app_config(self, cfg: AppConfig) -> Self

Install the top-level AppConfig, carrying the snapshot HMAC key + require-signature toggle (M5).

Called by build_router with the result of AppConfig::from_env so the /snapshot/* handlers consume the operator-configured key. Public so integration tests can drive the snapshot routes with an explicit key without poisoning the process environment.

Source

pub fn try_new() -> Result<Arc<Self>, TensorWasmError>

Fallible constructor. Returns a TensorWasmError if the underlying wasmtime engine cannot be initialised (e.g. unsupported strategy on the host). Production callers should use this and surface the failure through their own startup path.

Source

pub fn new() -> Arc<Self>

Construct an AppState wrapped in Arc for use with Router::with_state. Panics on engine initialisation failure.

Prefer AppState::try_new in production code; this convenience wrapper exists for parity with Default and for tests.

Source

pub fn with_metrics(self, metrics: Arc<TensorWasmMetrics>) -> Self

Override the metrics registry, rebuilding the executor so its spawn/terminate counters share the supplied handle.

Useful for tests that need to inspect counter values, or for embedders who construct a process-wide registry separately. Panics on engine initialisation failure for ergonomic parity with Self::new.

Trait Implementations§

Source§

impl Clone for AppState

Source§

fn clone(&self) -> AppState

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for AppState

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for AppState

Source§

fn default() -> Self

Default AppState. Calls the internal builder and unwraps for the same reasons documented on AppState::new: in practice TensorWasmEngine::new only fails on host misconfiguration, which is a fatal startup condition. Used by tests via AppState::default().

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FromRef<T> for T
where T: Clone,

Source§

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.
Source§

impl<T> FutureExt for T

Source§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
Source§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
Source§

impl<A, B, T> HttpServerConnExec<A, B> for T
where B: Body,

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more