Re-exports§
pub use ml_runtime_backend;pub use ml_runtime_common;pub use ml_runtime_inference;pub use ml_runtime_model;pub use ml_runtime_provider;
Structs§
- Backend
Registry - Builtin
Capability Provider - Builtin
Model Registry - Cancellation
Token - A token which can be used to signal a cancellation request to one or more tasks.
- Capability
- Capability
Availability - Capability
Execution Metadata - Capability
Limits - Capability
Package Manifest - Capability
Policy - Capability
Registry - Capability
Resolution - Compiled
Artifact Manifest - Decision
Dependency - Decision
Execution - Decision
Execution Diagnostics - Decision
Execution Plan - Decision
Execution Policy - Application constraints. These bound execution without prescribing a backend strategy.
- Decision
Graph Request - Decision
Model Capabilities - Backend/model execution facts used by the structured-decision planner.
- Decision
Node - One decision node and the predicates that control whether it is required.
- Decision
Option - Decision
Plan Stage - Decision
Planner - Decision
Provenance - Decision
Question - Decision
Request - A model-neutral request for one or more typed decisions about immutable input state.
- Decision
Result - Execution
Metadata - Execution
Record - Execution
Request - Execution
Result - Filesystem
Model Catalog - Inference
Options - Inference
Request - Inference
Result - Installation
Manifest - Installed
Model Record - Local
Provider Package - Manifest
Capability Provider - Model
Capability - Model
Description - Model
Descriptor - Catalog discovery information. A descriptor is metadata, not a loaded resource.
- Model
Diagnostic - Model
Doctor Report - ModelId
- A validated, stable model name and version used by catalogs and installers.
- Model
Identity - Model
Lifecycle Result - Model
Registry - Model
Resource - Model
Spec - An explicit backend-independent model definition and artifact location.
- Package
Capability - Package
Manifest - Planned
Decision Result - Result returned by the capability-aware executor. Flattening preserves the
existing JSON shape while keeping
DecisionResultsource-compatible. - Provider
Descriptor - Provider
Manifest - Provider
Registry - Registered
Model Installer - Resolution
Candidate - Resolution
Constraints - Runtime
- Coordinates catalog resolution, routing, model lifecycle, and inference.
- Runtime
Builder - Explicit construction and extension surface for an application-owned
Runtime. - Runtime
Capabilities - Runtime
Config - Runtime
Environment - Runtime
Metrics - Runtime
Metrics Snapshot - Runtime
Model Handle - Opaque runtime-owned reference to a loaded model resource.
- Runtime
Selection - Runtime
Snapshot - Runtime
Status - Tensor
- Typed
Decision
Enums§
- Availability
State - Compiled
Status - Decision
Dependency Condition - Decision
Execution Strategy - Decision
Type - Decision
Value - Device
Kind - Execution
Completion - Execution
Policy - Determines where the runtime attempts to execute a request and whether it may fall back.
- Inference
Stream Event - Input
- Installed
Model Status - Model
Architecture - Model
Format - Model
Lifecycle State - Model
Location - Model
Reference - A request-time model reference: either a catalog identity or an explicit specification.
- Output
- Platform
- Runtime
Error - Stable, structured failures returned by the public runtime API.
Constants§
Traits§
- Capability
Authorizer - Capability
Provider - Decision
Model - Loaded model-neutral typed-decision model.
- Decision
Model Provider - Backend extension capable of loading a local typed-decision artifact.
Functions§
Type Aliases§
- Execution
Id - Inference
Stream - Bounded asynchronous stream of normalized runtime-owned inference events.
- Request
Id - Runtime
Result