Skip to main content

Crate rust_ml_runtime

Crate rust_ml_runtime 

Source

Re-exports§

pub use ml_runtime_backend;
pub use ml_runtime_common;
pub use ml_runtime_inference;
pub use ml_runtime_model;
pub use ml_runtime_provider;

Structs§

BackendRegistry
BuiltinCapabilityProvider
BuiltinModelRegistry
CancellationToken
A token which can be used to signal a cancellation request to one or more tasks.
Capability
CapabilityAvailability
CapabilityExecutionMetadata
CapabilityLimits
CapabilityPackageManifest
CapabilityPolicy
CapabilityRegistry
CapabilityResolution
CompiledArtifactManifest
DecisionDependency
DecisionExecution
DecisionExecutionDiagnostics
DecisionExecutionPlan
DecisionExecutionPolicy
Application constraints. These bound execution without prescribing a backend strategy.
DecisionGraphRequest
DecisionModelCapabilities
Backend/model execution facts used by the structured-decision planner.
DecisionNode
One decision node and the predicates that control whether it is required.
DecisionOption
DecisionPlanStage
DecisionPlanner
DecisionProvenance
DecisionQuestion
DecisionRequest
A model-neutral request for one or more typed decisions about immutable input state.
DecisionResult
ExecutionMetadata
ExecutionRecord
ExecutionRequest
ExecutionResult
FilesystemModelCatalog
InferenceOptions
InferenceRequest
InferenceResult
InstallationManifest
InstalledModelRecord
LocalProviderPackage
ManifestCapabilityProvider
ModelCapability
ModelDescription
ModelDescriptor
Catalog discovery information. A descriptor is metadata, not a loaded resource.
ModelDiagnostic
ModelDoctorReport
ModelId
A validated, stable model name and version used by catalogs and installers.
ModelIdentity
ModelLifecycleResult
ModelRegistry
ModelResource
ModelSpec
An explicit backend-independent model definition and artifact location.
PackageCapability
PackageManifest
PlannedDecisionResult
Result returned by the capability-aware executor. Flattening preserves the existing JSON shape while keeping DecisionResult source-compatible.
ProviderDescriptor
ProviderManifest
ProviderRegistry
RegisteredModelInstaller
ResolutionCandidate
ResolutionConstraints
Runtime
Coordinates catalog resolution, routing, model lifecycle, and inference.
RuntimeBuilder
Explicit construction and extension surface for an application-owned Runtime.
RuntimeCapabilities
RuntimeConfig
RuntimeEnvironment
RuntimeMetrics
RuntimeMetricsSnapshot
RuntimeModelHandle
Opaque runtime-owned reference to a loaded model resource.
RuntimeSelection
RuntimeSnapshot
RuntimeStatus
Tensor
TypedDecision

Enums§

AvailabilityState
CompiledStatus
DecisionDependencyCondition
DecisionExecutionStrategy
DecisionType
DecisionValue
DeviceKind
ExecutionCompletion
ExecutionPolicy
Determines where the runtime attempts to execute a request and whether it may fall back.
InferenceStreamEvent
Input
InstalledModelStatus
ModelArchitecture
ModelFormat
ModelLifecycleState
ModelLocation
ModelReference
A request-time model reference: either a catalog identity or an explicit specification.
Output
Platform
RuntimeError
Stable, structured failures returned by the public runtime API.

Constants§

VERSION

Traits§

CapabilityAuthorizer
CapabilityProvider
DecisionModel
Loaded model-neutral typed-decision model.
DecisionModelProvider
Backend extension capable of loading a local typed-decision artifact.

Functions§

default_model_root

Type Aliases§

ExecutionId
InferenceStream
Bounded asynchronous stream of normalized runtime-owned inference events.
RequestId
RuntimeResult