Skip to main content

Crate ml_runtime_inference

Crate ml_runtime_inference 

Source

Structs§

Audio
DecisionDependency
DecisionExecution
DecisionExecutionDiagnostics
DecisionExecutionPlan
DecisionExecutionPolicy
Application constraints. These bound execution without prescribing a backend strategy.
DecisionGraphRequest
DecisionModelCapabilities
Backend/model execution facts used by the structured-decision planner.
DecisionNode
One decision node and the predicates that control whether it is required.
DecisionOption
DecisionPlanStage
DecisionProvenance
DecisionQuestion
DecisionRequest
A model-neutral request for one or more typed decisions about immutable input state.
DecisionResult
ExecutionMetadata
Image
InferenceChunk
InferenceOptions
InferenceRequest
InferenceResult
ModelDescription
ModelIdentity
PlannedDecisionResult
Result returned by the capability-aware executor. Flattening preserves the existing JSON shape while keeping DecisionResult source-compatible.
Tensor
TypedDecision

Enums§

DecisionDependencyCondition
DecisionExecutionStrategy
DecisionType
DecisionValue
DeviceKind
ExecutionPolicy
Determines where the runtime attempts to execute a request and whether it may fall back.
InferenceStreamEvent
Input
ModelArchitecture
Output

Type Aliases§

InferenceOutput