Skip to main content

Crate ml_runtime_inference

Crate ml_runtime_inference 

Source

Structs§

Audio
DecisionExecution
DecisionOption
DecisionProvenance
DecisionQuestion
DecisionRequest
A model-neutral request for one or more typed decisions about immutable input state.
DecisionResult
ExecutionMetadata
Image
InferenceChunk
InferenceOptions
InferenceRequest
InferenceResult
ModelDescription
ModelIdentity
Tensor
TypedDecision

Enums§

DecisionType
DecisionValue
ExecutionPolicy
Determines where the runtime attempts to execute a request and whether it may fall back.
InferenceStreamEvent
Input
Output

Type Aliases§

InferenceOutput