Module runtime_api 

Runtime abstraction surface needed to drive backends directly (e.g. parity tests that construct and compare the ort and candle encoder sessions).

Structs

Shape

Normalized tensor shape independent of any runtime backend.

Tensor

Owned, cheaply cloneable tensor value used by the runtime abstraction layer.

Enums

RuntimeError

Errors produced by the runtime abstraction layer.

TensorData

Owned tensor storage for the supported element types.

TensorDataView

Zero-copy borrow of tensor storage.

Traits

Runtime

Owns loaded sessions. One runtime per Engine.

RuntimeFactory

Creates a Runtime configured for a specific execution provider.

RuntimeSession

One loaded model session: encoder, decoder, or joiner.

Functions

cpu_factory

Returns a CPU-only ort factory for auxiliary models.

production_factory

Returns a production ort factory that preserves the provider selection and disk-cache layout used by the engine before the runtime abstraction.