Skip to main content

Module kernel

Module kernel 

Source
Expand description

The Kernel trait and kernel-match / cost types (§4.2).

Structs§

Cost
A cost estimate for running a kernel, consumed by the placement cost model (docs/ORT2.md §6). All time fields are in microseconds; a fuller model (roofline, calibration) lands in onnx-runtime-cost-model (Phase 2).
KernelVariantSelection
The concrete implementation selected by a kernel’s internal dispatcher.
ViewOutput
A zero-copy view output: a kernel’s declaration that one of its outputs is a strided view aliasing one of its inputs’ buffers, rather than freshly computed bytes (docs/ORT2.md §5.4, lazy PyTorch-style views).

Enums§

CaptureSupport
Whether a compiled kernel can participate in device-graph capture.
KernelInput
An executor-delivered kernel input. Existing EPs receive Tensor variants; an EP advertising the nxrt capability may receive a lazy Weight at the pkg.nxrt::BlockQuantizedMoE boundary.
KernelMatch
Result of crate::ExecutionProvider::supports_op.

Constants§

ARG_KERNEL_VARIANT
Trace-argument key carrying the selected kernel implementation.
ARG_KERNEL_VARIANT_REASON
Trace-argument key carrying why the kernel variant was selected.

Traits§

Kernel
A kernel ready to execute a specific op with specific shapes (§4.2).

Functions§

kernel_variant_tracing_enabled
Whether kernel-variant trace annotations would currently be recorded.
record_kernel_variant_selection
Record a selected kernel variant on the active runtime trace span.
record_kernel_variant_stage_selection
Record a selected kernel variant for a named sub-decision of the current op.