Module execution 

Portable execution plans, capabilities, and telemetry. Portable execution-plan and telemetry schemas.

Structs

BackendId

Stable, extensible identity of an execution backend.

DevicePlan

Backend and device selected for one complete model session.

ExecutionPlan

A concrete, backend-neutral set of model/session execution choices.

ExpertCachePlan

Optional independent routed-expert cache selected by a plan.

Enums

DraftPlacementPlan

External assistant placement selected by an execution plan.

DraftingPlan

Speculative decoding selected by an execution plan.

ExecutionPlanError

Execution plan validation error.

ResidencyPlan

Static weight placement selected by an execution plan.

WeightTransformationPlan

Optional load-time transformation applied to checkpoint weights.

Constants

DEFAULT_MAX_CACHED_SHARDS

Default bound for simultaneously open checkpoint payload sources.

EXECUTION_PLAN_SCHEMA_VERSION

Schema version shared by execution-plan documents.