Module automatic 

Backend-neutral automatic execution planning. Backend-neutral automatic execution planning.

Backends report hardware, artifact resources, and candidate admission. This module owns policy validation, resource budgeting, plan selection, feedback matching, and the serialized planning and telemetry documents.

Structs

AllocatorTelemetry

Backend allocator observations for one execution.

AutomaticPlanRequest

Owned input to one automatic planning session.

AutomaticPlanner

Backend-neutral automatic planner.

AutomaticPlannerPolicy

Tunable, serializable automatic-planning policy.

BoundedResidencyRequirement

Exact bounded device-window requirement established by a backend probe.

CandidateAdmission

Backend candidate-admission result consumed by the neutral planner.

DurationSeconds

Floating-point duration wrapper with equality based on its bit pattern.

ExecutionPlanReport

Complete automatic-planning document suitable for JSON persistence.

ExecutionPlanTarget

One target-backend instance and load policy realized from a portable execution plan.

ExecutionTelemetry

Stable JSON telemetry for one completed model execution.

ExpertCacheTelemetry

Routed-expert cache occupancy summary.

ExternalDraftArtifact

Architecture-prepared assistant artifact and proven portable tokenizer compatibility.

HardwareBackendProfile

Availability and devices for one execution backend.

HardwareDeviceProfile

One logical device visible to an execution backend.

HardwareProfile

Hardware and memory observations used as automatic-planning inputs.

ModelResourceProfile

Architecture and header-derived planning facts used before a model is loaded.

PlanExplanation

Explanation accompanying a selected execution plan.

PlanExplanationEntry

One stable, machine-routable planner explanation entry.

ResidencyTelemetry

Logical bytes and transfers reported by bounded parameter residency.

SpeculativeDecodingTelemetry

Speculative-decoding observations for one request.

TimingTelemetry

Timings reported for one generation request.

TokenizerCompatibilityError

A target and external assistant do not share the same token-id vocabulary mapping.

TokenizerCompatibilityProof

Proof that a target and external assistant use the same token-id vocabulary mapping.

TransferTelemetry

One logical residency transfer counter.

Enums

AutomaticPlanningError

Failure produced by portable planning or its selected backend adapter.

HardwareMemorySemantics

Serializable form of physical host/device memory semantics.

ObservationKind

Confidence attached to an observed or derived value.

Observed

A value which remains explicit when the runtime cannot produce it.

PlanExplanationLevel

Severity of one planner explanation entry.

RealizedDrafting

Backend-owned drafting resources realized for one complete execution plan.

Constants

AUTOMATIC_SCHEMA_VERSION

Schema version shared by automatic-planning and telemetry documents.

Traits

AutomaticPlanningBackend

High-level observations a backend supplies to the neutral planner.

ExecutionPlanBackendFactory

Creates an executable whole-model backend from a portable execution plan.

Functions

realize_execution_plan_drafting

Validates and realizes the drafting portion of a portable execution plan.

realize_execution_plan_target

Validates and realizes the target portion of a portable execution plan.