Crate aiconfigurator_core 

Rust-native core latency API for AIConfigurator.

The compiled-engine path is the only supported entry point: Python’s compile_engine walks the model once and emits an engine::spec::EngineSpec (op lists + EngineConfig identity); the Rust engine::Engine executes it without re-entering Python. AicEngineBuilder is the preferred Rust → Python → Rust embedded build entry point. AicEngine is the PyO3 hot-path pyclass.

Re-exports

pub use memory::estimate_kv_cache;

pub use memory::EstimateSource;

pub use memory::KvCacheEstimate;

pub use memory::KvCacheEstimateAdjusted;

pub use memory::KvCacheEstimateError;

pub use memory::KvCacheEstimateOptions;

pub use memory::KvCacheEstimateRequest;

pub use memory::KvCacheMemoryFraction;

pub use memory::MemoryBreakdown;

Modules

engine

Compiled-engine layer.

memory

KV-cache memory estimation.

Structs

AicEngine

PyO3 wrapper around the Engine: a compiled engine the Python sweep / Mocker bridge drives per point.

AicEngineBuilder

Ergonomic builder for the Rust -> Python -> Rust compiled-engine entry point.

EngineConfig

Static engine identity and setup information carried by an crate::engine::spec::EngineSpec.

ForwardPassMetrics

Per-iteration forward-pass metrics.

ForwardPassPerfDiagnostics

Current readiness and tuning state for a ForwardPassPerfModel.

ForwardPassPerfModel

Forward-pass-level performance model with optional online tuning.

ForwardPassPerfOptions

In-memory tuning controls for ForwardPassPerfModel.

ParallelMapping

Parallelism layout. Flattened into EngineConfig so the flat wire keys (tp_size, pp_size, …) parse unchanged.

QuantizationConfig

Precision/quantization dtypes. Flattened into EngineConfig. Field names and types are unchanged from the former flat struct so the flat wire keys (weight_dtype, moe_dtype, …) parse unchanged.

QueuedRequestMetrics

Metrics for requests queued but not scheduled in one iteration.

ScheduledRequestMetrics

Metrics for requests scheduled in one forward-pass iteration.

SpeculativeConfig

Multi-Token Prediction speculative-decoding parameters. Wrapped in Option<> on EngineConfig so models without MTP don’t carry the noise, and #[serde(flatten)]-ed so the flat wire key (nextn) parses unchanged. Accepted-token progress is modeled above aic-core.

Enums

AicError

All errors surfaced by the Rust core.

BackendKind

Backend performance database family.

DataType

Precision/quantization dtypes carried on the engine-config wire.

ForwardPassPerfReadiness

Readiness state reported by ForwardPassPerfDiagnostics.

ForwardPassPerfSource

Prediction backend currently used by ForwardPassPerfModel.

Constants

ENGINE_CONFIG_SCHEMA_VERSION

ENGINE_SPEC_SCHEMA_VERSION

FPM_VERSION

Wire-schema version for ForwardPassMetrics (Dynamo’s scheduler telemetry). The FPM input is rejected with AicError::UnsupportedSchemaVersion when version does not match.