Skip to main content

EngineConfig

Struct EngineConfig 

Source
pub struct EngineConfig {
Show 17 fields pub schema_version: u32, pub model_name: String, pub system_name: String, pub systems_path: Option<PathBuf>, pub backend: BackendKind, pub backend_version: Option<String>, pub forward_model: Option<String>, pub kv_block_size: Option<u32>, pub parallel: ParallelMapping, pub quantization: QuantizationConfig, pub speculative: Option<SpeculativeConfig>, pub enable_shared_layer: Option<bool>, pub strict_provenance: bool, pub database_mode: DatabaseMode, pub tolerate_dirless_version: bool, pub transfer_policy: Option<Vec<String>>, pub extra: BTreeMap<String, String>,
}
Expand description

Static engine identity and setup information carried by an crate::perfmodel::engine::spec::EngineSpec.

Cohesive multi-field groupings (parallel, quantization, speculative) are extracted into sub-structs but #[serde(flatten)]-ed so the wire JSON stays flat. Python (sdk/engine.py) emits a flat object with keys like tp_size, weight_dtype, nextn, which deserialize into the regrouped struct unchanged.

Fields§

§schema_version: u32§model_name: String§system_name: String§systems_path: Option<PathBuf>

Optional override for the bundled systems/ directory. None (the default) uses the resolution path baked into the build/env.

§backend: BackendKind§backend_version: Option<String>§forward_model: Option<String>

Forward-pass modeling mode ("op_level" | "fpm"); None keeps Python’s default (op_level). Threaded to compile_engine so the FPM arena can select the whole-model engine through the supported predictor API (additive-optional: absent in older payloads).

§kv_block_size: Option<u32>§parallel: ParallelMapping§quantization: QuantizationConfig§speculative: Option<SpeculativeConfig>§enable_shared_layer: Option<bool>

Shared-layer (sibling/cross-version) source inheritance on/off. The engine resolves per-op sources ITSELF (perf_database/source_resolution.rs — schema v13; the resolved perf_db_sources map left the wire with the Python resolver). None derives the flag from database_mode (SILICON/HYBRID = on), mirroring Python _shared_layer_enabled; Some carries an explicit override (Python’s shared_layer= kwarg, used by regression harnesses to pin per-version behavior).

§strict_provenance: bool

Fail-closed provenance mode (Python’s strict_provenance / AIC_STRICT_PROVENANCE): malformed sidecar metadata errors the load instead of warn-and-continue. Absent on old specs -> false.

§database_mode: DatabaseMode

Perf-database lookup mode (Python’s database._default_database_mode). SILICON queries collected tables only; HYBRID falls back to the util-space empirical layer on a typed silicon miss; EMPIRICAL always answers SOL/util. Absent on old specs -> Silicon (back-compat).

§tolerate_dirless_version: bool

Directory-less next load (design §14). Set by the Python spec builder ONLY after it resolved the requested version to the fleet-advertised next slot and loaded it without a local version directory (every op rides channel-1 backward fill). Tells the engine reload to skip the missing-directory gate for THIS spec; raw-version and provenance gates are untouched, and native builders never set it (additive-optional: absent in older payloads -> false).

§transfer_policy: Option<Vec<String>>

Enabled empirical transfer kinds as explicit tokens (xshape / xquant / xprofile / xop). Python resolves preset names before serialising, so no preset vocabulary exists on the wire. None = the default ALL-transfers policy (mirrors common.ALL_TRANSFERS).

§extra: BTreeMap<String, String>

Trait Implementations§

Source§

impl Clone for EngineConfig

Source§

fn clone(&self) -> EngineConfig

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for EngineConfig

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for EngineConfig

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl PartialEq for EngineConfig

Source§

fn eq(&self, other: &EngineConfig) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl Serialize for EngineConfig

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for EngineConfig

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more