pub struct ExecutionPlan {
pub plan_id: String,
pub model_id: String,
pub provider_id: String,
pub execution_mode: ExecutionMode,
pub estimated_latency_ms: u32,
pub kv_profile: KVProfile,
pub constraints: PlacementConstraints,
pub trust_profile: TrustProfile,
}Expand description
A resolved execution plan for a model inference session.
Fields§
§plan_id: StringUnique plan identifier.
model_id: StringModel being executed.
provider_id: StringProvider peer ID selected for this plan.
execution_mode: ExecutionModeSelected execution mode.
estimated_latency_ms: u32Estimated end-to-end latency in milliseconds.
kv_profile: KVProfileKV-cache profile to use.
constraints: PlacementConstraintsPlacement constraints applied.
trust_profile: TrustProfileTrust profile of the selected provider.
Trait Implementations§
Source§impl Clone for ExecutionPlan
impl Clone for ExecutionPlan
Source§fn clone(&self) -> ExecutionPlan
fn clone(&self) -> ExecutionPlan
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ExecutionPlan
impl Debug for ExecutionPlan
Source§impl Default for ExecutionPlan
impl Default for ExecutionPlan
Source§fn default() -> ExecutionPlan
fn default() -> ExecutionPlan
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for ExecutionPlan
impl<'de> Deserialize<'de> for ExecutionPlan
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for ExecutionPlan
impl RefUnwindSafe for ExecutionPlan
impl Send for ExecutionPlan
impl Sync for ExecutionPlan
impl Unpin for ExecutionPlan
impl UnsafeUnpin for ExecutionPlan
impl UnwindSafe for ExecutionPlan
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more