pub struct ProgramPlanCompileOptions { /* private fields */ }Expand description
Explicit semantic inputs, per-node selection preferences, and optional completion diagnostics for compiling a model program. Product input capacities are required because they bound request-lifetime backing; the compiler never guesses a one-token capacity.
Implementations§
Source§impl ProgramPlanCompileOptions
impl ProgramPlanCompileOptions
pub fn new( input_tensor_specs: BTreeMap<ProgramValueId, ProgramTensorSpec>, ) -> Result<Self, VNextError>
Sourcepub fn insert_tensor_spec(
&mut self,
value_id: ProgramValueId,
tensor: ProgramTensorSpec,
) -> Result<(), VNextError>
pub fn insert_tensor_spec( &mut self, value_id: ProgramValueId, tensor: ProgramTensorSpec, ) -> Result<(), VNextError>
Adds an explicit tensor for an intermediate/output whose contract is intentionally not inferable (for example a non-contiguous layout).
pub fn require_capability(&mut self, node_id: NodeId, capability: CapabilityId)
pub fn prefer_provider(&mut self, node_id: NodeId, provider_id: ProviderId)
Sourcepub fn retain_completion_value(&mut self, value_id: ProgramValueId) -> bool
pub fn retain_completion_value(&mut self, value_id: ProgramValueId) -> bool
Retains one semantic activation until the terminal completion fence for an explicit diagnostic readback. Normal product plans leave this empty.
Sourcepub fn retain_all_outputs_for_determinism(
&mut self,
family: &PreparedModelFamily,
) -> Result<(), VNextError>
pub fn retain_all_outputs_for_determinism( &mut self, family: &PreparedModelFamily, ) -> Result<(), VNextError>
Configures a diagnostic plan whose every operation output remains readable after the terminal completion fence.
pub fn completion_retention(&self) -> &CompletionRetentionSpec
pub fn tensor_specs(&self) -> &BTreeMap<ProgramValueId, ProgramTensorSpec>
pub fn require_weight_materializer( &mut self, materializer_id: WeightMaterializerId, )
pub fn weight_materializer_id(&self) -> &WeightMaterializerId
Trait Implementations§
Source§impl Clone for ProgramPlanCompileOptions
impl Clone for ProgramPlanCompileOptions
Source§fn clone(&self) -> ProgramPlanCompileOptions
fn clone(&self) -> ProgramPlanCompileOptions
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProgramPlanCompileOptions
impl Debug for ProgramPlanCompileOptions
impl Eq for ProgramPlanCompileOptions
impl StructuralPartialEq for ProgramPlanCompileOptions
Auto Trait Implementations§
impl Freeze for ProgramPlanCompileOptions
impl RefUnwindSafe for ProgramPlanCompileOptions
impl Send for ProgramPlanCompileOptions
impl Sync for ProgramPlanCompileOptions
impl Unpin for ProgramPlanCompileOptions
impl UnsafeUnpin for ProgramPlanCompileOptions
impl UnwindSafe for ProgramPlanCompileOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more