pub struct PreparedProductionModel { /* private fields */ }Expand description
One immutable semantic family and the exact indexed weight source used to initialize its execution plan. Keeping them together prevents product code from resolving a family from one model directory and loading bytes from another.
Implementations§
Source§impl PreparedProductionModel
impl PreparedProductionModel
pub fn family(&self) -> &PreparedModelFamily
pub fn weights(&self) -> &dyn WeightComponentSource
pub fn weight_source(&self) -> &Arc<dyn WeightComponentSource> ⓘ
pub fn descriptor(&self) -> &CausalLanguageModelDescriptor
pub fn sources(&self) -> &Arc<ProductionModelSourceBundle> ⓘ
pub fn product_source_identity( &self, requested_model: impl Into<String>, resolved_model: impl Into<String>, ) -> Result<ProductModelSourceIdentity>
pub const fn execution_kind(&self) -> ProductionExecutionKind
Sourcepub fn model_capabilities(&self) -> Result<ModelCapabilities>
pub fn model_capabilities(&self) -> Result<ModelCapabilities>
Projects the immutable typed package into startup auto-configuration. Fixed sequence state comes directly from the semantic program; token- scaled state (for example KV) remains under the plan/runtime capacity policy and is deliberately not double-counted here.
Sourcepub fn model_info(&self, model_id: ModelId, device: Device) -> ModelInfo
pub fn model_info(&self, model_id: ModelId, device: Device) -> ModelInfo
Projects typed package facts into the transitional ModelExecutor
metadata contract. The family id is descriptive only and never drives
executor selection.
Trait Implementations§
Auto Trait Implementations§
impl !RefUnwindSafe for PreparedProductionModel
impl !UnwindSafe for PreparedProductionModel
impl Freeze for PreparedProductionModel
impl Send for PreparedProductionModel
impl Sync for PreparedProductionModel
impl Unpin for PreparedProductionModel
impl UnsafeUnpin for PreparedProductionModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more