pub struct ExecutorPrefillMaintenanceDeferral { /* private fields */ }Expand description
Non-authoritative projection of plan-runtime maintenance work.
The request id is the only handle returned to the engine. Implementations
must retain the sealed deferral internally and validate it again when
ModelExecutor::maintain_prefill_backing is called.
Implementations§
Source§impl ExecutorPrefillMaintenanceDeferral
impl ExecutorPrefillMaintenanceDeferral
pub fn new( request_id: RequestId, observed: ExecutorAdmissionEpochs, wait_condition: CapacityWaitCondition, stage: ExecutorPrefillMaintenanceStage, blockers: Vec<ExecutorPrefillMaintenanceBlocker>, ) -> Result<Self>
pub fn from_admission( request_id: &RequestId, deferred: &AdmissionDeferred, ) -> Result<Self>
pub fn from_backing( request_id: &RequestId, deferred: &DynamicBackingDeferred, ) -> Result<Self>
pub fn request_id(&self) -> &RequestId
pub const fn observed(&self) -> ExecutorAdmissionEpochs
pub fn wait_condition(&self) -> &CapacityWaitCondition
pub const fn stage(&self) -> ExecutorPrefillMaintenanceStage
pub fn blockers(&self) -> &[ExecutorPrefillMaintenanceBlocker]
Trait Implementations§
Source§impl Clone for ExecutorPrefillMaintenanceDeferral
impl Clone for ExecutorPrefillMaintenanceDeferral
Source§fn clone(&self) -> ExecutorPrefillMaintenanceDeferral
fn clone(&self) -> ExecutorPrefillMaintenanceDeferral
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Eq for ExecutorPrefillMaintenanceDeferral
impl StructuralPartialEq for ExecutorPrefillMaintenanceDeferral
Auto Trait Implementations§
impl Freeze for ExecutorPrefillMaintenanceDeferral
impl RefUnwindSafe for ExecutorPrefillMaintenanceDeferral
impl Send for ExecutorPrefillMaintenanceDeferral
impl Sync for ExecutorPrefillMaintenanceDeferral
impl Unpin for ExecutorPrefillMaintenanceDeferral
impl UnsafeUnpin for ExecutorPrefillMaintenanceDeferral
impl UnwindSafe for ExecutorPrefillMaintenanceDeferral
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more