pub enum Command {
Submit(Request),
SubmitHandoffPrefill {
handoff_id: HandoffId,
request: Request,
},
ReserveDestination {
handoff_id: HandoffId,
request: Request,
},
ActivateDestination {
handoff_id: HandoffId,
},
ReleaseSource {
handoff_id: HandoffId,
},
CancelSource {
handoff_id: HandoffId,
},
CancelDestination {
handoff_id: HandoffId,
},
CancelRequest {
request_id: Uuid,
discard_pending_output: bool,
},
}Expand description
Commands supported by the standalone scheduler.
Variants§
Submit(Request)
Submit one request.
SubmitHandoffPrefill
Submit a request whose completed prefill KV must remain source-held.
ReserveDestination
Accept a decode request and reserve its destination KV footprint.
ActivateDestination
Make a reserved destination runnable after transfer completion.
ReleaseSource
Release a successfully transferred source hold.
CancelSource
Cancel pending or held source ownership.
CancelDestination
Cancel pending, reserved, or active destination ownership.
CancelRequest
Cancel one request.
A command that removes scheduler-owned state also suppresses output
retained by an in-flight pass. discard_pending_output additionally
requests suppression when scheduler cancellation is a no-op, which is
needed after an external driver has already retired the request.
Trait Implementations§
impl Eq for Command
impl StructuralPartialEq for Command
Auto Trait Implementations§
impl Freeze for Command
impl RefUnwindSafe for Command
impl Send for Command
impl Sync for Command
impl Unpin for Command
impl UnsafeUnpin for Command
impl UnwindSafe for Command
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.