pub enum WorkerType {
Aggregated,
Prefill,
Decode,
}Expand description
Worker type for disaggregated serving configurations
Variants§
Aggregated
Standard aggregated worker handling both prefill and decode
Prefill
Dedicated prefill worker in disaggregated mode
Decode
Dedicated decode worker in disaggregated mode
Trait Implementations§
Source§impl Clone for WorkerType
impl Clone for WorkerType
Source§fn clone(&self) -> WorkerType
fn clone(&self) -> WorkerType
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for WorkerType
Source§impl Debug for WorkerType
impl Debug for WorkerType
Source§impl Default for WorkerType
impl Default for WorkerType
Source§fn default() -> WorkerType
fn default() -> WorkerType
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for WorkerType
impl<'de> Deserialize<'de> for WorkerType
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for WorkerType
Source§impl FromStr for WorkerType
impl FromStr for WorkerType
Source§impl PartialEq for WorkerType
impl PartialEq for WorkerType
Source§impl Serialize for WorkerType
impl Serialize for WorkerType
impl StructuralPartialEq for WorkerType
Auto Trait Implementations§
impl Freeze for WorkerType
impl RefUnwindSafe for WorkerType
impl Send for WorkerType
impl Sync for WorkerType
impl Unpin for WorkerType
impl UnsafeUnpin for WorkerType
impl UnwindSafe for WorkerType
Blanket Implementations§
impl<T> BlockMetadata for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.