pub enum SwarmRole {
Stage,
Coordinator,
}Expand description
Role of a node within a pipeline-parallel inference swarm.
Variants§
Stage
Holds a contiguous block of model layers and streams activations onward (default).
Coordinator
Orchestrates the swarm: accepts requests and drives the ring of stages.
Trait Implementations§
impl Copy for SwarmRole
Source§impl<'de> Deserialize<'de> for SwarmRole
impl<'de> Deserialize<'de> for SwarmRole
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<SwarmRole, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<SwarmRole, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for SwarmRole
Source§impl Serialize for SwarmRole
impl Serialize for SwarmRole
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for SwarmRole
Auto Trait Implementations§
impl Freeze for SwarmRole
impl RefUnwindSafe for SwarmRole
impl Send for SwarmRole
impl Sync for SwarmRole
impl Unpin for SwarmRole
impl UnsafeUnpin for SwarmRole
impl UnwindSafe for SwarmRole
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.