pub enum WorkloadType {
LlmInference,
ImageGeneration,
VideoGeneration,
}Expand description
Types of workloads the Arbiter manages.
Variants§
LlmInference
LLM inference (Infernum).
ImageGeneration
Image generation (Dantalion diffusion).
VideoGeneration
Video generation (Dantalion video diffusion).
Implementations§
Source§impl WorkloadType
impl WorkloadType
Sourcepub fn min_quality(self) -> f32
pub fn min_quality(self) -> f32
Returns the minimum quality threshold for this workload.
Below this, results are too degraded to be useful.
Sourcepub fn target_quality(self) -> f32
pub fn target_quality(self) -> f32
Returns the target quality for this workload at full resources.
Sourcepub fn typical_memory_mb(self) -> u64
pub fn typical_memory_mb(self) -> u64
Returns typical memory usage estimate in bytes.
Sourcepub fn is_streaming(self) -> bool
pub fn is_streaming(self) -> bool
Returns whether this workload type is streaming (continuous output).
Trait Implementations§
Source§impl Clone for WorkloadType
impl Clone for WorkloadType
Source§fn clone(&self) -> WorkloadType
fn clone(&self) -> WorkloadType
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for WorkloadType
impl Debug for WorkloadType
Source§impl<'de> Deserialize<'de> for WorkloadType
impl<'de> Deserialize<'de> for WorkloadType
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Hash for WorkloadType
impl Hash for WorkloadType
Source§impl PartialEq for WorkloadType
impl PartialEq for WorkloadType
Source§impl Serialize for WorkloadType
impl Serialize for WorkloadType
impl Copy for WorkloadType
impl Eq for WorkloadType
impl StructuralPartialEq for WorkloadType
Auto Trait Implementations§
impl Freeze for WorkloadType
impl RefUnwindSafe for WorkloadType
impl Send for WorkloadType
impl Sync for WorkloadType
impl Unpin for WorkloadType
impl UnwindSafe for WorkloadType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more