pub struct LoadStats {
pub total_layers_distributed: usize,
pub total_vram_used_gb: f32,
pub avg_load_balance_ratio: f32,
pub rebalancing_count: usize,
/* private fields */
}Expand description
Load statistics collector
Fields§
§total_layers_distributed: usizeTotal layers distributed
total_vram_used_gb: f32Total VRAM used across cluster
avg_load_balance_ratio: f32Average load balance ratio (0.0 to 1.0)
rebalancing_count: usizeNumber of rebalancing operations
Implementations§
Source§impl LoadStats
impl LoadStats
Sourcepub fn record_distribution(&mut self, num_layers: usize, vram_gb: f32)
pub fn record_distribution(&mut self, num_layers: usize, vram_gb: f32)
Record layer distribution
Sourcepub fn update_balance_ratio(&mut self, ratio: f32)
pub fn update_balance_ratio(&mut self, ratio: f32)
Update load balance ratio
Sourcepub fn record_rebalancing(&mut self)
pub fn record_rebalancing(&mut self)
Record rebalancing operation
Trait Implementations§
Auto Trait Implementations§
impl Freeze for LoadStats
impl RefUnwindSafe for LoadStats
impl Send for LoadStats
impl Sync for LoadStats
impl Unpin for LoadStats
impl UnsafeUnpin for LoadStats
impl UnwindSafe for LoadStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more