pub struct IntelligentLoadBalancer { /* private fields */ }Expand description
Intelligent load balancer for multi-GPU workload distribution
Implementations§
Source§impl IntelligentLoadBalancer
impl IntelligentLoadBalancer
Sourcepub fn new(strategy: LoadBalancingStrategy) -> Self
pub fn new(strategy: LoadBalancingStrategy) -> Self
Create a new intelligent load balancer
Sourcepub async fn add_device(&self, device: Arc<GpuDevice>)
pub async fn add_device(&self, device: Arc<GpuDevice>)
Add a device to the load balancer
Sourcepub async fn remove_device(&self, device_id: DeviceId)
pub async fn remove_device(&self, device_id: DeviceId)
Remove a device from the load balancer
Sourcepub async fn distribute_workload(
&self,
workload: &Workload,
) -> UnifiedGpuResult<Vec<DeviceWorkload>>
pub async fn distribute_workload( &self, workload: &Workload, ) -> UnifiedGpuResult<Vec<DeviceWorkload>>
Distribute workload across available devices
Sourcepub async fn record_performance(&self, record: PerformanceRecord)
pub async fn record_performance(&self, record: PerformanceRecord)
Record performance data for adaptive learning
Sourcepub async fn get_performance_stats(
&self,
operation_type: &str,
) -> Option<PerformanceStats>
pub async fn get_performance_stats( &self, operation_type: &str, ) -> Option<PerformanceStats>
Get performance statistics for an operation type
Auto Trait Implementations§
impl Freeze for IntelligentLoadBalancer
impl !RefUnwindSafe for IntelligentLoadBalancer
impl Send for IntelligentLoadBalancer
impl Sync for IntelligentLoadBalancer
impl Unpin for IntelligentLoadBalancer
impl !UnwindSafe for IntelligentLoadBalancer
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.