Struct AutoScaler 

pub struct AutoScaler { /* private fields */ }

Auto-scaler for dynamic node management

Implementations

impl AutoScaler

pub fn new(config: AutoScalerConfig) -> Self

pub fn with_node_provider(self, provider: Arc<dyn NodeProvider>) -> Self

Attach a NodeProvider so scaling decisions can act on a real cluster substrate (or an explicit SimulatedNodeProvider) instead of update_and_scale returning TrustformersError::invalid_state whenever it decides to scale up or down.

pub fn with_min_nodes(self, min_nodes: usize) -> Self

Builder pattern for configuration

pub fn with_max_nodes(self, max_nodes: usize) -> Self

pub fn with_scaling_strategy(self, strategy: ScalingStrategy) -> Self

pub fn with_scale_up_threshold(self, threshold: f32) -> Self

pub fn with_scale_down_threshold(self, threshold: f32) -> Self

pub fn update_and_scale( &mut self, metrics: &PerformanceMetrics, ) -> Result<ScalingDecision>

Update performance metrics, decide on scaling, and – when the decision is to scale up or down – execute it. Executing needs a NodeProvider (see Self::with_node_provider); with none attached this returns TrustformersError::invalid_state whenever the decision is ScalingDecision::ScaleUp/ScalingDecision::ScaleDown rather than silently deciding without acting, or acting without a real substrate. ScalingDecision::NoAction never needs a provider.

pub fn get_current_nodes(&self) -> usize

pub fn get_scaling_history(&self) -> &[ScalingEvent]