Struct AdaptiveBatcher 

pub struct AdaptiveBatcher { /* private fields */ }

Adaptive batch size controller.

Implementations

impl AdaptiveBatcher

pub fn new(config: DynamicBatchConfig) -> Self

Create a new adaptive batcher.

pub fn current_batch_size(&self) -> usize

Get current recommended batch size.

pub fn update(&mut self, _batch_size: usize, latency: Duration, throughput: f64)

Update batch size based on observed latency.

pub fn avg_latency(&self) -> Option<Duration>

Get average recent latency.

pub fn avg_throughput(&self) -> Option<f64>

Get average recent throughput.