Module batching 

Request Batching Strategy

This strategy analyzes request patterns and groups similar requests to improve efficiency and reduce costs. It balances latency vs cost savings by:

• Detecting similar requests that can be batched together
• Calculating optimal batch sizes and timeouts
• Analyzing latency-cost tradeoffs
• Managing priority queues for different request types
• Learning from batching effectiveness over time

Example

use processor::decision::batching::BatchingStrategy;
use processor::decision::config::BatchingConfig;

let config = BatchingConfig::default();
let mut strategy = BatchingStrategy::new(config);

Structs

BatchingStrategy

Request Batching Strategy