Struct ItemBatcher 

pub struct ItemBatcher {
    pub max_items_per_batch: usize,
    pub max_bytes_per_batch: usize,
}

Configuration for batching items in map operations.

Fields

max_items_per_batch: usize

Maximum number of items per batch.

max_bytes_per_batch: usize

Maximum total bytes per batch.

Implementations

impl ItemBatcher

pub fn new(max_items_per_batch: usize, max_bytes_per_batch: usize) -> Self

Creates a new ItemBatcher with the specified limits.

pub fn batch<T: Serialize + Clone>(&self, items: &[T]) -> Vec<(usize, Vec<T>)>

Batches items according to configuration, respecting both item count and byte limits.

This method groups items into batches where each batch:

• Contains at most max_items_per_batch items
• Has an estimated total size of at most max_bytes_per_batch bytes

Item size is estimated using JSON serialization via serde_json.

Arguments

• items - The slice of items to batch

Returns

A vector of (start_index, batch) tuples where:

• start_index is the index of the first item in the batch from the original slice
• batch is a vector of cloned items in that batch

Example

use durable_execution_sdk::ItemBatcher;

let batcher = ItemBatcher::new(2, 1024);
let items = vec!["a", "b", "c", "d", "e"];
let batches = batcher.batch(&items);

// Items are grouped into batches of at most 2 items each
assert_eq!(batches.len(), 3);
assert_eq!(batches[0], (0, vec!["a", "b"]));
assert_eq!(batches[1], (2, vec!["c", "d"]));
assert_eq!(batches[2], (4, vec!["e"]));

Trait Implementations

impl Clone for ItemBatcher

fn clone(&self) -> ItemBatcher

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ItemBatcher

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ItemBatcher

fn default() -> Self

Returns the “default value” for a type.