Struct MultiThreadDataLoader 

pub struct MultiThreadDataLoader<B: Backend, I, O> { /* private fields */ }

Available on crate features dataset and std only.

A multi-threaded data loader that can be used to iterate over a dataset.

Dropping an iterator stops prefetching and waits for any dataset read or batch construction already in progress to return. Workers are joined unless reuse is explicitly enabled with Self::reuse_workers.

Implementations

impl<B: Backend, I, O> MultiThreadDataLoader<B, I, O>

where I: Send + Sync + Clone + 'static, O: Send + 'static,

pub fn new( strategy: Box<dyn BatchStrategy<I>>, dataset: Arc<dyn Dataset<I>>, batcher: Arc<dyn Batcher<B, I, O>>, num_threads: usize, device: B::Device, rng: Option<StdRng>, ) -> Self

Creates a new multi-threaded batch data loader.

Arguments

• strategy - The batch strategy.
• dataset - The dataset.
• batcher - The batcher.
• num_threads - The number of threads.
• device - The device to use when loading a batch.
• rng - The rng determining if the dataset is shuffled each time a dataloader iterator is created.

Returns

The multi-threaded batch data loader.

pub fn reuse_workers(self, enabled: bool) -> Self

Enables reuse of idle workers across iterations (disabled by default).

Finishing or dropping an iterator still waits for its in-flight reads and batch construction. Concurrent iterators use separate transient workers when the reusable pool is busy, rather than waiting behind another epoch. A panicked worker is joined; failed batches are never automatically replayed.

pub fn batch_reading(self, enabled: bool) -> Self

Enables batch dataset reads for every worker (default: false).

Missing items or a mismatched result length panic without rereading; the iterator propagates worker failures using its existing shutdown behavior.

Trait Implementations

impl<B: Backend, I, O> DataLoader<B, O> for MultiThreadDataLoader<B, I, O>

where I: Send + Sync + Clone + 'static, O: Send + 'static + Debug,

fn iter<'a>(&'a self) -> Box<dyn DataLoaderIterator<O> + 'a>

Returns a boxed iterator to iterate over the data loader.

fn num_items(&self) -> usize

The number of items (not the number of batches nor the number of iterations), corresponding to the items_total of the progress returned by the iterator.

fn to_device(&self, device: &B::Device) -> Arc<dyn DataLoader<B, O>>

Move the data loader to the given device, ensuring the batches are assigned to the correct device.

fn slice(&self, start: usize, end: usize) -> Arc<dyn DataLoader<B, O>>

Returns a new data loader containing a subset of the data.