Struct burn_core::data::dataloader::BatchDataLoader

pub struct BatchDataLoader<I, O> { /* private fields */ }

A data loader that can be used to iterate over a dataset in batches.

Implementations

impl<I, O> BatchDataLoader<I, O>

pub fn new( strategy: Box<dyn BatchStrategy<I>>, dataset: Arc<dyn Dataset<I>>, batcher: Arc<dyn Batcher<I, O>>, rng: Option<StdRng> ) -> Self

Creates a new batch data loader.

Arguments

• strategy - The batch strategy.
• dataset - The dataset.
• batcher - The batcher.
• rng - The rng determining if the dataset is shuffled each time a dataloader iterator is created.

Returns

The batch data loader.

impl<I, O> BatchDataLoader<I, O>

where I: Send + Sync + Clone + 'static, O: Send + Sync + Clone + 'static,

pub fn multi_thread( strategy: Box<dyn BatchStrategy<I>>, dataset: Arc<dyn Dataset<I>>, batcher: Arc<dyn Batcher<I, O>>, num_threads: usize, rng: Option<StdRng> ) -> MultiThreadDataLoader<O>

Creates a new multi-threaded batch data loader.

Arguments

• strategy - The batch strategy.
• dataset - The dataset.
• batcher - The batcher.
• num_threads - The number of threads.

Returns

The multi-threaded batch data loader.

Trait Implementations

impl<I: Send + Sync + Clone + 'static, O: Send + Sync> DataLoader<O> for BatchDataLoader<I, O>

fn iter<'a>(&'a self) -> Box<dyn DataLoaderIterator<O> + 'a>

Returns a boxed iterator to iterate over the data loader.

fn num_items(&self) -> usize

The number of items (not the number of batches nor the number of iterations), corresponding to the items_total of the progress returned by the iterator.