Skip to main content

create_loader

Function create_loader 

Source
pub fn create_loader(
    world_size: usize,
    rank: usize,
    total_samples: usize,
) -> Result<DistributedLoader>
Expand description

Create a distributed loader for a dataset

§Arguments

  • world_size - Total number of workers
  • rank - Rank of this worker
  • total_samples - Total samples in the dataset

§Returns

  • Ok(DistributedLoader) - The loader
  • Err(DatasetsError) - If creation fails