pub struct AsyncDataLoaderConfig {
pub batch_size: usize,
pub shuffle: bool,
pub drop_last: bool,
pub dtype: DType,
pub num_workers: usize,
pub prefetch_factor: usize,
pub seed: Option<u64>,
}Expand description
Configuration for the async prefetching data loader.
Fields§
§batch_size: usizeNumber of samples per batch.
shuffle: boolWhether to shuffle indices each epoch.
drop_last: boolWhether to drop the last incomplete batch.
dtype: DTypeDType for the created tensors.
num_workers: usizeNumber of background workers (threads) for loading + transforming. 0 = no background threads (falls back to sync loading, with prefetch still happening on a single background thread).
prefetch_factor: usizeHow many batches to pre-load ahead of the consumer. Total buffered batches = prefetch_factor * max(num_workers, 1).
seed: Option<u64>Optional random seed for reproducible shuffling.
Implementations§
Source§impl AsyncDataLoaderConfig
impl AsyncDataLoaderConfig
pub fn batch_size(self, bs: usize) -> Self
pub fn shuffle(self, s: bool) -> Self
pub fn drop_last(self, d: bool) -> Self
pub fn dtype(self, d: DType) -> Self
pub fn num_workers(self, n: usize) -> Self
pub fn prefetch_factor(self, pf: usize) -> Self
pub fn seed(self, s: u64) -> Self
Trait Implementations§
Source§impl Clone for AsyncDataLoaderConfig
impl Clone for AsyncDataLoaderConfig
Source§fn clone(&self) -> AsyncDataLoaderConfig
fn clone(&self) -> AsyncDataLoaderConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AsyncDataLoaderConfig
impl Debug for AsyncDataLoaderConfig
Auto Trait Implementations§
impl Freeze for AsyncDataLoaderConfig
impl RefUnwindSafe for AsyncDataLoaderConfig
impl Send for AsyncDataLoaderConfig
impl Sync for AsyncDataLoaderConfig
impl Unpin for AsyncDataLoaderConfig
impl UnsafeUnpin for AsyncDataLoaderConfig
impl UnwindSafe for AsyncDataLoaderConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more