Skip to main content

Module async_prefetch

Module async_prefetch 

Source
Expand description

Async prefetch for parallel I/O in streaming datasets.

Provides AsyncPrefetchDataset which spawns a background task to read batches ahead of time, reducing I/O latency in the training loop.

Structsยง

AsyncPrefetchBuilder
Builder for creating async prefetch datasets.
AsyncPrefetchDataset
A streaming dataset with async prefetch for parallel I/O.
SyncPrefetchDataset
Synchronous wrapper for async prefetch that works with DataLoader.