Expand description
Data loading infrastructure for AxonML neural network training.
Dataset trait + implementations (TensorDataset, MapDataset, ConcatDataset,
SubsetDataset, InMemoryDataset), DataLoader with batching/shuffling/
drop_last/num_workers (rayon-backed), GpuPrefetchIter (background GPU
transfer with bounded channel), samplers (Sequential, Random, Weighted,
Distributed, Batch), transforms (Compose, Normalize, Standardize, MinMaxScale,
RandomCrop, RandomFlip, DropoutTransform, Lambda), and collate functions
(DefaultCollate, StackCollate, stack_tensors, concat_tensors).
§File
crates/axonml-data/src/lib.rs
§Author
Andrew Jewell Sr. — AutomataNexus LLC ORCID: 0009-0005-2158-7060
§Updated
April 14, 2026 11:15 PM EST
§Disclaimer
Use at own risk. This software is provided “as is”, without warranty of any kind, express or implied. The author and AutomataNexus shall not be held liable for any damages arising from the use of this software.
Re-exports§
pub use collate::Collate;pub use collate::DefaultCollate;pub use collate::StackCollate;pub use dataloader::Batch;pub use dataloader::DataLoader;pub use dataloader::DataLoaderIter;pub use dataloader::GpuPrefetchIter;pub use dataset::ConcatDataset;pub use dataset::Dataset;pub use dataset::InMemoryDataset;pub use dataset::MapDataset;pub use dataset::SubsetDataset;pub use dataset::TensorDataset;pub use sampler::BatchSampler;pub use sampler::RandomSampler;pub use sampler::Sampler;pub use sampler::SequentialSampler;pub use sampler::SubsetRandomSampler;pub use sampler::WeightedRandomSampler;pub use transforms::Clamp;pub use transforms::Compose;pub use transforms::DropoutTransform;pub use transforms::Flatten;pub use transforms::Lambda;pub use transforms::Normalize;pub use transforms::RandomCrop;pub use transforms::RandomFlip;pub use transforms::RandomNoise;pub use transforms::Reshape;pub use transforms::Scale;pub use transforms::ToTensor;pub use transforms::Transform;
Modules§
- collate
- Collate - Batch Assembly Functions
- dataloader
DataLoader- Batched Data Iteration- dataset
- Dataset Trait - Core Data Abstraction
- prelude
- Common imports for data loading.
- sampler
- Samplers - Data Access Patterns
- transforms
- Transforms - Data Augmentation and Preprocessing