Expand description
Mako is a high performance data handling library
Modulesยง
- batching
- Batching module contains several utilities for dealing with batches, such as shuffling and sorting batches
- dataloader
- Dataloader module contains the main dataloader struct, as well as dataloader utilities
- pipeline
- Pipeline module contains the dataflow pipeline struct, as well as all pipeline utilities
- tokenization
- Tokenization module handles all tokenization and untokenization
- vocab
- Vocab module contains the mako vocab object and the functions to load different vocabularies