Crate mako

mako is a high performance data handling library

Modules

batching	Batching module contains several utilities for dealing with batches, such as shuffling and sorting batches
len	Len contains the Len trait implemented for several types
tokenization	Tokenization module handles all tokenization and untokenization
vocab	Vocab module contains the Railgun vocab object and the functions to load different vocabularies