Mako
Mako is the main Sidekick AI data processing library. Docs to come.
To Do:
- Make iterator non-consuming
- Add collate function support to dataloader
- Make tokenizer loading more efficient
- Add dataloader support to python wrapper (not sure if this is possible)