libphext 0.3.1

A rust-native implementation of phext
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
* support common file formats
  * tar
  * zip
  * sqlite
  * csv
  * sql
* non-linear flows
  Q: what happens to information as it flows along a path of phext coordinates?
  say we want to define stable regions early in the file...
  we could define a phext-based mask to assist with indexing
* hierarchical mobs
* DB emulation
* memory-mapped I/O
* investigate data sources
  * https://huggingface.co/learn/nlp-course/chapter2/4?fw=pt
  * https://commoncrawl.org/get-started
  * https://medium.com/@zolayola/public-data-sets-in-the-era-of-llms-0a4e89bda658