Expand description
Streaming JSONL loader. Each line is one situation { "tokens": [...], "num": {...} }; the line
index (0-based) is the situation id. Builds token -> ascending sids in a single pass — the sids
land in id order for free, so the index build hits the fast sorted path.
Functions§
- load
- Returns (token -> sids, n_situations).