Skip to main content

Module jsonl

Module jsonl 

Source
Expand description

Streaming JSONL loader. Each line is one situation { "tokens": [...], "num": {...} }; the line index (0-based) is the situation id. Builds token -> ascending sids in a single pass — the sids land in id order for free, so the index build hits the fast sorted path.

Functions§

load
Returns (token -> sids, n_situations).