pub fn ner_batch_size() -> usizeExpand description
Batch size for BERT NER forward passes.
Larger values amortise fixed forward-pass overhead but increase peak RAM. Memory guide (CPU only, max 512-token windows): N=4 → ~54 MiB peak N=8 → ~108 MiB peak ← default N=16 → ~216 MiB peak N=32 → ~432 MiB peak (not recommended without 16+ GiB RAM)
Override via GRAPHRAG_NER_BATCH_SIZE env var. Values outside [1, 32] are
clamped silently.