pub fn tokenizer_fallback_enabled() -> boolExpand description
Read the current flag value. Cheap — single Mutex acquisition.
Called once per run_streaming_legacy_path chunking decision
(per-flow, not per-token), so the lock contention is
negligible.