Module output 

Output layer: document formatting and sharded file writing.

Modules

format

Rendering an extracted page into its output representation, byte-matching wikiextractor: <doc> blocks repeat the title as the first text line and end with a blank line; JSON lines carry ids as strings and use Python’s json.dumps defaults (", " / ": " separators, ensure_ascii).

writer

Document sinks: wikiextractor-compatible sharded output files (OUTPUT/AA/wiki_00, rolling over at a size limit) or stdout.