Skip to main content

read_tokenless_stats

Function read_tokenless_stats 

Source
pub fn read_tokenless_stats() -> CompressionStats
Expand description

Parses the TOKENLESS_TOKENS environment variable into CompressionStats.

Expected format: {"pre":800,"post":300,"experimental":150} Returns CompressionStats::default() if the env var is not set or invalid.