Skip to main content

BYTES_PER_TOKEN

Constant BYTES_PER_TOKEN 

Source
pub const BYTES_PER_TOKEN: u64 = 4;
Expand description

Bytes per token, typical: the rate every budget that crosses the two units is converted at. It is an estimate for English prose and code, and it is deliberately not the worst-case ratio INTERVAL_CAP_BYTES reasons from - a budget that has to hold is sized by the worst case, a budget that has to be spent is sized by the typical one.