Expand description
Human rendering – the cosmetic table, free to evolve. The stable
machine contract (--format json) is a separate concern (V9, T3).
Structs§
- Method
- A tier’s method label and whether its number is a crude estimate.
The
~marks only the dummy tier; bpe/exact are a real tokenizer’s true count and drop it (V3). - Style
- How to render:
summarizecollapses to the total line,humanabbreviates counts. A struct, not two bool params – the fn-params bool limit is 1 (clippy.toml).
Constants§
- DUMMY
- Dummy tier: bytes/4, crude -> carries the tilde.
- O200K
- The bpe tier: o200k_base, a real tokenizer’s true count -> no tilde.
Functions§
- human
- Compact human size:
37k,1M. Integer-truncated – precision is not the point of-h, and the exact number is one flag away. - report
- The estimate report. The total names its method; every count carries
its unit and, for a crude tier, the
~estimate marker (V3). - total
- Total tokens, saturating – a token counter never panics on overflow.