Expand description
Token-optimal encoding based on empirical lab results.
Uses a lookup table (concept -> optimal representation) derived from Experiment C’s cross-tokenizer analysis. Falls back to identity when no optimizations are known.
Token-optimal encoding based on empirical lab results.
Uses a lookup table (concept -> optimal representation) derived from Experiment C’s cross-tokenizer analysis. Falls back to identity when no optimizations are known.