Structsยง
- Token
Counter - Estimates token counts using the
cl100k_basetokenizer (GPT-4 / Claude compatible). Accuracy is within ~5% across non-OpenAI providers; the budget is a soft guarantee.
cl100k_base tokenizer (GPT-4 / Claude
compatible). Accuracy is within ~5% across non-OpenAI providers; the budget
is a soft guarantee.