Skip to main content

estimator_for_model

Function estimator_for_model 

Source
pub fn estimator_for_model(_model: &str) -> TokenEstimator
Expand description

Resolve the estimator for a model. No provider tokenizer crate is linked today, so every model — Anthropic, OpenAI, Google, unknown — uses the conservative estimator (spec §9.1: tokenizers where available, conservative estimators otherwise).