Skip to main content

default_context_limit

Function default_context_limit 

Source
pub fn default_context_limit(model_id: &str) -> usize
Expand description

Returns the default context limit (in tokens) for a known model ID.

Uses prefix matching against known model families. Unknown models return 8192 as a conservative default.