Skip to main content

effective_window

Function effective_window 

Source
pub fn effective_window(
    record: &ModelRecord,
    requested_context_length: Option<i64>,
) -> Option<i64>
Expand description

The effective context window for record, honoring a per-runtime policy. A built-in model has a fixed window; other runtimes derive it from the record’s declared context length (and, for Ollama, a caller override).