Skip to main content

context_window_for

Function context_window_for 

Source
pub fn context_window_for(model: &str) -> Option<u32>
Expand description

Infer context window size from model name. Honours the CONTEXT_SIZE env variable first so users can override.