Skip to main content

context_length_spec

Function context_length_spec 

Source
pub fn context_length_spec(record: &ModelRecord) -> Option<ParamSpec>
Expand description

The context_length spec for a chat/completion model on a runtime that honors it (llama.cpp or Ollama), sized to the model’s declared window.