pub fn context_length_spec(record: &ModelRecord) -> Option<ParamSpec>Expand description
The context_length spec for a chat/completion model on a runtime that honors
it (llama.cpp or Ollama), sized to the model’s declared window.
pub fn context_length_spec(record: &ModelRecord) -> Option<ParamSpec>The context_length spec for a chat/completion model on a runtime that honors
it (llama.cpp or Ollama), sized to the model’s declared window.