Skip to main content

Module profile

Module profile 

Source
Expand description

The parameter-schema system: which tunable parameters a model exposes, assembled from capability- and runtime-specific profiles.

Structs§

ModelProfile
A set of parameter specs that applies to any model the matches predicate accepts.
ProfileRegistry
A collection of profiles that together determine a model’s parameter schema.

Functions§

context_length_spec
The context_length spec for a chat/completion model on a runtime that honors it (llama.cpp or Ollama), sized to the model’s declared window.