Expand description
Per-model configuration: the parameter schema a model exposes, merging saved values and the system prompt into requests, and context-window budgeting.
Re-exports§
pub use configuration::dropping_vanished_param_values;pub use configuration::merged;pub use configuration::normalized_param_values;pub use context_budget::BUILTIN_CONTEXT_WINDOW;pub use context_budget::COMPLETION_FLOOR;pub use context_budget::Verdict;pub use context_budget::assess;pub use context_budget::effective_window;pub use context_budget::estimated_tokens;pub use context_budget::prompt_characters;pub use context_budget::stored_context_length;pub use fit::FitAssessment;pub use fit::FitVerdict;pub use profile::ModelProfile;pub use profile::ProfileRegistry;pub use profile::context_length_spec;
Modules§
- configuration
- Merging a model’s saved configuration into a request: keeping only parameter values the current schema still recognizes, and seeding the system prompt.
- context_
budget - Context-window budgeting: estimating prompt token cost, deciding whether a request fits, and clamping the completion length to what remains.
- fit
- Whether a model fits in a machine’s memory: a coarse runs-well / tight-fit / too-large verdict from the model’s footprint and the total RAM.
- profile
- The parameter-schema system: which tunable parameters a model exposes, assembled from capability- and runtime-specific profiles.