Skip to main content

Module profiles

Module profiles 

Source
Expand description

Per-model configuration: the parameter schema a model exposes, merging saved values and the system prompt into requests, and context-window budgeting.

Re-exports§

pub use configuration::dropping_vanished_param_values;
pub use configuration::merged;
pub use configuration::normalized_param_values;
pub use context_budget::COMPLETION_FLOOR;
pub use context_budget::Verdict;
pub use context_budget::assess;
pub use context_budget::effective_window;
pub use context_budget::estimated_tokens;
pub use context_budget::prompt_characters;
pub use context_budget::stored_context_length;
pub use fit::FitAssessment;
pub use fit::FitVerdict;
pub use profile::ModelProfile;
pub use profile::ProfileRegistry;
pub use profile::context_length_spec;

Modules§

configuration
Merging a model’s saved configuration into a request: keeping only parameter values the current schema still recognizes, and seeding the system prompt.
context_budget
Context-window budgeting: estimating prompt token cost, deciding whether a request fits, and clamping the completion length to what remains.
fit
Whether a model fits in a machine’s memory: a coarse runs-well / tight-fit / too-large verdict from the model’s footprint and the total RAM.
profile
The parameter-schema system: which tunable parameters a model exposes, assembled from capability- and runtime-specific profiles.