pub enum PromptProfile {
Auto,
Full,
Compact,
}Expand description
Which prompt and tool surface a run gets.
Variants§
Auto
Decide from ModelFacts, falling back to Self::Full when the
backend reported nothing useful.
Full
Every tool, terse instructions.
Compact
Core tools only, explicit instructions.
Implementations§
Source§impl PromptProfile
impl PromptProfile
Sourcepub fn resolve(self, facts: ModelFacts) -> Self
pub fn resolve(self, facts: ModelFacts) -> Self
The profile to actually use, resolving Self::Auto against what the
backend reported.
Either measurement alone is enough to choose Self::Compact: a small
window cannot fit the full surface, and a small model cannot use it.
When neither is available the endpoint decides. A hosted one gets
Self::Full — withholding tools from a frontier model narrows the run
silently, which is the harder error to notice. A local one gets
Self::Compact, because a self-hosted model is usually small and
started on a modest context, and there the error is loud: llama-server
refuses the whole request rather than answering a little worse.
A host that knows better overrides with an explicit profile.
Trait Implementations§
Source§impl Clone for PromptProfile
impl Clone for PromptProfile
Source§fn clone(&self) -> PromptProfile
fn clone(&self) -> PromptProfile
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more