Struct ModelOverride 

pub struct ModelOverride {
    pub model: String,
}

Canonical per-request model override used by the LLM interceptor.

Re-exporting the LLM type keeps context interception and provider policy enforcement on the same TypeId across the agent and server crates. Per-request model override for ctx.intercept.

Example:

let req_ctx = root_ctx.intercept(ModelOverride { model: "gpt-4o-mini".into() });
let llm = req_ctx.get::<Llm>().unwrap();
// inside Llm, check `ctx.get::<ModelOverride>()` for pinning

Fields

model: String

Model id to pin for this request scope.

Trait Implementations

impl Clone for ModelOverride

fn clone(&self) -> ModelOverride

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelOverride

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Service for ModelOverride

fn name(&self) -> &'static str

fn init( &self, _ctx: &Arc<Context>, ) -> Pin<Box<dyn Future<Output = Result<Option<Box<dyn Disposable>>, CordisError>> + Send + '_>>

fn check(&self) -> bool

Availability predicate for this service instance.