Struct ModelInvocation 

pub struct ModelInvocation {
    pub request: ModelRequest,
    pub ctx: ExecutionContext,
}

One model call’s full request + request-scope context. Layers read both fields; the leaf service consumes them.

Fields

request: ModelRequest

Provider-neutral model request the codec will encode.

ctx: ExecutionContext

Request-scope state (cancellation, deadline, tenant, thread).

Implementations

impl ModelInvocation

pub const fn new(request: ModelRequest, ctx: ExecutionContext) -> Self

Bundle request + ctx into one invocation.

Trait Implementations

impl Clone for ModelInvocation

fn clone(&self) -> ModelInvocation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelInvocation

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<ModelInvocation> for StreamingModelInvocation

fn from(inner: ModelInvocation) -> Self

Converts to this type from the input type.

impl Retryable for ModelInvocation

fn ctx(&self) -> &ExecutionContext

Borrow the ExecutionContext the retry loop checks for cancellation between attempts.

fn ctx_mut(&mut self) -> &mut ExecutionContext

Mutable handle so RetryService can stamp an idempotency key on first entry — every clone of the request that follows shares the stamped key, so vendor-side dedupe sees one logical call across N attempts.