Skip to main content

LlmExecutionNextFn

Type Alias LlmExecutionNextFn 

Source
pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;
Expand description

Continuation type invoked by non-streaming LLM execution intercepts.

Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.

§Parameters

  • First argument: LLM request to pass to the remaining execution chain.

§Returns

A future resolving to the provider response JSON.

§Errors

The future resolves to an error when the remaining execution chain fails.

§Lifetime

This continuation can be called repeatedly or concurrently while its execution-intercept callback is still running. Each invocation receives an isolated snapshot of the scopes visible when next is called. Calls that remain unfinished or begin after the interceptor settles are rejected.

Aliased Type§

pub struct LlmExecutionNextFn { /* private fields */ }