pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;Expand description
Continuation type invoked by non-streaming LLM execution intercepts.
Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.
§Parameters
- First argument: LLM request to pass to the remaining execution chain.
§Returns
A future resolving to the provider response JSON.
§Errors
The future resolves to an error when the remaining execution chain fails.
§Lifetime
This continuation can be called repeatedly or concurrently while its
execution-intercept callback is still running. Each invocation receives an
isolated snapshot of the scopes visible when next is called. Calls that
remain unfinished or begin after the interceptor settles are rejected.
Aliased Type§
pub struct LlmExecutionNextFn { /* private fields */ }