Skip to main content

LlmExecutionNextFn

Type Alias LlmExecutionNextFn 

Source
pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;
Expand description

Continuation type invoked by non-streaming LLM execution intercepts.

Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.

Aliased Typeยง

pub struct LlmExecutionNextFn { /* private fields */ }