pub type LlmExecutionFn = Arc<dyn Fn(&str, LlmRequest, LlmExecutionNextFn) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;Expand description
Wrap or replace non-streaming LLM execution.
A non-streaming execution intercept receives the logical provider name, the current request, and the continuation representing the rest of the chain.
Aliased Typeยง
pub struct LlmExecutionFn { /* private fields */ }