pub type RuntimeModelLlmCallback = Arc<dyn Fn(&RuntimeModelLlmRequest) -> Result<RuntimeModelLlmResponse, RuntimeModelError> + Send + Sync>;Expand description
Callback type used by hosts to handle one standard non-streaming LLM request. 宿主用于处理单个标准非流式 LLM 请求的回调类型。
Aliased Type§
pub struct RuntimeModelLlmCallback { /* private fields */ }