Skip to main content

RuntimeModelLlmCallback

Type Alias RuntimeModelLlmCallback 

Source
pub type RuntimeModelLlmCallback = Arc<dyn Fn(&RuntimeModelLlmRequest) -> Result<RuntimeModelLlmResponse, RuntimeModelError> + Send + Sync>;
Expand description

Callback type used by hosts to handle one standard non-streaming LLM request. 宿主用于处理单个标准非流式 LLM 请求的回调类型。

Aliased Type§

pub struct RuntimeModelLlmCallback { /* private fields */ }