Skip to main content

OnModelErrorCallback

Type Alias OnModelErrorCallback 

Source
pub type OnModelErrorCallback = Box<dyn Fn(Arc<dyn CallbackContext>, LlmRequest, String) -> Pin<Box<dyn Future<Output = Result<Option<LlmResponse>>> + Send>> + Send + Sync>;
Expand description

Callback invoked when a model error occurs.

Can handle or transform model errors. Return Ok(Some(response)) to provide a fallback response. Return Ok(None) to propagate the original error.

Aliased Typeยง

pub struct OnModelErrorCallback(/* private fields */);