Skip to main content

impl_sdk_model_provider

Macro impl_sdk_model_provider 

Source
macro_rules! impl_sdk_model_provider {
    ($provider:ty) => { ... };
}
Expand description

Implements rho_sdk::provider::ModelProvider for an application transport that already exposes inherent model_identity, complete_turn, and stream_turn methods.

Streaming uses a bounded callback bridge. A callback burst that fills the bridge is interrupted rather than buffered without bound.