macro_rules! impl_sdk_model_provider {
($provider:ty) => { ... };
}Expand description
Implements rho_sdk::provider::ModelProvider for an application transport
that already exposes inherent model_identity, complete_turn, and
stream_turn methods.
Streaming uses a bounded callback bridge. A callback burst that fills the bridge is interrupted rather than buffered without bound.