pub struct ProviderHandles {
pub primary: AnyProvider,
pub embedding: AnyProvider,
pub disambiguate: AnyProvider,
pub compaction: AnyProvider,
}Expand description
Bundle of LLM provider handles needed for async context operations.
Each handle is an Arc-backed clone, suitable for moving into spawned tasks
or passing across async boundaries.
Fields§
§primary: AnyProviderPrimary LLM provider used for completions.
embedding: AnyProviderDedicated embedding provider.
disambiguate: AnyProviderProvider for skill disambiguation classification calls.
Falls back to primary when the [skills] disambiguate_provider config field is empty.
compaction: AnyProviderProvider used for deferred tool-pair summarization (context compaction).
Falls back to primary when the [memory] compaction_provider config field is empty.
Auto Trait Implementations§
impl !Freeze for ProviderHandles
impl !RefUnwindSafe for ProviderHandles
impl Send for ProviderHandles
impl Sync for ProviderHandles
impl Unpin for ProviderHandles
impl UnsafeUnpin for ProviderHandles
impl !UnwindSafe for ProviderHandles
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request