pub struct OpenAICompatible { /* private fields */ }Available on crate features
models and openai only.Expand description
Shared OpenAI-compatible client implementation.
Implementations§
Source§impl OpenAICompatible
impl OpenAICompatible
Sourcepub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
pub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
Create a new OpenAI-compatible client.
pub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
pub fn set_retry_config(&mut self, retry_config: RetryConfig)
pub fn retry_config(&self) -> &RetryConfig
Trait Implementations§
Source§impl Llm for OpenAICompatible
impl Llm for OpenAICompatible
fn name(&self) -> &str
fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
Auto Trait Implementations§
impl Freeze for OpenAICompatible
impl !RefUnwindSafe for OpenAICompatible
impl Send for OpenAICompatible
impl Sync for OpenAICompatible
impl Unpin for OpenAICompatible
impl UnsafeUnpin for OpenAICompatible
impl !UnwindSafe for OpenAICompatible
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestCreates a shared type from an unshared type.