pub struct OpenAICompatible { /* private fields */ }Available on crate feature
openai only.Expand description
Shared OpenAI-compatible client implementation.
Implementations§
Source§impl OpenAICompatible
impl OpenAICompatible
Sourcepub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
Available on crate feature models only.
pub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
models only.Create a new OpenAI-compatible client.
Sourcepub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
Available on crate feature models only.
pub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
models only.Set the retry configuration (builder pattern).
Sourcepub fn set_retry_config(&mut self, retry_config: RetryConfig)
Available on crate feature models only.
pub fn set_retry_config(&mut self, retry_config: RetryConfig)
models only.Set the retry configuration (mutable reference).
Sourcepub fn retry_config(&self) -> &RetryConfig
Available on crate feature models only.
pub fn retry_config(&self) -> &RetryConfig
models only.Returns the current retry configuration.
Trait Implementations§
Source§impl Llm for OpenAICompatible
impl Llm for OpenAICompatible
Source§fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
Generates content from the given request, optionally streaming.
Source§fn schema_adapter(&self) -> &dyn SchemaAdapter
fn schema_adapter(&self) -> &dyn SchemaAdapter
Returns the schema adapter for this provider. Read more
Auto Trait Implementations§
impl Freeze for OpenAICompatible
impl !RefUnwindSafe for OpenAICompatible
impl Send for OpenAICompatible
impl Sync for OpenAICompatible
impl Unpin for OpenAICompatible
impl UnsafeUnpin for OpenAICompatible
impl !UnwindSafe for OpenAICompatible
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more