pub struct OpenAICompatible { /* private fields */ }Available on crate feature
models only.Expand description
Shared OpenAI-compatible client implementation.
Implementations§
Source§impl OpenAICompatible
impl OpenAICompatible
Sourcepub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
Available on crate feature openai only.
pub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
openai only.Create a new OpenAI-compatible client.
pub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
Available on crate feature
openai only.pub fn set_retry_config(&mut self, retry_config: RetryConfig)
Available on crate feature
openai only.pub fn retry_config(&self) -> &RetryConfig
Available on crate feature
openai only.Trait Implementations§
Source§impl Llm for OpenAICompatible
impl Llm for OpenAICompatible
fn name(&self) -> &str
fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
Auto Trait Implementations§
impl Freeze for OpenAICompatible
impl !RefUnwindSafe for OpenAICompatible
impl Send for OpenAICompatible
impl Sync for OpenAICompatible
impl Unpin for OpenAICompatible
impl UnsafeUnpin for OpenAICompatible
impl !UnwindSafe for OpenAICompatible
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more