pub struct VolcanoClient { /* private fields */ }Expand description
Volcano AI API client
Implementations§
Source§impl VolcanoClient
impl VolcanoClient
Trait Implementations§
Source§impl Debug for VolcanoClient
impl Debug for VolcanoClient
Source§impl Provider for VolcanoClient
impl Provider for VolcanoClient
Source§fn chat_completion<'life0, 'async_trait>(
&'life0 self,
request: ChatCompletionRequest,
) -> Pin<Box<dyn Future<Output = Result<ChatCompletionResponse, LlmError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn chat_completion<'life0, 'async_trait>(
&'life0 self,
request: ChatCompletionRequest,
) -> Pin<Box<dyn Future<Output = Result<ChatCompletionResponse, LlmError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Generate a chat completion
Source§fn embeddings<'life0, 'async_trait>(
&'life0 self,
_request: EmbeddingRequest,
) -> Pin<Box<dyn Future<Output = Result<EmbeddingResponse, LlmError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn embeddings<'life0, 'async_trait>(
&'life0 self,
_request: EmbeddingRequest,
) -> Pin<Box<dyn Future<Output = Result<EmbeddingResponse, LlmError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Generate embeddings for text
Source§fn provider_name(&self) -> &'static str
fn provider_name(&self) -> &'static str
Get the provider name
Source§fn chat_completion_stream(
&self,
_request: ChatCompletionRequest,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<ChatCompletionChunk, LlmError>> + Send>>, LlmError>> + Send + '_>>
fn chat_completion_stream( &self, _request: ChatCompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<ChatCompletionChunk, LlmError>> + Send>>, LlmError>> + Send + '_>>
Stream a chat completion
Source§fn supported_models(&self) -> Vec<String>
fn supported_models(&self) -> Vec<String>
Get the list of models supported by this provider
Auto Trait Implementations§
impl Freeze for VolcanoClient
impl !RefUnwindSafe for VolcanoClient
impl Send for VolcanoClient
impl Sync for VolcanoClient
impl Unpin for VolcanoClient
impl UnsafeUnpin for VolcanoClient
impl !UnwindSafe for VolcanoClient
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more