Struct CohereProvider 

pub struct CohereProvider { /* private fields */ }

Client for the Cohere Chat API v2 (POST {base_url}/chat).

Requests use the same message, image and tool shapes as OpenAI; responses differ.

Implementations

impl CohereProvider

pub fn new(api_key: impl Into<String>) -> Self

pub fn with_base_url(self, base_url: impl Into<String>) -> Self

pub fn with_client(self, client: Client) -> Self

Uses your own reqwest::Client, for example to share a connection pool or set a proxy.

pub fn with_max_retries(self, max_retries: u32) -> Self

How many times a failed request is retried (default DEFAULT_MAX_RETRIES; 0 disables).

Trait Implementations

impl Clone for CohereProvider

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CohereProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl EmbeddingProvider for CohereProvider

fn embed<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, model: &'life1 str, inputs: &'life2 [&'life3 str], ) -> Pin<Box<dyn Future<Output = Result<Embeddings>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

impl LlmProvider for CohereProvider

fn chat<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Sends the request and waits for the whole answer.

fn chat_stream<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatStream>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Streams the answer as it is generated. The last event is StreamEvent::Done with the full response.

fn list_models<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<ModelInfo>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Models available to the key.