Struct DefaultClient 

pub struct DefaultClient { /* private fields */ }

Default client implementation backed by reqwest.

The provider is resolved at construction time from model_hint (or defaults to OpenAI). However, individual requests can override the provider when their model string contains a prefix that clearly identifies a different provider (e.g. "anthropic/claude-3" will route to Anthropic even if the client was built without a hint).

When the model prefix does not match any known provider, the construction-time provider is used as the fallback.

The provider is stored behind an Arc so it can be shared cheaply into async closures and streaming tasks that must be 'static.

Implementations

impl DefaultClient

pub fn new(config: ClientConfig, model_hint: Option<&str>) -> Result<Self>

Build a client.

model_hint guides provider auto-detection when no explicit base_url override is present in the config. For example, passing Some("groq/llama3-70b") selects the Groq provider. Pass None to default to OpenAI.

Errors

Returns a wrapped reqwest::Error if the underlying HTTP client cannot be constructed. Header names and values are pre-validated by ClientConfigBuilder::header, so they are inserted directly here.

Trait Implementations

impl BatchClient for DefaultClient

Available on crate features native-http or wasm-http only.

fn create_batch( &self, req: CreateBatchRequest, ) -> BoxFuture<'_, Result<BatchObject>>

Create a new batch job.

fn retrieve_batch(&self, batch_id: &str) -> BoxFuture<'_, Result<BatchObject>>

Retrieve a batch by ID.

fn list_batches( &self, query: Option<BatchListQuery>, ) -> BoxFuture<'_, Result<BatchListResponse>>

List batches, optionally filtered by query parameters.

fn cancel_batch(&self, batch_id: &str) -> BoxFuture<'_, Result<BatchObject>>

Cancel an in-progress batch.

impl Clone for DefaultClient

fn clone(&self) -> DefaultClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl FileClient for DefaultClient

Available on crate features native-http or wasm-http only.

fn create_file( &self, req: CreateFileRequest, ) -> BoxFuture<'_, Result<FileObject>>

Upload a file.

fn retrieve_file(&self, file_id: &str) -> BoxFuture<'_, Result<FileObject>>

Retrieve metadata for a file.

fn delete_file(&self, file_id: &str) -> BoxFuture<'_, Result<DeleteResponse>>

Delete a file.

fn list_files( &self, query: Option<FileListQuery>, ) -> BoxFuture<'_, Result<FileListResponse>>

List files, optionally filtered by query parameters.

fn file_content(&self, file_id: &str) -> BoxFuture<'_, Result<Bytes>>

Retrieve the raw content of a file.

impl LlmClient for DefaultClient

Available on crate features native-http or wasm-http only.

fn chat( &self, req: ChatCompletionRequest, ) -> BoxFuture<'_, Result<ChatCompletionResponse>>

Send a chat completion request.

fn chat_stream( &self, req: ChatCompletionRequest, ) -> BoxFuture<'_, Result<BoxStream<'static, Result<ChatCompletionChunk>>>>

Send a streaming chat completion request.

fn embed( &self, req: EmbeddingRequest, ) -> BoxFuture<'_, Result<EmbeddingResponse>>

Send an embedding request.

fn list_models(&self) -> BoxFuture<'_, Result<ModelsListResponse>>

List available models.

fn image_generate( &self, req: CreateImageRequest, ) -> BoxFuture<'_, Result<ImagesResponse>>

Generate an image.

fn speech(&self, req: CreateSpeechRequest) -> BoxFuture<'_, Result<Bytes>>

Generate speech audio from text.

fn transcribe( &self, req: CreateTranscriptionRequest, ) -> BoxFuture<'_, Result<TranscriptionResponse>>

Transcribe audio to text.

fn moderate( &self, req: ModerationRequest, ) -> BoxFuture<'_, Result<ModerationResponse>>

Check content against moderation policies.

fn rerank(&self, req: RerankRequest) -> BoxFuture<'_, Result<RerankResponse>>

Rerank documents by relevance to a query.

fn search(&self, req: SearchRequest) -> BoxFuture<'_, Result<SearchResponse>>

Perform a web/document search.

fn ocr(&self, req: OcrRequest) -> BoxFuture<'_, Result<OcrResponse>>

Extract text from a document via OCR.

impl LlmClientRaw for DefaultClient

Available on crate features native-http or wasm-http only.

fn chat_raw( &self, req: ChatCompletionRequest, ) -> BoxFuture<'_, Result<RawExchange<ChatCompletionResponse>>>

Send a chat completion request and return the raw exchange.

fn chat_stream_raw( &self, req: ChatCompletionRequest, ) -> BoxFuture<'_, Result<RawStreamExchange<BoxStream<'static, Result<ChatCompletionChunk>>>>>

Send a streaming chat completion request and return the raw exchange.

fn embed_raw( &self, req: EmbeddingRequest, ) -> BoxFuture<'_, Result<RawExchange<EmbeddingResponse>>>

Send an embedding request and return the raw exchange.

fn image_generate_raw( &self, req: CreateImageRequest, ) -> BoxFuture<'_, Result<RawExchange<ImagesResponse>>>

Generate an image and return the raw exchange.

fn transcribe_raw( &self, req: CreateTranscriptionRequest, ) -> BoxFuture<'_, Result<RawExchange<TranscriptionResponse>>>

Transcribe audio to text and return the raw exchange.

fn moderate_raw( &self, req: ModerationRequest, ) -> BoxFuture<'_, Result<RawExchange<ModerationResponse>>>

Check content against moderation policies and return the raw exchange.

fn rerank_raw( &self, req: RerankRequest, ) -> BoxFuture<'_, Result<RawExchange<RerankResponse>>>

Rerank documents by relevance to a query and return the raw exchange.

fn search_raw( &self, req: SearchRequest, ) -> BoxFuture<'_, Result<RawExchange<SearchResponse>>>

Perform a web/document search and return the raw exchange.

fn ocr_raw( &self, req: OcrRequest, ) -> BoxFuture<'_, Result<RawExchange<OcrResponse>>>

Extract text from a document via OCR and return the raw exchange.

impl ResponseClient for DefaultClient

Available on crate features native-http or wasm-http only.

fn create_response( &self, req: CreateResponseRequest, ) -> BoxFuture<'_, Result<ResponseObject>>

Create a new response.

fn retrieve_response(&self, id: &str) -> BoxFuture<'_, Result<ResponseObject>>

Retrieve a response by ID.

fn cancel_response(&self, id: &str) -> BoxFuture<'_, Result<ResponseObject>>

Cancel an in-progress response.