Struct ClientBuilder 

pub struct ClientBuilder { /* private fields */ }

Builder for creating a LLMKitClient.

Implementations

impl ClientBuilder

pub fn new() -> Self

Create a new client builder.

pub fn with_embedding_provider( self, name: impl Into<String>, provider: Arc<dyn EmbeddingProvider>, ) -> Self

Add an embedding provider.

pub fn with_speech_provider( self, name: impl Into<String>, provider: Arc<dyn SpeechProvider>, ) -> Self

Add a speech (TTS) provider.

pub fn with_transcription_provider( self, name: impl Into<String>, provider: Arc<dyn TranscriptionProvider>, ) -> Self

Add a transcription (STT) provider.

pub fn with_image_provider( self, name: impl Into<String>, provider: Arc<dyn ImageProvider>, ) -> Self

Add an image generation provider.

pub fn with_video_provider( self, name: impl Into<String>, provider: Arc<dyn VideoProvider>, ) -> Self

Add a video generation provider.

pub fn with_ranking_provider( self, name: impl Into<String>, provider: Arc<dyn RankingProvider>, ) -> Self

Add a ranking/reranking provider.

pub fn with_moderation_provider( self, name: impl Into<String>, provider: Arc<dyn ModerationProvider>, ) -> Self

Add a moderation provider.

pub fn with_classification_provider( self, name: impl Into<String>, provider: Arc<dyn ClassificationProvider>, ) -> Self

Add a classification provider.

pub fn with_retry(self, config: RetryConfig) -> Self

Enable automatic retry with the specified configuration.

All providers will be wrapped with retry logic using exponential backoff.

Example

let client = LLMKitClient::builder()
    .with_anthropic_from_env()
    .with_retry(RetryConfig::production())
    .build()?;

pub fn with_default_retry(self) -> Self

Enable automatic retry with default production configuration.

Uses RetryConfig::default() which provides:

• 10 retry attempts
• Exponential backoff from 1s up to 5 minutes
• Jitter enabled for better distributed retry timing

pub fn with_provider( self, name: impl Into<String>, provider: Arc<dyn Provider>, ) -> Self

Add a custom provider.

pub fn with_default(self, name: impl Into<String>) -> Self

Set the default provider by name.

pub fn with_anthropic_from_env(self) -> Self

Add Anthropic provider from environment.

pub fn with_anthropic(self, api_key: impl Into<String>) -> Result<Self>

Add Anthropic provider with API key.

pub fn with_anthropic_config(self, config: ProviderConfig) -> Result<Self>

Add Anthropic provider with custom config.

pub fn with_openai_from_env(self) -> Self

Add OpenAI provider from environment.

Also registers OpenAI as an embedding provider for text-embedding-* models.

pub fn with_openai(self, api_key: impl Into<String>) -> Result<Self>

Add OpenAI provider with API key.

Also registers OpenAI as an embedding provider for text-embedding-* models.

pub fn with_openai_config(self, config: ProviderConfig) -> Result<Self>

Add OpenAI provider with custom config.

Also registers OpenAI as an embedding provider for text-embedding-* models.

pub async fn build(self) -> Result<LLMKitClient>

Build the client.

This is an async method that initializes all pending providers (Vertex AI, Bedrock) that require async credential discovery.

If retry configuration was set via with_retry() or with_default_retry(), all providers will be wrapped with automatic retry logic.

Trait Implementations

impl Default for ClientBuilder

fn default() -> Self

Returns the “default value” for a type.