Struct LlmClientBuilder 

pub struct LlmClientBuilder { /* private fields */ }

Builds an LlmClient from a primary provider, optional fallbacks, and a stack of Tower layers.

Layers are applied outermost-first, matching the order they are added: the first .layer(...) call sees the request first and the response last.

Implementations

impl LlmClientBuilder

pub fn new() -> Self

Start a new builder with default model aliases.

pub fn provider<P: LlmProvider>(self, provider: P) -> Self

Set the primary provider.

pub fn fallback<P: LlmProvider>(self, provider: P) -> Self

Add a fallback provider, tried in registration order after the primary.

pub fn layer<L>(self, layer: L) -> Self

where L: LlmLayer + 'static, L::Provider: 'static,

Add a Tower layer. Outermost layers are added first.

pub fn alias(self, alias: impl Into<String>, model: impl Into<String>) -> Self

Register a model alias (e.g. "fast" → "gpt-4o-mini").

pub fn track_cost(self, handle: SessionCost) -> Self

Track the session-cost handle from a CostTrackingLayer so the client can report session_cost_usd().

pub fn build(self) -> LlmResult<LlmClient>

Finish building.

Trait Implementations

impl Default for LlmClientBuilder

fn default() -> LlmClientBuilder

Returns the “default value” for a type.