Struct LlmClient 

pub struct LlmClient { /* private fields */ }

Cheap to clone (everything shareable lives behind Arc). Share one instance across tasks so they all observe the same circuit-breaker state.

Implementations

impl LlmClient

pub fn new(config: LlmConfig) -> Result<Self>

Build a client with a fresh, default circuit breaker.

pub fn with_breaker( config: LlmConfig, breaker: Arc<CircuitBreaker>, ) -> Result<Self>

Build a client sharing an existing circuit breaker (e.g. one breaker across several clients hitting the same provider).

pub fn with_image_resolver(self, resolver: Arc<dyn ImageResolver>) -> Self

Bind a caller-aware image resolver. Text-only clients need no resolver.

pub fn breaker(&self) -> &Arc<CircuitBreaker>

Access the shared circuit breaker (health checks, metrics).

pub async fn complete_stream_single_attempt<F>( &self, request: &CompletionRequest, on_delta: F, ) -> Result<CompletionResponse>

where F: FnMut(&str, bool) + Send,

Execute one auditable streaming provider attempt. Retry and durable attempt accounting belong exclusively to af-agent-runtime.

pub async fn complete_stream_single_attempt_controlled<F>( &self, request: &CompletionRequest, cancellation: &CancellationToken, deadline: Instant, on_delta: F, ) -> Result<CompletionResponse>

where F: FnMut(&str, bool) + Send,

Execute one provider attempt bounded by caller cancellation and deadline.

Trait Implementations

impl Clone for LlmClient

fn clone(&self) -> LlmClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.