Struct GenericProvider 

pub struct GenericProvider { /* private fields */ }

Generic LLM provider built on top of any RawAdapter.

Handles HTTP client management, retry logic, and automatically implements LlmProvider.

Implementations

impl GenericProvider

pub fn new(adapter: Box<dyn RawAdapter>) -> Self

pub fn with_config(adapter: Box<dyn RawAdapter>, config: ProviderConfig) -> Self

pub fn with_http_client( adapter: Box<dyn RawAdapter>, client: Arc<dyn HttpClient>, config: ProviderConfig, ) -> Self

Build a provider on top of a caller-supplied HttpClient.

Use this to stub transport in tests, share a connection pool wrapper, or route requests through custom middleware (logging, proxies, signing). The config still controls retry/backoff behaviour.

pub fn adapter(&self) -> &dyn RawAdapter

Get a reference to the inner adapter.

Trait Implementations

impl LlmProvider for GenericProvider

fn stream<'life0, 'async_trait>( &'life0 self, request: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatStream, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Streaming call (returns chunks in real-time).

fn chat<'life0, 'async_trait>( &'life0 self, request: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Non-streaming call (returns complete result at once).

fn capabilities(&self) -> Capabilities

Get provider capabilities.

fn info(&self) -> ProviderInfo

Get provider info.