Struct LLMClient 

pub struct LLMClient { /* private fields */ }

Available on crate feature client only.

Implementations

impl LLMClient

pub async fn proxy( &self, req: ProxyRequest, options: ProxyOptions, ) -> Result<ProxyResponse, Error>

pub async fn proxy_stream( &self, req: ProxyRequest, options: ProxyOptions, ) -> Result<StreamHandle, Error>

Available on crate feature streaming only.

pub async fn proxy_stream_deltas( &self, req: ProxyRequest, options: ProxyOptions, ) -> Result<Pin<Box<dyn Stream<Item = Result<String, Error>> + Send>>, Error>

Available on crate feature streaming only.

Convenience helper to stream text deltas directly (async).

pub fn for_customer( &self, customer_id: impl Into<String>, ) -> CustomerChatRequestBuilder

Create a builder for customer-attributed chat requests.

Customer-attributed requests use the customer’s tier to determine which model to use, so no model parameter is required.

pub async fn proxy_customer( &self, customer_id: &str, body: CustomerProxyRequestBody, options: ProxyOptions, ) -> Result<ProxyResponse, Error>

Execute a customer-attributed proxy request (non-streaming).

The customer_id is sent via the X-ModelRelay-Customer-Id header.

pub async fn proxy_customer_stream( &self, customer_id: &str, body: CustomerProxyRequestBody, options: ProxyOptions, ) -> Result<StreamHandle, Error>

Available on crate feature streaming only.

Execute a customer-attributed proxy request (streaming).

The customer_id is sent via the X-ModelRelay-Customer-Id header.

Trait Implementations

impl Clone for LLMClient

fn clone(&self) -> LLMClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.