Struct Client 

pub struct Client {
    pub http_client: Client,
    pub api_base: String,
    pub api_key: String,
    pub user_agent: Option<String>,
    pub x_title: Option<String>,
    pub referer: Option<String>,
}

HTTP client for communicating with the OpenRouter API.

Fields

http_client: Client

The underlying HTTP client.

api_base: String

Base URL for the OpenRouter API.

api_key: String

API key for authentication with OpenRouter.

user_agent: Option<String>

Optional User-Agent header value.

x_title: Option<String>

Optional X-Title header value.

referer: Option<String>

Optional Referer header value (sent as both referer and http-referer).

Implementations

impl Client

pub fn new( http_client: Client, api_base: String, api_key: String, user_agent: Option<String>, x_title: Option<String>, referer: Option<String>, ) -> Self

Creates a new OpenRouter client.

pub fn create_streaming_for_chat( &self, id: String, byok: Option<&str>, cost_multiplier: Decimal, first_chunk_timeout: Duration, other_chunk_timeout: Duration, ensemble_llm: &EnsembleLlm, request: &ChatCompletionCreateParams, ) -> impl Stream<Item = Result<ChatCompletionChunk, Error>> + Send + 'static

Creates a streaming chat completion request.

Transforms the request using the Ensemble LLM’s configuration and returns a stream of chat completion chunks.

pub fn create_streaming_for_vector( &self, id: String, byok: Option<&str>, cost_multiplier: Decimal, first_chunk_timeout: Duration, other_chunk_timeout: Duration, ensemble_llm: &EnsembleLlm, request: &VectorCompletionCreateParams, vector_pfx_indices: &[(String, usize)], ) -> impl Stream<Item = Result<ChatCompletionChunk, Error>> + Send + 'static

Creates a streaming chat completion for LLM voting in vector completions.

The LLM sees responses labeled with prefix keys (e.g., `A`) and responds with its choice. The vector_pfx_indices maps the prefix keys shown to the LLM to the indices of the responses in the original request.

Trait Implementations

impl Clone for Client

fn clone(&self) -> Client

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Client

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.