Struct Client 

pub struct Client<B = Hyper> { /* private fields */ }

A client for one model server.

Cheap to clone; clones share the connection pool and what was learned about the server, such as that it rejects optional fields.

B is the HTTP backend: the built-in Hyper unless the builder is given another. Most code never names it and writes Client.

use svir::prelude::*;

let client = Client::openai("http://127.0.0.1:1234").build()?;
let request = Request::new("qwen3-27b").user("Explain ownership in one paragraph.");

let mut stream = client.stream(&request).await?;
while let Some(event) = stream.next().await {
    if let Event::Text(delta) = event? {
        print!("{delta}");
    }
}

Implementations

impl Client

pub fn openai(url: impl Into<String>) -> ClientBuilder

A client for an OpenAI-compatible server at url, which may be written with or without /v1. Finish with build.

impl<B: Backend> Client<B>

pub async fn stream( &self, request: impl Borrow<Request>, ) -> Result<EventStream<B>, Error>

Sends request and returns the answer as a stream of events.

Dropping the stream cancels the request and closes the connection.

pub async fn complete( &self, request: impl Borrow<Request>, ) -> Result<Completion, Error>

Sends request and returns the whole answer.

pub async fn send( &self, request: impl Borrow<Request>, ) -> Result<RawStream<B>, Error>

Sends request and returns the server’s bytes unchanged, after status mapping and compatibility handling: for a proxy that relays the stream and reads it on the way past with a Decoder. Layers work on events, so they do not apply here.

pub async fn list_models(&self) -> Result<Vec<Model>, Error>

Lists the models the server reports, unfiltered.

Trait Implementations

impl<B> Clone for Client<B>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B> Debug for Client<B>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.