Struct Client 

pub struct Client<T = Client> { /* private fields */ }

Provider client: Client Note: base_url is resolved into concrete endpoints during build, so we don’t store base_url.

Implementations

impl<T> Client<T>

where T: Default,

pub fn builder<'a>() -> ClientBuilder<'a, T>

pub fn new() -> Self

impl Client<Client>

pub async fn predict( &self, inputs: impl IntoIterator<Item = String>, ) -> Result<PredictResponse, PredictError>

Predict/classify inputs using TEI router endpoint (customizable via ClientBuilder)

impl Client<Client>

pub async fn rerank( &self, query: &str, texts: impl IntoIterator<Item = String>, top_n: Option<usize>, ) -> Result<Vec<RerankResult>, RerankError>

Rerank endpoint (customizable via ClientBuilder): POST {endpoints.rerank}

Trait Implementations

impl<T: Clone> Clone for Client<T>

fn clone(&self) -> Client<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug> Debug for Client<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T> Default for Client<T>

where T: Default,

fn default() -> Self

Returns the “default value” for a type.

impl EmbeddingsClient for Client<Client>

type EmbeddingModel = EmbeddingModel

The type of EmbeddingModel used by the Client

fn embedding_model(&self, model: impl Into<String>) -> Self::EmbeddingModel

Create an embedding model with the given model.

fn embedding_model_with_ndims( &self, model: impl Into<String>, ndims: usize, ) -> Self::EmbeddingModel

Create an embedding model with the given model identifier string and the number of dimensions in the embedding generated by the model. This is the suggested method if you need to use a model not included in Self::EmbeddingModel::Models

fn embeddings<D>( &self, model: impl Into<String>, ) -> EmbeddingsBuilder<Self::EmbeddingModel, D>

where D: Embed,

Create an embedding builder with the given embedding model.

fn embeddings_with_ndims<D>( &self, model: &str, ndims: usize, ) -> EmbeddingsBuilder<Self::EmbeddingModel, D>

where D: Embed,

Create an embedding builder with the given name and the number of dimensions in the embedding generated by the model.

impl ProviderClient for Client<Client>

type Input = String

fn from_env() -> Self

Create a client from the process’s environment. Panics if an environment is improperly configured.

fn from_val(input: String) -> Self

impl VerifyClient for Client<Client>

async fn verify(&self) -> Result<(), VerifyError>

Verify the configuration.