Struct Client 

pub struct Client {
    pub server_url: String,
    /* private fields */
}

A client of one server.

Fields

server_url: String

The normalized server URL.

Implementations

impl Client

pub fn new(server_url: &str, api_key: Option<String>) -> Result<Client, String>

A client of server_url, sending api_key when there is one.

pub async fn list( &self, reload: bool, cancel: &CancellationToken, ) -> Result<Vec<ModelInfo>, String>

The server’s models. reload rescans its model directories.

pub async fn props( &self, model: Option<&str>, cancel: &CancellationToken, ) -> Result<Props, String>

/props, for model without loading it, or for the server.

pub async fn load( &self, model: &str, cancel: &CancellationToken, ) -> Result<(), String>

Asks the router to load model.

pub async fn unload( &self, model: &str, cancel: &CancellationToken, ) -> Result<(), String>

Asks the router to unload model, or to stop loading or downloading it.

pub async fn unload_and_wait( &self, model: &str, cancel: &CancellationToken, ) -> Result<(), String>

Unloads model and waits until it is unloaded.

pub async fn download( &self, model: &str, cancel: &CancellationToken, ) -> Result<(), String>

Asks the router to download model, a Hugging Face repo[:quant].

pub async fn load_and_wait( &self, model: &str, progress: &(dyn Fn(Progress) + Send + Sync), cancel: &CancellationToken, ) -> Result<ModelInfo, String>

Loads model and waits until it is loaded, reporting progress.

pub async fn download_and_wait( &self, model: &str, progress: &(dyn Fn(Progress) + Send + Sync), cancel: &CancellationToken, ) -> Result<Vec<ModelInfo>, String>

Downloads model, waits until the router lists it and returns the catalog after a rescan.

Trait Implementations

impl Clone for Client

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Client

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.