Struct ServerClient 

pub struct ServerClient { /* private fields */ }

A client bound to one server.

Implementations

impl ServerClient

pub fn new(base: String, timeout: Duration) -> Result<Self, RuntimeError>

Client for base (http://127.0.0.1:PORT) with a per-request timeout.

pub fn base(&self) -> &str

Base URL.

pub async fn get(&self, path: &str) -> Result<(u16, String), String>

GET path.

pub async fn post( &self, path: &str, body: &Value, ) -> Result<(u16, String), String>

POST JSON to path.

pub async fn probe(&self, flavor: InferFlavor) -> ServerReport

Probe the server the way flavor is probed: /health then /v1/models for llama.cpp and mlx-lm (a 404 on /health falls back to /v1/models alone), /api/version, /api/tags and /api/ps for Ollama.

pub async fn tiny_completion(&self, model: &str) -> Result<(), String>

Ask for one token. Costs real compute, so callers opt in.

Trait Implementations

impl Clone for ServerClient

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.