Struct Config 

pub struct Config {
    pub base_url: String,
    pub model: String,
    pub provider: String,
    pub user_agent: String,
    pub connect_timeout: Duration,
    pub timeout: Duration,
    pub max_retries: u32,
    pub max_backoff: Duration,
    pub pool_size: usize,
    pub throttle_pause: Duration,
    pub backoff_scale: f64,
}

How a Client reaches the API and how hard it tries.

Build one with Config { field: value, ..Config::default() }. Every field has a default that suits TypeSafe’s hosted endpoint.

Fields

base_url: String

The endpoint every request is POSTed to. DEFAULT_BASE_URL, or a gateway in front of it. The URL is used as given: a token is sent to whatever host it names.

model: String

The model name sent in every request. DEFAULT_MODEL follows TypeSafe’s latest Jev.

provider: String

Who serves the endpoint, for error messages only: TypeSafe, or the name of a gateway.

user_agent: String

The User-Agent header. Defaults to this crate’s name and version.

connect_timeout: Duration

Time allowed to open a connection.

timeout: Duration

Time allowed for each of sending the request, waiting for the response and reading it.

max_retries: u32

Attempts after the first for transient failures; see Error for what is transient.

max_backoff: Duration

The longest a retry’s exponential backoff grows to. The backoff starts at half a second and doubles per attempt, up to this cap, times a random factor in [0.5, 1.5).

pool_size: usize

Connections kept open, and the ceiling of the concurrency AdaptiveLimiter. Set it to the number of threads that will call Client::ask at once.

throttle_pause: Duration

How long every thread waits after a throttled reply (HTTP 429 or 529) before the next attempt, times a random factor in [1, 2).

backoff_scale: f64

Multiplies the retry backoff and any Retry-After wait. Zero makes retries immediate, which tests want; Config::throttle_pause is separate. A negative or non-finite scale also means no wait.

Trait Implementations

impl Clone for Config

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Config

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Config

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for Config

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Config