Skip to main content

ProviderConfig

Struct ProviderConfig 

Source
pub struct ProviderConfig {
    pub kind: ProviderKind,
    pub api_key: Option<String>,
    pub base_url: Option<String>,
    pub models: Vec<String>,
    pub weight: Option<u16>,
    pub max_retries: Option<u32>,
    pub api_version: Option<String>,
    pub timeout: Option<u64>,
    pub retry_deadline: Option<u64>,
    pub region: Option<String>,
    pub access_key: Option<String>,
    pub secret_key: Option<String>,
}
Expand description

Configuration for a single LLM provider.

Fields§

§kind: ProviderKind

Provider kind determines the dispatch path.

§api_key: Option<String>

API key (supports ${ENV_VAR} interpolation).

§base_url: Option<String>

Base URL override. OpenAI-compat providers have sensible defaults.

§models: Vec<String>

Model names served by this provider.

§weight: Option<u16>

Routing weight for weighted random selection. Higher = more traffic.

§max_retries: Option<u32>

Max retries on transient errors before fallback. 0 disables retry.

§api_version: Option<String>

API version string, used by Azure OpenAI.

§timeout: Option<u64>

Per-request timeout in seconds. Default: 30.

§retry_deadline: Option<u64>

Wall-clock deadline for the entire retry loop in seconds. Default: 15. The loop stops retrying once this much time has elapsed since the first attempt, even if max_retries has not been exhausted.

§region: Option<String>

AWS region for Bedrock provider.

§access_key: Option<String>

AWS access key ID for Bedrock provider.

§secret_key: Option<String>

AWS secret access key for Bedrock provider.

Implementations§

Source§

impl ProviderConfig

Source

pub fn effective_kind(&self) -> ProviderKind

Resolve the effective provider kind.

Returns Anthropic if the field is explicitly set to Anthropic, or if base_url contains “anthropic”. Otherwise returns the configured kind.

Source

pub fn validate(&self, provider_name: &str) -> Result<(), String>

Validate field combinations.

Trait Implementations§

Source§

impl Clone for ProviderConfig

Source§

fn clone(&self) -> ProviderConfig

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ProviderConfig

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for ProviderConfig

Source§

fn default() -> ProviderConfig

Returns the “default value” for a type. Read more
Source§

impl<'de> Deserialize<'de> for ProviderConfig

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Serialize for ProviderConfig

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,