Struct CustomProviderConfig 

pub struct CustomProviderConfig {
    pub name: String,
    pub label: Option<String>,
    pub url: String,
    pub api_key: Option<String>,
    pub api_key_source: Option<String>,
    pub format: ProviderRequestFormat,
    pub headers: BTreeMap<String, String>,
    pub prefix: Option<String>,
}

A declarative definition of a model provider

Fields

name: String

The name of the provider, as referenced in proxy requests

label: Option<String>

A human-readable name for the provider

url: String

The url to use

api_key: Option<String>

The API token to pass along

api_key_source: Option<String>

Where to retrieve the value for api_key. If api_key_source is “env” then api_key is an environment variable. If it is empty, then api_key is assumed to be the token itself, if provided. In the future the key sources will be pluggable, to support external secret sources.

format: ProviderRequestFormat

What kind of request format this provider uses. Defaults to OpenAI-compatible

headers: BTreeMap<String, String>

Extra headers to pass with the request

prefix: Option<String>

Models starting with this prefix will use this provider by default.

Implementations

impl CustomProviderConfig

pub fn into_provider(self, client: Client) -> CustomProvider

Generate a CustomProvider object from the configuration

pub fn with_token_or_env(self, token: Option<String>, env: &str) -> Self

Add an API token to the CustomProviderConfig, or if one is not provided, then configure it to read from the given environment variable.

Trait Implementations

impl Clone for CustomProviderConfig

fn clone(&self) -> CustomProviderConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CustomProviderConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CustomProviderConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CustomProviderConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.