pub struct ProviderDef {
pub id: String,
pub dialect: Dialect,
pub base_url: String,
pub api_key_env: Option<String>,
}Expand description
A model provider a ladder can route to. Declared as [[provider]] in TOML; referenced from a
ladder as <id>/<model> (e.g. groq/llama-3.3-70b-versatile).
Fields§
§id: StringLadder prefix for this provider, e.g. "groq". Overrides a built-in of the same id.
dialect: DialectWhich wire API it speaks.
base_url: StringBase URL, e.g. "https://api.groq.com/openai" or "http://localhost:11434" for Ollama.
api_key_env: Option<String>Env var the API key is read from at call time, e.g. "GROQ_API_KEY". Omit for a keyless
endpoint (local Ollama / vLLM). Per-request BYOK headers still apply to the built-in
anthropic / openai providers.
Trait Implementations§
Source§impl Clone for ProviderDef
impl Clone for ProviderDef
Source§fn clone(&self) -> ProviderDef
fn clone(&self) -> ProviderDef
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProviderDef
impl Debug for ProviderDef
Source§impl<'de> Deserialize<'de> for ProviderDef
impl<'de> Deserialize<'de> for ProviderDef
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for ProviderDef
impl RefUnwindSafe for ProviderDef
impl Send for ProviderDef
impl Sync for ProviderDef
impl Unpin for ProviderDef
impl UnsafeUnpin for ProviderDef
impl UnwindSafe for ProviderDef
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more