pub struct ProviderConfig {
pub model: CompactString,
pub api_key: Option<String>,
pub base_url: Option<String>,
pub loader: Option<Loader>,
pub quantization: Option<QuantizationType>,
pub chat_template: Option<String>,
}Expand description
Flat provider configuration. All fields except model are optional.
Provider kind is inferred from the model name — no explicit provider tag.
Fields§
§model: CompactStringModel identifier. Remote models use known prefixes (deepseek-*,
gpt-*, claude-*, etc.). Local models use HuggingFace repo IDs
containing / (e.g. microsoft/Phi-3.5-mini-instruct).
api_key: Option<String>API key for remote providers. Supports ${ENV_VAR} expansion at the
daemon layer.
base_url: Option<String>Base URL override for remote providers.
loader: Option<Loader>Mistralrs model builder to use for local models. Defaults to Text.
quantization: Option<QuantizationType>In-situ quantization for local models.
chat_template: Option<String>Chat template override for local models (path or inline Jinja).
Implementations§
Trait Implementations§
Source§impl Clone for ProviderConfig
impl Clone for ProviderConfig
Source§fn clone(&self) -> ProviderConfig
fn clone(&self) -> ProviderConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProviderConfig
impl Debug for ProviderConfig
Source§impl<'de> Deserialize<'de> for ProviderConfig
impl<'de> Deserialize<'de> for ProviderConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for ProviderConfig
impl RefUnwindSafe for ProviderConfig
impl Send for ProviderConfig
impl Sync for ProviderConfig
impl Unpin for ProviderConfig
impl UnsafeUnpin for ProviderConfig
impl UnwindSafe for ProviderConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more