Struct Provider 

pub struct Provider {

    pub allow_fallbacks: Option<bool>,
    pub require_parameters: Option<bool>,
    pub data_collection: Option<ProviderDataCollection>,
    pub zdr: Option<bool>,
    pub order: Option<Vec<String>>,
    pub only: Option<Vec<String>>,
    pub ignore: Option<Vec<String>>,
    pub quantizations: Option<Vec<ProviderQuantization>>,
    pub sort: Option<ProviderSort>,
    pub max_price: Option<ProviderMaxPrice>,
    pub preferred_min_throughput: Option<f64>,
    pub preferred_max_latency: Option<f64>,
    pub min_throughput: Option<f64>,
    pub max_latency: Option<f64>,
}

Provider preferences merged from request and Ensemble LLM configuration.

Some fields come from the Ensemble LLM (allow_fallbacks, require_parameters, etc.) while others come from the request (data_collection, zdr, sort, etc.).

Fields

allow_fallbacks: Option<bool>

Whether to allow fallback to other providers. From Ensemble LLM.

require_parameters: Option<bool>

Whether to require all parameters. From Ensemble LLM.

data_collection: Option<ProviderDataCollection>

Data collection preferences. From request.

zdr: Option<bool>

Zero Data Retention preference. From request.

order: Option<Vec<String>>

Provider order preference. From Ensemble LLM.

only: Option<Vec<String>>

Only use these providers. From Ensemble LLM.

ignore: Option<Vec<String>>

Ignore these providers. From Ensemble LLM.

quantizations: Option<Vec<ProviderQuantization>>

Allowed quantizations. From Ensemble LLM.

sort: Option<ProviderSort>

Provider sort preference. From request.

max_price: Option<ProviderMaxPrice>

Maximum price constraints. From request.

preferred_min_throughput: Option<f64>

Preferred minimum throughput. From request.

preferred_max_latency: Option<f64>

Preferred maximum latency. From request.

min_throughput: Option<f64>

Hard minimum throughput requirement. From request.

max_latency: Option<f64>

Hard maximum latency requirement. From request.

Implementations

impl Provider

pub fn is_empty(&self) -> bool

Returns true if all fields are None.

pub fn new( request: Option<Provider>, ensemble_llm: Option<&Provider>, ) -> Option<Self>

Creates a new Provider by merging request and Ensemble LLM preferences.

Returns None if both inputs are None or if the merged result is empty.

Trait Implementations

impl Clone for Provider

fn clone(&self) -> Provider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Provider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Provider

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Provider

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.