Struct LLMPreference

pub struct LLMPreference {
    pub llm_uuid: Option<Uuid>,
    pub llm_id: Option<String>,
    pub local: Option<bool>,
    pub family_id: Option<String>,
    pub capability_type: Option<CapabilityType>,
}

Preference structure for calls that allow flexible choice of LLMs.

Preferences are sort-then-choose, meaning you’re preferences will not entirely exclude any result.

Preferences are evaluated in the following order:

• uuid
• llm_id
• local
• family_id
• capability_type

This means that if a uuid matches, it gets returned, otherwise the other preferences get evaluated. If more than one LLM matches, the results are filtered to those LLMs and the next preference is applied. If no capability type is provided, the final sorting (should multiple LLMs be left over) is based on CapabilityType::General.

Fields

llm_uuid: Option<Uuid>

llm_id: Option<String>

local: Option<bool>

family_id: Option<String>

capability_type: Option<CapabilityType>

Trait Implementations

impl Debug for LLMPreference

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for LLMPreference

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for LLMPreference

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.