Struct Settings 

pub struct Settings {
    pub strategy: String,
    pub max_retries: usize,
    pub debug_folder: Option<String>,
}

Global settings for the LlmManager.

Fields

strategy: String

Load balancing strategy: “lru”, “lowest_latency”, or “random”.

max_retries: usize

Maximum number of retries for failed requests.

debug_folder: Option<String>

Optional folder path for debug logging.

Trait Implementations

impl Debug for Settings

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Settings

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Settings

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.