pub struct LlmConfig {
pub provider: LlmProviderKind,
pub model: String,
pub base_url: Option<String>,
pub timeout_seconds: Option<u64>,
pub max_tokens: Option<u32>,
pub temperature: Option<f32>,
pub cost_cap_usd: Option<f64>,
}Expand description
The llm: block of .ailint.yaml; enables the opt-in AIL9xx rules.
Fields§
§provider: LlmProviderKindWhich provider client to use.
model: StringModel identifier passed to the provider.
base_url: Option<String>Override endpoint URL for OpenAI-compatible providers.
timeout_seconds: Option<u64>Per-request timeout in seconds.
max_tokens: Option<u32>Cap on tokens the provider may generate per request.
temperature: Option<f32>Sampling temperature forwarded to the provider.
cost_cap_usd: Option<f64>Stop running LLM rules once cumulative spend exceeds this many USD.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for LlmConfig
impl<'de> Deserialize<'de> for LlmConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl JsonSchema for LlmConfig
impl JsonSchema for LlmConfig
Source§fn schema_name() -> String
fn schema_name() -> String
The name of the generated JSON Schema. Read more
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn is_referenceable() -> bool
fn is_referenceable() -> bool
Whether JSON Schemas generated for this type should be re-used where possible using the
$ref keyword. Read moreAuto Trait Implementations§
impl Freeze for LlmConfig
impl RefUnwindSafe for LlmConfig
impl Send for LlmConfig
impl Sync for LlmConfig
impl Unpin for LlmConfig
impl UnsafeUnpin for LlmConfig
impl UnwindSafe for LlmConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more