pub struct LlmRoute {
pub backend: String,
pub profile: String,
pub model: String,
pub provider_preferences: Vec<String>,
pub temperature: Option<f64>,
pub max_output_tokens: Option<u32>,
pub cache_control: Option<bool>,
pub reasoning_effort: Option<String>,
pub context_window_tokens: u32,
pub model_snapshot: LlmModelSnapshot,
}Expand description
One concrete cloud model route frozen by the deployment before command admission.
Fields§
§backend: String§profile: String§model: String§provider_preferences: Vec<String>§temperature: Option<f64>§max_output_tokens: Option<u32>§cache_control: Option<bool>§reasoning_effort: Option<String>§context_window_tokens: u32Total context window of the exact frozen model route.
model_snapshot: LlmModelSnapshotRequired immutable facts; old plans must not silently resolve against a new catalog.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for LlmRoute
impl<'de> Deserialize<'de> for LlmRoute
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for LlmRoute
Auto Trait Implementations§
impl Freeze for LlmRoute
impl RefUnwindSafe for LlmRoute
impl Send for LlmRoute
impl Sync for LlmRoute
impl Unpin for LlmRoute
impl UnsafeUnpin for LlmRoute
impl UnwindSafe for LlmRoute
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more