pub struct RoutingExplainParams {
pub model: String,
pub messages: Vec<ChatCompletionRequestMessage>,
pub temperature: Option<f64>,
pub max_tokens: Option<u32>,
pub max_completion_tokens: Option<u32>,
pub top_p: Option<f64>,
}Expand description
Arguments for crate::resources::Routing::explain. messages reuses
the async-openai request-message type, so a request can be dry-run
before it is sent.
Fields§
§model: StringModel to plan for.
messages: Vec<ChatCompletionRequestMessage>Conversation to plan for.
temperature: Option<f64>Optional sampling temperature.
max_tokens: Option<u32>Optional legacy output-token cap. Prefer Self::max_completion_tokens;
the gateway coerces this into max_completion_tokens before forwarding
to any OpenAI-compatible provider.
max_completion_tokens: Option<u32>Optional canonical output-token cap (the current OpenAI standard).
Takes precedence over Self::max_tokens when both are set.
top_p: Option<f64>Optional nucleus-sampling top-p.
Implementations§
Trait Implementations§
Source§impl Clone for RoutingExplainParams
impl Clone for RoutingExplainParams
Source§fn clone(&self) -> RoutingExplainParams
fn clone(&self) -> RoutingExplainParams
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RoutingExplainParams
impl Debug for RoutingExplainParams
Auto Trait Implementations§
impl Freeze for RoutingExplainParams
impl RefUnwindSafe for RoutingExplainParams
impl Send for RoutingExplainParams
impl Sync for RoutingExplainParams
impl Unpin for RoutingExplainParams
impl UnsafeUnpin for RoutingExplainParams
impl UnwindSafe for RoutingExplainParams
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more