Skip to main content

StructuredRequest

Struct StructuredRequest 

Source
pub struct StructuredRequest {
    pub model: String,
    pub system_prompts: Vec<String>,
    pub messages: Vec<Message>,
    pub max_tokens: Option<u32>,
    pub temperature: Option<f32>,
    pub top_p: Option<f32>,
    pub schema: ObjectSchema,
    pub cache_system_prompt: bool,
    pub reasoning_effort: Option<String>,
    pub seed: Option<u64>,
    pub repair: Option<Arc<dyn RepairStrategy>>,
    pub provider_options: Value,
}
Expand description

The immutable, provider-agnostic shape of one structured-output call. You’ll normally build one with PendingStructuredRequest rather than constructing this directly.

Fields§

§model: String§system_prompts: Vec<String>§messages: Vec<Message>§max_tokens: Option<u32>§temperature: Option<f32>§top_p: Option<f32>§schema: ObjectSchema

The shape the model’s reply must match. Required up front (via PendingStructuredRequest::new) rather than optional the way tools are for a text request, since a structured request without a schema isn’t a meaningful thing to send.

§cache_system_prompt: bool

Marks the system prompt as a cache breakpoint on providers that support explicit prompt caching (currently just Anthropic; ignored elsewhere). See TextRequest::cache_system_prompt for when this is worth turning on. Defaults to false.

§reasoning_effort: Option<String>

Sets how much effort a reasoning model spends thinking before replying. See TextRequest::reasoning_effort for which providers and models this applies to.

§seed: Option<u64>

A seed for providers whose backend can honor one. See TextRequest::seed for what “honor” means here. (No stop_sequences equivalent here, unlike TextRequest: a stop string can truncate otherwise-valid JSON output, which cuts against the whole point of a structured request.)

§repair: Option<Arc<dyn RepairStrategy>>

A hook that gets one chance to salvage a reply that failed to decode, instead of the request just failing. None (the default) means a decode failure always returns Error::StructuredDecode as-is. See RepairStrategy and with_repair.

§provider_options: Value

Extra provider-specific fields to send alongside this request, for options this crate doesn’t model as a typed field yet. Must be a JSON object to have any effect: each of its top-level keys is merged into (and, if it collides with one of this crate’s own fields, overrides) the request body actually sent to the provider. The default, Value::Null, sends nothing extra.

Implementations§

Source§

impl StructuredRequest

Source

pub fn new(model: impl Into<String>, schema: ObjectSchema) -> Self

Trait Implementations§

Source§

impl Clone for StructuredRequest

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more