StructuredChatBuilder

Struct StructuredChatBuilder 

Source
pub struct StructuredChatBuilder<T, H: RetryHandler = DefaultRetryHandler> { /* private fields */ }
Available on crate feature client only.
Expand description

Builder for structured output chat requests.

Created via [ChatRequestBuilder::structured()].

Implementations§

Source§

impl<T: JsonSchema + DeserializeOwned> StructuredChatBuilder<T, DefaultRetryHandler>

Source

pub fn new(inner: ChatRequestBuilder) -> Self

Create a new structured builder from a chat request builder.

Source§

impl<T: JsonSchema + DeserializeOwned, H: RetryHandler> StructuredChatBuilder<T, H>

Source

pub fn max_retries(self, retries: u32) -> Self

Set the maximum number of retries on validation failure.

Source

pub fn retry_handler<H2: RetryHandler>( self, handler: H2, ) -> StructuredChatBuilder<T, H2>

Set a custom retry handler.

Source

pub fn schema_name(self, name: impl Into<String>) -> Self

Override the schema name.

Source

pub fn system(self, content: impl Into<String>) -> Self

Add a system message.

Source

pub fn user(self, content: impl Into<String>) -> Self

Add a user message.

Source

pub fn assistant(self, content: impl Into<String>) -> Self

Add an assistant message.

Source

pub fn max_tokens(self, max_tokens: i64) -> Self

Set max tokens.

Source

pub fn temperature(self, temperature: f64) -> Self

Set temperature.

Source

pub fn timeout(self, timeout: Duration) -> Self

Set request timeout.

Source

pub async fn send( self, client: &LLMClient, ) -> Result<StructuredResult<T>, StructuredError>

Execute the structured request (blocking, async).

Returns a typed result with validation retries if configured.

Source

pub async fn stream( self, client: &LLMClient, ) -> Result<StructuredJSONStream<T>, StructuredError>

Available on crate feature streaming only.

Execute and stream structured responses.

Note: Streaming does not support retries. For retry behavior, use [send].

Auto Trait Implementations§

§

impl<T, H> Freeze for StructuredChatBuilder<T, H>
where H: Freeze,

§

impl<T, H> RefUnwindSafe for StructuredChatBuilder<T, H>

§

impl<T, H> Send for StructuredChatBuilder<T, H>
where T: Send,

§

impl<T, H> Sync for StructuredChatBuilder<T, H>
where T: Sync,

§

impl<T, H> Unpin for StructuredChatBuilder<T, H>
where H: Unpin, T: Unpin,

§

impl<T, H> UnwindSafe for StructuredChatBuilder<T, H>
where H: UnwindSafe, T: UnwindSafe,

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more