Struct GetBatchResults 

pub struct GetBatchResults { /* private fields */ }

Builder returned by get_batch_results; .await opens the stream.

Implementations

impl GetBatchResults

pub fn tools(self, tools: ToolSet) -> Self

Tools used to parse and validate tool calls in text results.

impl GetBatchResults

pub fn headers(self, headers: Headers) -> Self

Adds request headers.

pub fn header(self, name: &str, value: &str) -> Self

Adds one request header; invalid names or values are ignored.

pub fn provider_options(self, options: ProviderOptions) -> Self

Sets the provider-specific options.

pub fn provider_option( self, provider: impl Into<String>, options: JsonObject, ) -> Self

Sets the options of one provider.

pub fn cancellation(self, token: CancellationToken) -> Self

Sets the cancellation token.

pub fn timeout(self, timeout: Duration) -> Self

Sets the total timeout of the call.

pub fn telemetry(self, options: TelemetryOptions) -> Self

Sets the telemetry options.

impl GetBatchResults

pub fn retry(self, policy: RetryPolicy) -> Self

Sets the retry policy (default: two retries).

pub fn max_retries(self, max_retries: u32) -> Self

Sets the number of retries of the default policy.

Trait Implementations

impl Debug for GetBatchResults

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl IntoFuture for GetBatchResults

type Output = Result<Pin<Box<dyn Stream<Item = Result<BatchResultItem, Error>> + Send>>, Error>

The output that the future will produce on completion.

type IntoFuture = Pin<Box<dyn Future<Output = <GetBatchResults as IntoFuture>::Output> + Send>>

Which kind of future are we turning this into?

fn into_future(self) -> Self::IntoFuture

Creates a future from a value.