Skip to main content

SimpleStreamOptions

Struct SimpleStreamOptions 

Source
pub struct SimpleStreamOptions {
Show 13 fields pub api_key: Option<String>, pub timeout: Option<Duration>, pub max_retries: Option<u32>, pub max_retry_delay: Option<Duration>, pub headers: Option<BTreeMap<String, String>>, pub metadata: Option<BTreeMap<String, String>>, pub cache_retention: CacheRetention, pub session_id: Option<String>, pub signal: CancellationToken, pub reasoning: Option<ThinkingLevel>, pub max_tokens: Option<u64>, pub temperature: Option<f64>, pub thinking_budgets: Option<ThinkingBudgets>,
}
Expand description

Options for a “simple” (non-agent) stream call — what compaction / smoke tests / bare provider usage pass. The agent loop wraps this with its richer equivalent when it drives a real turn (M2).

Fields§

§api_key: Option<String>

API key. A provider may fall back to an env var when None (M3 anthropic reads ANTHROPIC_API_KEY); faux ignores it.

§timeout: Option<Duration>

Request timeout. Defaults to 600 seconds; None uses the same provider fallback and can be used by patches to clear a caller override.

§max_retries: Option<u32>

Max retry attempts on retryable errors (408/409/429/>=500). None = 0.

§max_retry_delay: Option<Duration>

Cap on the total backoff between retries. None = 60s.

§headers: Option<BTreeMap<String, String>>

Extra HTTP headers to send (merged over provider defaults).

§metadata: Option<BTreeMap<String, String>>

Free-form provider metadata (request id, trace id, …). Anthropic reads user_id for abuse tracking; faux ignores it.

§cache_retention: CacheRetention

Cache-retention hint for prompt caching.

§session_id: Option<String>

Optional session id (faux uses it to simulate prompt-cache hits).

§signal: CancellationToken

Cancellation token. Providers must poll this between chunks and emit an Error { reason: Aborted } terminal event when cancelled. Defaults to a fresh un-cancelled token so Default-constructed options never abort.

§reasoning: Option<ThinkingLevel>

Extended-thinking level. None/Off → thinking disabled (provider may still emit thinking: { type: "disabled" } when the model reasons). Mirrors TS SimpleStreamOptions.reasoning.

§max_tokens: Option<u64>

Optional caller override for the requested output-token ceiling. None lets the provider fit the thinking budget inside Model::max_tokens. Mirrors TS SimpleStreamOptions.maxTokens.

§temperature: Option<f64>

Sampling temperature. Only applied when the model supports it AND thinking is disabled (Anthropic rejects temperature under thinking). Mirrors TS StreamOptions.temperature.

§thinking_budgets: Option<ThinkingBudgets>

Per-level reasoning token budgets for budget-based thinking models. Faux ignores this; anthropic uses it in adjust_max_tokens_for_thinking.

Implementations§

Source§

impl SimpleStreamOptions

Source

pub fn new() -> Self

Source

pub fn with_api_key(self, key: impl Into<String>) -> Self

Source

pub fn with_signal(self, signal: CancellationToken) -> Self

Source

pub fn reasoning_level(&self) -> ThinkingLevel

Resolve the effective reasoning level, defaulting to Off when unset.

Source

pub fn request_timeout(&self) -> Duration

Resolve the effective request timeout, including the provider fallback.

Trait Implementations§

Source§

impl Clone for SimpleStreamOptions

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for SimpleStreamOptions

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for SimpleStreamOptions

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more