pub struct TimeoutConfiguration {
pub total_ms: Option<u64>,
pub step_ms: Option<u64>,
pub first_chunk_ms: Option<u64>,
pub chunk_ms: Option<u64>,
}Expand description
Per-call timeout configuration.
Aligned with V4 LanguageModelV4CallOptions.timeout
(TimeoutConfiguration). All values are milliseconds; None disables the
corresponding limit. A total timeout also covers retry backoff and the
whole streamed response.
Fields§
§total_ms: Option<u64>Overall timeout for the entire call (including retries and, for streaming, the whole stream), in milliseconds.
step_ms: Option<u64>Timeout for one generation step, including that step’s attempts and retry backoff, in milliseconds. Aimux currently has one step.
first_chunk_ms: Option<u64>Timeout waiting for the first stream chunk (streaming only).
Counted from operation start, so it also bounds stream establishment and any retries before the first semantic output: it is the user-perceived time-to-first-output budget, not a per-attempt timer.
chunk_ms: Option<u64>Maximum idle time between consecutive stream chunks (streaming only).
Trait Implementations§
Source§impl Clone for TimeoutConfiguration
impl Clone for TimeoutConfiguration
impl Copy for TimeoutConfiguration
Source§impl Debug for TimeoutConfiguration
impl Debug for TimeoutConfiguration
Source§impl Default for TimeoutConfiguration
impl Default for TimeoutConfiguration
Source§impl<'de> Deserialize<'de> for TimeoutConfiguration
impl<'de> Deserialize<'de> for TimeoutConfiguration
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
impl Eq for TimeoutConfiguration
Source§impl PartialEq for TimeoutConfiguration
impl PartialEq for TimeoutConfiguration
Source§impl Serialize for TimeoutConfiguration
impl Serialize for TimeoutConfiguration
impl StructuralPartialEq for TimeoutConfiguration
Source§impl TS for TimeoutConfiguration
impl TS for TimeoutConfiguration
Source§type WithoutGenerics = TimeoutConfiguration
type WithoutGenerics = TimeoutConfiguration
WithoutGenerics should just be Self.
If the type does have generic parameters, then all generic parameters must be replaced with
a dummy type, e.g ts_rs::Dummy or (). The only requirement for these dummy types is that
EXPORT_TO must be None. Read moreSource§type OptionInnerType = TimeoutConfiguration
type OptionInnerType = TimeoutConfiguration
std::option::Option<T>, then this associated type is set to T.
All other implementations of TS should set this type to Self instead.Source§fn docs() -> Option<String>
fn docs() -> Option<String>
TS is derived, docs are
automatically read from your doc comments or #[doc = ".."] attributesSource§fn decl_concrete(cfg: &Config) -> String
fn decl_concrete(cfg: &Config) -> String
TS::decl().
If this type is not generic, then this function is equivalent to TS::decl().Source§fn decl(cfg: &Config) -> String
fn decl(cfg: &Config) -> String
type User = { user_id: number, ... }.
This function will panic if the type has no declaration. Read moreSource§fn inline(cfg: &Config) -> String
fn inline(cfg: &Config) -> String
{ user_id: number }.
This function will panic if the type cannot be inlined.Source§fn inline_flattened(cfg: &Config) -> String
fn inline_flattened(cfg: &Config) -> String
Source§fn visit_generics(v: &mut impl TypeVisitor)where
Self: 'static,
fn visit_generics(v: &mut impl TypeVisitor)where
Self: 'static,
Source§fn output_path() -> Option<PathBuf>
fn output_path() -> Option<PathBuf>
T should be exported, relative to the output directory.
The returned path does not include any base directory. Read moreSource§fn visit_dependencies(v: &mut impl TypeVisitor)where
Self: 'static,
fn visit_dependencies(v: &mut impl TypeVisitor)where
Self: 'static,
Source§fn dependencies(cfg: &Config) -> Vec<Dependency>where
Self: 'static,
fn dependencies(cfg: &Config) -> Vec<Dependency>where
Self: 'static,
Source§fn export(cfg: &Config) -> Result<(), ExportError>where
Self: 'static,
fn export(cfg: &Config) -> Result<(), ExportError>where
Self: 'static,
TS::export_all. Read moreSource§fn export_all(cfg: &Config) -> Result<(), ExportError>where
Self: 'static,
fn export_all(cfg: &Config) -> Result<(), ExportError>where
Self: 'static,
TS::export. Read moreSource§fn export_to_string(cfg: &Config) -> Result<String, ExportError>where
Self: 'static,
fn export_to_string(cfg: &Config) -> Result<String, ExportError>where
Self: 'static,
Auto Trait Implementations§
impl Freeze for TimeoutConfiguration
impl RefUnwindSafe for TimeoutConfiguration
impl Send for TimeoutConfiguration
impl Sync for TimeoutConfiguration
impl Unpin for TimeoutConfiguration
impl UnsafeUnpin for TimeoutConfiguration
impl UnwindSafe for TimeoutConfiguration
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.