pub struct RequestTiming {
pub time_to_headers: Option<Duration>,
pub time_to_first_token: Option<Duration>,
pub first_token_kind: Option<FirstTokenKind>,
}Expand description
Timing measured from the start of one logical request.
time_to_headers is available after the HTTP response headers arrive.
time_to_first_token is only available for streaming model output.
Fields§
§time_to_headers: Option<Duration>Time from request start until HTTP response headers arrived.
time_to_first_token: Option<Duration>Time from request start until the first streamed token; None for
non-streaming requests.
first_token_kind: Option<FirstTokenKind>The kind of output that produced the first token.
Trait Implementations§
Source§impl Clone for RequestTiming
impl Clone for RequestTiming
impl Copy for RequestTiming
Source§impl Debug for RequestTiming
impl Debug for RequestTiming
Source§impl Default for RequestTiming
impl Default for RequestTiming
impl Eq for RequestTiming
Source§impl PartialEq for RequestTiming
impl PartialEq for RequestTiming
impl StructuralPartialEq for RequestTiming
Auto Trait Implementations§
impl Freeze for RequestTiming
impl RefUnwindSafe for RequestTiming
impl Send for RequestTiming
impl Sync for RequestTiming
impl Unpin for RequestTiming
impl UnsafeUnpin for RequestTiming
impl UnwindSafe for RequestTiming
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.