pub struct TrackedStream {
pub model_used: String,
pub trace_id: String,
pub events: Receiver<StreamEvent>,
}Expand description
Handle returned by InferenceEngine::generate_tracked_stream: the event
receiver plus the stream-level metadata a caller needs to attribute the
finished turn. trace_id is the same trace the tap task resolves on
completion, so a caller can score the turn against it; model_used is the
resolved model. In-process only (the receiver isn’t serializable) — the wire
layer forwards events and surfaces these fields on the final response itself.
Fields§
§model_used: StringResolved model id for this stream.
trace_id: StringTrace id (minted before the first token) the tap resolves on completion.
events: Receiver<StreamEvent>The forwarded event stream.
Auto Trait Implementations§
impl Freeze for TrackedStream
impl RefUnwindSafe for TrackedStream
impl Send for TrackedStream
impl Sync for TrackedStream
impl Unpin for TrackedStream
impl UnsafeUnpin for TrackedStream
impl UnwindSafe for TrackedStream
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more