Struct InferenceResultStream 

pub struct InferenceResultStream { /* private fields */ }

A streaming view of an incremental distributed inference session.

Results arrive asynchronously via an internal mpsc channel as each peer responds. The caller polls next_partial to receive one PartialResult per peer response until the session is complete or the deadline expires.

Example

// (obtained from Node::infer_streaming)
let mut stream: InferenceResultStream = todo!();
while let Some(partial) = stream.next_partial().await {
    println!("peer {}: {} new bindings", partial.peer_id, partial.new_bindings.len());
    if partial.is_final { break; }
}

Implementations

impl InferenceResultStream

pub fn new( session_id: String, rx: Receiver<InferenceResponse>, deadline: Instant, ) -> Self

Construct a new stream from a channel receiver and a deadline.

This is used internally by Node::infer_streaming; callers should not normally construct this directly.

pub fn session_id(&self) -> &str

The session identifier.

pub fn result_count(&self) -> usize

Number of binding sets accumulated so far.

pub async fn next_partial(&mut self) -> Option<PartialResult>

Poll for the next partial result.

Returns None when the deadline has passed or the channel is closed, indicating that no further results will arrive.