pub struct PendingQueries { /* private fields */ }Expand description
Join barrier that collects N LLM responses.
Responses can be fed in any order and concurrency. Becomes complete when all queries have been responded to.
Implementations§
Source§impl PendingQueries
impl PendingQueries
pub fn new(queries: Vec<LlmQuery>) -> Self
Sourcepub fn feed(
&mut self,
id: &QueryId,
response: String,
) -> Result<bool, FeedError>
pub fn feed( &mut self, id: &QueryId, response: String, ) -> Result<bool, FeedError>
Feed one response. Returns true if all queries are now complete.
pub fn pending_queries(&self) -> Vec<&LlmQuery>
pub fn remaining(&self) -> usize
pub fn is_complete(&self) -> bool
Sourcepub fn into_ordered_responses(self) -> Vec<String>
pub fn into_ordered_responses(self) -> Vec<String>
Consume and return responses in query insertion order. Corresponds to the Paused → Running transition.
Trait Implementations§
Source§impl Debug for PendingQueries
impl Debug for PendingQueries
Source§impl<'de> Deserialize<'de> for PendingQueries
impl<'de> Deserialize<'de> for PendingQueries
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for PendingQueries
impl RefUnwindSafe for PendingQueries
impl Send for PendingQueries
impl Sync for PendingQueries
impl Unpin for PendingQueries
impl UnsafeUnpin for PendingQueries
impl UnwindSafe for PendingQueries
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more