pub struct BatchProcessor { /* private fields */ }Expand description
Batch processing for multiple queries
Implementations§
Source§impl BatchProcessor
impl BatchProcessor
Sourcepub fn new(processor: Arc<RagProcessor>) -> Self
pub fn new(processor: Arc<RagProcessor>) -> Self
Create a new batch processor
Sourcepub async fn process_batch(
&self,
queries: Vec<RetrievalQuery>,
) -> Vec<ContextResult<RetrievalResult>> ⓘ
pub async fn process_batch( &self, queries: Vec<RetrievalQuery>, ) -> Vec<ContextResult<RetrievalResult>> ⓘ
Process multiple queries (sequential for async compatibility)
Auto Trait Implementations§
impl Freeze for BatchProcessor
impl !RefUnwindSafe for BatchProcessor
impl Send for BatchProcessor
impl Sync for BatchProcessor
impl Unpin for BatchProcessor
impl !UnwindSafe for BatchProcessor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more