pub struct Harness { /* private fields */ }Expand description
Runs sweeps against a dataset using a fixed embedder (+ optional LLM).
Implementations§
Source§impl Harness
impl Harness
Sourcepub fn new(
embedder: Arc<dyn Embedder>,
chat: Option<Arc<dyn ChatModel>>,
) -> Self
pub fn new( embedder: Arc<dyn Embedder>, chat: Option<Arc<dyn ChatModel>>, ) -> Self
Build a harness with the embedder used for every config in the sweep.
Sourcepub async fn run(
&self,
dataset: &EvalDataset,
chunk_configs: &[(usize, f32)],
modes: &[RetrievalMode],
top_k: usize,
) -> Result<EvalReport>
pub async fn run( &self, dataset: &EvalDataset, chunk_configs: &[(usize, f32)], modes: &[RetrievalMode], top_k: usize, ) -> Result<EvalReport>
Run the sweep. modes that need an LLM are skipped when no ChatModel
was provided.
Auto Trait Implementations§
impl !RefUnwindSafe for Harness
impl !UnwindSafe for Harness
impl Freeze for Harness
impl Send for Harness
impl Sync for Harness
impl Unpin for Harness
impl UnsafeUnpin for Harness
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
impl<A, B, T> HttpServerConnExec<A, B> for Twhere
B: Body,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more