pub struct ToolTrajectoryScorer { /* private fields */ }Available on crate feature
eval only.Expand description
Scorer for tool trajectory matching
Implementations§
Source§impl ToolTrajectoryScorer
impl ToolTrajectoryScorer
Sourcepub fn new() -> ToolTrajectoryScorer
pub fn new() -> ToolTrajectoryScorer
Create a new scorer with default config
Sourcepub fn with_config(config: ToolTrajectoryConfig) -> ToolTrajectoryScorer
pub fn with_config(config: ToolTrajectoryConfig) -> ToolTrajectoryScorer
Create with custom config
Sourcepub fn score(&self, expected: &[ToolUse], actual: &[ToolUse]) -> f64
pub fn score(&self, expected: &[ToolUse], actual: &[ToolUse]) -> f64
Score tool trajectory
Returns a score from 0.0 to 1.0 indicating how well the actual tool calls match the expected tool calls.
Sourcepub fn compare(
&self,
expected: &[ToolUse],
actual: &[ToolUse],
) -> ToolTrajectoryComparison
pub fn compare( &self, expected: &[ToolUse], actual: &[ToolUse], ) -> ToolTrajectoryComparison
Get detailed comparison
Trait Implementations§
Source§impl Default for ToolTrajectoryScorer
impl Default for ToolTrajectoryScorer
Source§fn default() -> ToolTrajectoryScorer
fn default() -> ToolTrajectoryScorer
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for ToolTrajectoryScorer
impl RefUnwindSafe for ToolTrajectoryScorer
impl Send for ToolTrajectoryScorer
impl Sync for ToolTrajectoryScorer
impl Unpin for ToolTrajectoryScorer
impl UnsafeUnpin for ToolTrajectoryScorer
impl UnwindSafe for ToolTrajectoryScorer
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestCreates a shared type from an unshared type.