pub struct ConsistencyGate { /* private fields */ }Expand description
A gate that scores the candidate by agreement with k fresh samples of the same model.
Implementations§
Source§impl ConsistencyGate
impl ConsistencyGate
Sourcepub fn new(
id: impl Into<String>,
provider: Arc<dyn Provider>,
sample_model: impl Into<String>,
auth: Auth,
k: u32,
threshold: f64,
prices: PriceTable,
) -> Self
pub fn new( id: impl Into<String>, provider: Arc<dyn Provider>, sample_model: impl Into<String>, auth: Auth, k: u32, threshold: f64, prices: PriceTable, ) -> Self
Build a consistency gate. provider serves sample_model; auth carries credentials;
prices prices the k sample calls onto the receipt.
Trait Implementations§
Source§impl Debug for ConsistencyGate
impl Debug for ConsistencyGate
Source§impl Gate for ConsistencyGate
impl Gate for ConsistencyGate
Source§fn evaluate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
req: &'life1 ModelRequest,
resp: &'life2 ModelResponse,
) -> Pin<Box<dyn Future<Output = GateResult> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn evaluate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
req: &'life1 ModelRequest,
resp: &'life2 ModelResponse,
) -> Pin<Box<dyn Future<Output = GateResult> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Evaluate the candidate response, producing a verdict + evidence.
Source§fn abstain_fails_closed(&self) -> bool
fn abstain_fails_closed(&self) -> bool
Whether an abstain from this gate blocks serving like a
Fail (§7.2,
on_abstain = "fail_closed"). Default false = fail-open, the historical behavior.
The abstain verdict itself is still recorded honestly on the receipt; only the
aggregation treats it as blocking.Auto Trait Implementations§
impl !RefUnwindSafe for ConsistencyGate
impl !UnwindSafe for ConsistencyGate
impl Freeze for ConsistencyGate
impl Send for ConsistencyGate
impl Sync for ConsistencyGate
impl Unpin for ConsistencyGate
impl UnsafeUnpin for ConsistencyGate
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreCreates a shared type from an unshared type.