pub struct TokenCalibration {
pub provider_tokens: u64,
pub estimated_tokens: u64,
}Expand description
Provider-reported vs conservatively estimated footprint of ONE request. The user-visible context number is the provider’s; the policy’s is the estimate. Their ratio converts a target into estimator units.
Fields§
§provider_tokens: u64§estimated_tokens: u64Implementations§
Source§impl TokenCalibration
impl TokenCalibration
Sourcepub const MIN_RATIO: (u64, u64)
pub const MIN_RATIO: (u64, u64)
Accepted estimate/provider ratios. The conservative estimator should read at or above the provider; outside this band a sample is more likely a transport/accounting artifact (omitted cache fields, a proxy, a mismatched request) than a tokenizer difference, so the plain estimator is used instead.
pub const MAX_RATIO: (u64, u64)
pub fn plausible(&self) -> bool
Trait Implementations§
Source§impl Clone for TokenCalibration
impl Clone for TokenCalibration
Source§fn clone(&self) -> TokenCalibration
fn clone(&self) -> TokenCalibration
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for TokenCalibration
Source§impl Debug for TokenCalibration
impl Debug for TokenCalibration
impl Eq for TokenCalibration
Source§impl PartialEq for TokenCalibration
impl PartialEq for TokenCalibration
impl StructuralPartialEq for TokenCalibration
Auto Trait Implementations§
impl Freeze for TokenCalibration
impl RefUnwindSafe for TokenCalibration
impl Send for TokenCalibration
impl Sync for TokenCalibration
impl Unpin for TokenCalibration
impl UnsafeUnpin for TokenCalibration
impl UnwindSafe for TokenCalibration
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
Source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.Source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.Source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.Source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.Source§impl<T> DowncastSync for T
impl<T> DowncastSync for T
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
Source§impl<'a, T> Prefix<&'a [T], T> for T
impl<'a, T> Prefix<&'a [T], T> for T
Source§fn take_prefix(&self, haystack: &'a [T]) -> Option<(T, &'a [T])>
fn take_prefix(&self, haystack: &'a [T]) -> Option<(T, &'a [T])>
Remove the prefix described by this prefix from the haystack if present, and if so,
return it along with the rest of the haystack.
Source§fn skip_prefix(&self, haystack: Parent) -> Option<Parent>
fn skip_prefix(&self, haystack: Parent) -> Option<Parent>
Remove the prefix described by this prefix from the haystack if present, and return
the rest of the haystack (result is ignored).