pub struct PrefixHitResult {
pub prefix_hit_tokens: u64,
pub prefix_cache_hit_rate: Option<f64>,
}Expand description
Final prefix-hit metrics after provider usage is available.
Fields§
§prefix_hit_tokens: u64Estimated number of input tokens served from the context prefix.
prefix_cache_hit_rate: Option<f64>prefix_hit_tokens / total_input_tokens; None when there is no
provider-reported total input to calibrate against.
Trait Implementations§
Source§impl Clone for PrefixHitResult
impl Clone for PrefixHitResult
Source§fn clone(&self) -> PrefixHitResult
fn clone(&self) -> PrefixHitResult
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for PrefixHitResult
impl Debug for PrefixHitResult
Source§impl Default for PrefixHitResult
impl Default for PrefixHitResult
Source§fn default() -> PrefixHitResult
fn default() -> PrefixHitResult
Returns the “default value” for a type. Read more
Source§impl PartialEq for PrefixHitResult
impl PartialEq for PrefixHitResult
impl StructuralPartialEq for PrefixHitResult
Auto Trait Implementations§
impl Freeze for PrefixHitResult
impl RefUnwindSafe for PrefixHitResult
impl Send for PrefixHitResult
impl Sync for PrefixHitResult
impl Unpin for PrefixHitResult
impl UnsafeUnpin for PrefixHitResult
impl UnwindSafe for PrefixHitResult
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more