pub struct CacheMiss {
pub missed_tokens: u64,
pub missed_cost: f64,
pub idle_ms: u64,
pub model_changed: bool,
}Expand description
A counted cache miss on one assistant message.
Fields§
§missed_tokens: u64Prompt tokens of the previous request that were not read from the cache.
missed_cost: f64Dollars paid beyond a full cache hit, or 0 when prices are unknown.
idle_ms: u64Milliseconds since the previous request, which last refreshed the cache.
model_changed: boolThe model changed since the previous request.
Trait Implementations§
impl Copy for CacheMiss
impl StructuralPartialEq for CacheMiss
Auto Trait Implementations§
impl Forget for CacheMiss
impl Freeze for CacheMiss
impl RefUnwindSafe for CacheMiss
impl Send for CacheMiss
impl Sync for CacheMiss
impl Unpin for CacheMiss
impl UnsafeUnpin for CacheMiss
impl UnwindSafe for CacheMiss
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more