pub struct TokenUsage {
pub cache_read: i64,
pub cache_write: i64,
pub input: i64,
pub output: i64,
}Expand description
Tokens consumed. Cached reads and writes are counted apart from fresh input because providers price them very differently, and blending them makes any derived cost wrong by whatever the cache hit rate happened to be.
Fields§
§cache_read: i64Tokens served from the provider’s prompt cache.
cache_write: i64Tokens written into the provider’s prompt cache.
input: i64Prompt tokens billed at the input rate.
output: i64Generated tokens.
Trait Implementations§
Source§impl Clone for TokenUsage
impl Clone for TokenUsage
Source§impl Debug for TokenUsage
impl Debug for TokenUsage
Source§impl<'de> Deserialize<'de> for TokenUsage
impl<'de> Deserialize<'de> for TokenUsage
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for TokenUsage
impl PartialEq for TokenUsage
Source§impl Serialize for TokenUsage
impl Serialize for TokenUsage
impl StructuralPartialEq for TokenUsage
Auto Trait Implementations§
impl Freeze for TokenUsage
impl RefUnwindSafe for TokenUsage
impl Send for TokenUsage
impl Sync for TokenUsage
impl Unpin for TokenUsage
impl UnsafeUnpin for TokenUsage
impl UnwindSafe for TokenUsage
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more