pub struct EmbedUsage {
pub input_tokens: u32,
}Expand description
Re-exports of the embed wire types per ADR 0017. Embed lives on
the third inferd socket (separate from v1 and v2); the
proto types are re-exported here so consumers don’t need a separate
inferd-proto dep.
Token-count usage report carried on embeddings frames.
Embed requests have no output tokens (the output is a vector, not
a generation), so only input_tokens is reported.
Fields§
§input_tokens: u32Tokens consumed by the input strings (sum across the batch).
Trait Implementations§
Source§impl Clone for EmbedUsage
impl Clone for EmbedUsage
Source§fn clone(&self) -> EmbedUsage
fn clone(&self) -> EmbedUsage
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EmbedUsage
impl Debug for EmbedUsage
Source§impl<'de> Deserialize<'de> for EmbedUsage
impl<'de> Deserialize<'de> for EmbedUsage
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<EmbedUsage, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<EmbedUsage, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for EmbedUsage
impl PartialEq for EmbedUsage
Source§fn eq(&self, other: &EmbedUsage) -> bool
fn eq(&self, other: &EmbedUsage) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for EmbedUsage
impl Serialize for EmbedUsage
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl Copy for EmbedUsage
impl Eq for EmbedUsage
impl StructuralPartialEq for EmbedUsage
Auto Trait Implementations§
impl Freeze for EmbedUsage
impl RefUnwindSafe for EmbedUsage
impl Send for EmbedUsage
impl Sync for EmbedUsage
impl Unpin for EmbedUsage
impl UnsafeUnpin for EmbedUsage
impl UnwindSafe for EmbedUsage
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more