Struct CacheTierAttribution 

#[non_exhaustive]
pub struct CacheTierAttribution {
    pub g1_reused_input_tokens: usize,
    pub host_reused_input_tokens: usize,
}

First-admission provenance for prompt tokens reused across cache tiers.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

g1_reused_input_tokens: usize

Reused prompt tokens already resident in device KV before any H2D.

host_reused_input_tokens: usize

Additional reused prompt tokens restored from the native host tier.

Trait Implementations

impl Clone for CacheTierAttribution

fn clone(&self) -> CacheTierAttribution

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CacheTierAttribution

impl Debug for CacheTierAttribution

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for CacheTierAttribution

impl PartialEq for CacheTierAttribution

fn eq(&self, other: &CacheTierAttribution) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CacheTierAttribution