Struct ContextUsage 

pub struct ContextUsage {
    pub tokens: Option<u64>,
    pub context_window: u64,
}

How full the context window is.

Fields

tokens: Option<u64>

Estimated context tokens, unknown right after a compaction.

context_window: u64

The model’s context window.

Implementations

impl ContextUsage

pub fn percent(&self) -> Option<f64>

Percent of the window in use, when known.

Trait Implementations

impl Clone for ContextUsage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ContextUsage

impl Debug for ContextUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ContextUsage

impl PartialEq for ContextUsage

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ContextUsage