Struct ContextUse 

pub struct ContextUse {
    pub tokens: u64,
    pub window: Option<u32>,
}

The context a conversation’s next request sends, against the model’s window.

Fields

tokens: u64

Tokens in use.

window: Option<u32>

The model’s window, when known.

Implementations

impl ContextUse

pub fn percent(&self) -> Option<u64>

The share of the window in use, in percent, when the window is known.

Trait Implementations

impl Clone for ContextUse

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ContextUse

impl Debug for ContextUse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for ContextUse

45k/200k (22%), or 45k when the window is not known.

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ContextUse

impl PartialEq for ContextUse

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ContextUse