Struct Timing 

pub struct Timing {
    pub tokenize: Duration,
    pub device: Duration,
    pub batches: usize,
    pub truncated: usize,
    pub cut_tokens: usize,
}

Where the time of one Kime::decide_batch_timed call went.

Fields

tokenize: Duration

Validating the requests and laying their questions out as token ids.

device: Duration

The device batches, from the first upload to the last result copied back.

batches: usize

How many device batches the questions took.

truncated: usize

Questions whose state was cut to fit the model’s sequence length.

cut_tokens: usize

State tokens left out of those questions.

Trait Implementations

impl Clone for Timing

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Timing

impl Debug for Timing

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Timing

fn default() -> Self

Returns the “default value” for a type.

impl Eq for Timing

impl PartialEq for Timing

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Timing