Struct CacheEntry 

pub struct CacheEntry {
    pub seq: Seq,
    pub tokens: Vec<u32>,
    pub pins: u32,
    pub last_used: u64,
    pub bytes: u64,
    pub seeded: u32,
    pub shared: bool,
    pub exported: Option<Vec<u8>>,
    pub prompt: u64,
}

Fields

seq: Seq

The entry’s sequence while it is in the pool, and its name either way (a runtime never hands a handle out twice).

tokens: Vec<u32>

pins: u32

last_used: u64

bytes: u64

seeded: u32

Lanes started from this entry.

shared: bool

A copy of a live lane’s state, published for the requests that share its prefix: a lane seeded from it copies, never takes it over.

exported: Option<Vec<u8>>

Some: the entry is out of the pool, held as the runtime’s lossless export of its tokens.len() tokens of state; its sequence is freed.

prompt: u64

How much of tokens was the prompt of the lane that left the entry (the rest it generated); 0 where none is known.

Implementations

impl CacheEntry

pub fn share(&self, len: u64) -> bool

Whether len tokens are a real part of this entry.

pub fn serves(&self, len: u64) -> bool

Whether a seed of len tokens is served from this entry: any, from one in the pool (a copy); a real part of it, from an export.

pub fn holds_shared_prefix(&self) -> bool

An entry holds a prefix requests share when it is a lane’s state published for them, or has started two lanes or more: it goes after every entry that does not.

pub fn covered_by(&self, other: &CacheEntry) -> bool

Whether other serves what this entry does: its tokens begin with all of this entry’s, or all but a share of them when it was used later.