Struct KvSlot 

pub struct KvSlot {
    pub request_id: u64,
    pub kv_cache_idx: usize,
    pub position: usize,
}

A single request’s slot within the shared KV pool.

Each in-flight request receives one KvSlot that identifies which position in the KV pool belongs to it. The slot is released back to the pool when the request finishes (EOS or max-token limit reached).

Fields

request_id: u64

Unique identifier of the request that owns this slot.

kv_cache_idx: usize

Index into the shared KV cache pool (e.g. the row within a paged KV cache or the sequence slot index in a flat pool).

position: usize

Current sequence position (number of tokens committed so far).

Implementations

impl KvSlot

pub fn new(request_id: u64, kv_cache_idx: usize, position: usize) -> KvSlot

Construct a new KvSlot.

Trait Implementations

impl Clone for KvSlot

fn clone(&self) -> KvSlot

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvSlot

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl PartialEq for KvSlot

fn eq(&self, other: &KvSlot) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for KvSlot

impl Eq for KvSlot

impl StructuralPartialEq for KvSlot