pub struct KvSlotRequest {
pub cache_id: String,
pub target_len: usize,
pub admission_target_len: Option<usize>,
}Expand description
One model-owned KV slot reservation request.
cache_id is the executor/model cache key attached to a sequence. target_len
is the sequence length that must be writable before the next forward runs.
admission_target_len, when present, is a larger known-context bound used
only for admission fit checks. Paged models must not allocate future blocks
for it; it mirrors vLLM’s chunked-prefill full-context fit gate.
Fields§
§cache_id: String§target_len: usize§admission_target_len: Option<usize>Trait Implementations§
Source§impl Clone for KvSlotRequest
impl Clone for KvSlotRequest
Source§fn clone(&self) -> KvSlotRequest
fn clone(&self) -> KvSlotRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for KvSlotRequest
impl Debug for KvSlotRequest
Source§impl<'de> Deserialize<'de> for KvSlotRequest
impl<'de> Deserialize<'de> for KvSlotRequest
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for KvSlotRequest
Source§impl PartialEq for KvSlotRequest
impl PartialEq for KvSlotRequest
Source§impl Serialize for KvSlotRequest
impl Serialize for KvSlotRequest
impl StructuralPartialEq for KvSlotRequest
Auto Trait Implementations§
impl Freeze for KvSlotRequest
impl RefUnwindSafe for KvSlotRequest
impl Send for KvSlotRequest
impl Sync for KvSlotRequest
impl Unpin for KvSlotRequest
impl UnsafeUnpin for KvSlotRequest
impl UnwindSafe for KvSlotRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more