pub struct PagedKvCacheDescriptor {
pub page_size: i32,
pub num_total_pages: i32,
pub num_kv_heads: i32,
pub head_dim: i32,
pub element: ElementKind,
}Expand description
Descriptor for a paged KV-cache descriptor (kHND layout). Mirrors
FlashInfer’s paged_kv_t host-side fields.
Fields§
§page_size: i32Number of rows per page (e.g. 16 or 32 in vLLM defaults).
num_total_pages: i32Total physical pages allocated by the caller’s BlockManager.
num_kv_heads: i32KV heads (typically num_qo_heads / gqa_group_size).
head_dim: i32Per-head feature dimension.
element: ElementKindElement type of k_data / v_data.
Trait Implementations§
Source§impl Clone for PagedKvCacheDescriptor
impl Clone for PagedKvCacheDescriptor
Source§fn clone(&self) -> PagedKvCacheDescriptor
fn clone(&self) -> PagedKvCacheDescriptor
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for PagedKvCacheDescriptor
Auto Trait Implementations§
impl Freeze for PagedKvCacheDescriptor
impl RefUnwindSafe for PagedKvCacheDescriptor
impl Send for PagedKvCacheDescriptor
impl Sync for PagedKvCacheDescriptor
impl Unpin for PagedKvCacheDescriptor
impl UnsafeUnpin for PagedKvCacheDescriptor
impl UnwindSafe for PagedKvCacheDescriptor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more