Struct BatchPagedDecodeDescriptor 

pub struct BatchPagedDecodeDescriptor {
    pub batch_size: i32,
    pub num_qo_heads: i32,
    pub sm_scale: f32,
    pub paged_kv: PagedKvCacheDescriptor,
}

Descriptor for a batched paged-KV decode op.

Fields

batch_size: i32

Number of requests in the batch (each contributes 1 query row).

num_qo_heads: i32

Query / output attention heads.

sm_scale: f32

Score scaling factor — typically 1.0 / sqrt(head_dim).

paged_kv: PagedKvCacheDescriptor

Paged cache descriptor (shared between K and V — same shape/dtype).

Trait Implementations

impl Clone for BatchPagedDecodeDescriptor

fn clone(&self) -> BatchPagedDecodeDescriptor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for BatchPagedDecodeDescriptor

impl Debug for BatchPagedDecodeDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.