Struct CudaSessionTransferRequest 

pub struct CudaSessionTransferRequest { /* private fields */ }

A session-scoped transfer request for streaming KV chunks in layer order to a GPU-facing consumer.

Implementations

impl CudaSessionTransferRequest

pub fn new<S>( session_prefix: S, chunks: Vec<CudaChunkTransferDescriptor>, ) -> Self

where S: Into<Bytes>,

pub fn session_prefix(&self) -> &[u8]

pub fn chunks(&self) -> &[CudaChunkTransferDescriptor]

pub fn item_count(&self) -> usize

pub fn total_expected_bytes(&self) -> Option<usize>

Trait Implementations

impl Clone for CudaSessionTransferRequest

fn clone(&self) -> CudaSessionTransferRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CudaSessionTransferRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for CudaSessionTransferRequest

fn eq(&self, other: &CudaSessionTransferRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for CudaSessionTransferRequest

impl StructuralPartialEq for CudaSessionTransferRequest