Struct PinnedStorage 

pub struct PinnedStorage { /* private fields */ }

CUDA pinned host memory allocated via cudaHostAlloc.

Implementations

impl PinnedStorage

pub fn new(len: usize) -> Result<Self>

Allocate new pinned memory of the given size.

This is a convenience method that calls new_for_device(len, None).

Arguments

• len - Size in bytes to allocate

pub fn new_for_device(len: usize, device_id: Option<u32>) -> Result<Self>

Allocate pinned memory, optionally NUMA-aware for a specific GPU.

When device_id is Some, NUMA-aware allocation is attempted by default: a worker thread pinned to the GPU’s NUMA node performs the allocation, ensuring optimal memory placement via first-touch policy. If the GPU’s NUMA node cannot be determined, allocation falls back to the direct path. Set DYN_MEMORY_DISABLE_NUMA=1 to skip NUMA optimization entirely.

When device_id is None, a direct allocation is performed on device 0.

Arguments

• len - Size in bytes to allocate
• device_id - If Some, use NUMA-aware allocation on the GPU’s NUMA node

Errors

Returns an error if:

• len is 0
• CUDA context creation fails
• Memory allocation fails

pub unsafe fn as_ptr(&self) -> *const u8

Get a pointer to the underlying memory.

Safety

The caller must ensure the pointer is not used after this storage is dropped.

pub unsafe fn as_mut_ptr(&mut self) -> *mut u8

Get a mutable pointer to the underlying memory.

Safety

The caller must ensure the pointer is not used after this storage is dropped and that there are no other references to this memory.

pub fn ctx(&self) -> &Arc<CudaContext>

Get a reference to the CUDA context used for this allocation.

Trait Implementations

impl Debug for PinnedStorage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for PinnedStorage

fn drop(&mut self)

Executes the destructor for this type.

impl MemoryDescriptor for PinnedStorage

fn addr(&self) -> usize

Base address of the memory region.

fn size(&self) -> usize

Size of the memory region in bytes.

fn storage_kind(&self) -> StorageKind

Type of storage backing this region.

fn as_any(&self) -> &dyn Any

Enable downcasting to concrete type.

fn nixl_descriptor(&self) -> Option<NixlDescriptor>

Get the NIXL descriptor for this memory region.

impl Memset for PinnedStorage

fn memset(&mut self, value: u8, offset: usize, size: usize) -> Result<()>

Sets a region of memory to a specific value

impl NixlCompatible for PinnedStorage

fn nixl_params(&self) -> (*const u8, usize, MemType, u64)

Get parameters needed for NIXL registration.

impl Send for PinnedStorage

impl Sync for PinnedStorage