Struct CudaBufferPool 

pub struct CudaBufferPool { /* private fields */ }

Reusable CUDA device-buffer pool for repeated adapter dispatches.

Implementations

impl CudaBufferPool

pub fn new(context: CudaContext) -> Self

Create a new first-fit pool for context with bounded default retention.

impl CudaBufferPool

pub fn take(&self, len: usize) -> Result<CudaPooledDeviceBuffer, CudaError>

Acquire a device buffer with at least len bytes.

pub fn recycle(&self, buffer: CudaDeviceBuffer) -> Result<(), CudaError>

Return a raw device buffer to this pool.

pub fn upload(&self, bytes: &[u8]) -> Result<CudaPooledDeviceBuffer, CudaError>

Upload host bytes into a pooled device buffer.

pub fn upload_pinned( &self, bytes: &[u8], ) -> Result<CudaPooledDeviceBuffer, CudaError>

Upload host bytes through temporary page-locked staging into a pooled device buffer.

pub fn upload_f32( &self, samples: &[f32], ) -> Result<CudaPooledDeviceBuffer, CudaError>

Upload host f32 samples into a pooled device buffer.

pub fn upload_f32_pinned( &self, samples: &[f32], ) -> Result<CudaPooledDeviceBuffer, CudaError>

Upload host f32 samples through pinned staging into a pooled device buffer.

pub fn cached_count(&self) -> Result<usize, CudaError>

Number of free buffers currently cached by the pool.

Trait Implementations

impl Clone for CudaBufferPool

fn clone(&self) -> CudaBufferPool

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CudaBufferPool

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.