Struct ServiceStreamPool 

pub struct ServiceStreamPool { /* private fields */ }

Service-level CUDA stream pool for short-lived native worker tasks.

The pool owns a bounded set of same-device cuDF runtimes. Each runtime carries one CUDA stream and the process-local device memory manager. Streams are created lazily up to pool_size; dropping a StreamLease returns the runtime to the pool for reuse. This avoids creating a CUDA stream for every bounded source-read worker while preserving the existing reservation-aware allocator contract.

Implementations

impl ServiceStreamPool

pub fn new(device: DeviceId, pool_size: usize) -> Result<Self>

Create a stream pool for device.

pool_size is the maximum number of simultaneously leased streams. Runtime/stream creation is lazy: construction records the limit but does not allocate CUDA streams immediately.

pub fn device(&self) -> DeviceId

CUDA device served by this pool.

pub fn acquire(&self) -> Result<StreamLease>

Acquire a CUDA stream/runtime lease, blocking when all pool slots are busy.

Trait Implementations

impl Clone for ServiceStreamPool

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ServiceStreamPool

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.