Skip to main content

Module gpu_stream

Module gpu_stream 

Source

Structs§

GpuStream
A named handle to a device command queue / CUDA stream.
StreamGuard
Holds a reference to a pool stream slot. Decrements pending_ops on drop. Does not automatically synchronise the stream — call guard.stream().synchronize() explicitly.
StreamPool
Manages N streams created from the same backend device.
StreamSet
A small, fixed collection of streams used to pipeline a single DAG node.

Enums§

StreamAssignment
How the pool selects which stream to lend out.