Skip to main content

Module multi_stream

Module multi_stream 

Source
Expand description

Multi-stream kernel launch support.

Launches the same kernel across multiple CUDA streams simultaneously, enabling concurrent execution on the GPU when streams have no inter-dependencies. This is useful for data-parallel workloads where independent chunks can be processed in parallel.

§Example

// Assuming you have a kernel, streams, params, and args set up:
// multi_stream_launch(&kernel, &streams, &params, &args)?;

Functions§

multi_stream_launch
Launches the same kernel across multiple streams with per-stream parameters and arguments.
multi_stream_launch_uniform
Launches the same kernel across multiple streams with uniform parameters and arguments.