Struct CapturedGraph 

pub struct CapturedGraph { /* private fields */ }

A captured and instantiated CUDA graph that can be replayed with launch.

Created via begin_capture + GPU ops + end_capture. The graph holds references to all device memory used during capture. Those buffers must remain allocated for the lifetime of the graph.

Allocator pool integration (CL-278). When created via end_capture_with_pool, the graph holds a strong reference to the CapturePool that recorded its allocations. The pool keeps every registered buffer alive until the last CapturedGraph referencing it is dropped, which guarantees the device pointers recorded in the graph remain valid across replays. Without the pool, callers must manually keep buffers alive (the original end_capture API).

Implementations

impl CapturedGraph

pub fn launch(&self) -> GpuResult<()>

Replay all operations captured in this graph.

Before calling this, update any DeviceScalar values and perform any pre-launch memcpys (e.g., position embeddings). All updates must be on the same stream the graph was captured on.

Bumps num_replays on success.

pub fn upload(&self) -> GpuResult<()>

Pre-upload the graph’s executable resources to the device.

The first launch of a freshly instantiated graph pays a one-time cost for the driver to copy the exec into GPU memory. Calling upload up front shifts that cost out of the hot replay loop. Subsequent uploads are a no-op. CL-454.

pub fn num_replays(&self) -> u64

Number of successful replays issued on this graph. CL-454.

pub fn is_uploaded(&self) -> bool

Returns true if upload has been called on this graph. CL-454.

pub fn pool_buffer_count(&self) -> usize

Number of buffers held alive by this graph’s allocator pool. Returns 0 if the graph was created without a pool. CL-278.

pub fn has_pool(&self) -> bool

True if this graph holds a CapturePool reference. CL-278.

pub fn pool(&self) -> Option<&Arc<CapturePool>>

Return the Arc<CapturePool> this graph is using, if any. Allows sharing the same pool between multiple graphs so they all keep the same buffers alive. CL-454.