pub struct CapturedGraph { /* private fields */ }Expand description
A captured and instantiated CUDA graph that can be replayed with
launch.
Created via begin_capture + GPU ops + end_capture.
The graph holds references to all device memory used during capture.
Those buffers must remain allocated for the lifetime of the graph.
Implementations§
Source§impl CapturedGraph
impl CapturedGraph
Sourcepub fn launch(&self) -> GpuResult<()>
pub fn launch(&self) -> GpuResult<()>
Replay all operations captured in this graph.
Before calling this, update any DeviceScalar values and perform
any pre-launch memcpys (e.g., position embeddings). All updates must
be on the same stream the graph was captured on.
Auto Trait Implementations§
impl Freeze for CapturedGraph
impl RefUnwindSafe for CapturedGraph
impl !Send for CapturedGraph
impl !Sync for CapturedGraph
impl Unpin for CapturedGraph
impl UnsafeUnpin for CapturedGraph
impl UnwindSafe for CapturedGraph
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> DistributionExt for Twhere
T: ?Sized,
impl<T> DistributionExt for Twhere
T: ?Sized,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more