Skip to main content

CudaMemPoolBuilder

Struct CudaMemPoolBuilder 

Source
pub struct CudaMemPoolBuilder { /* private fields */ }
Expand description

Builder for creating a CUDA memory pool with configurable parameters.

§Example

let pool = CudaMemPoolBuilder::new(context, 64 * 1024 * 1024) // 64 MiB reserve
    .release_threshold(32 * 1024 * 1024) // 32 MiB release threshold
    .build()?;

Implementations§

Source§

impl CudaMemPoolBuilder

Source

pub fn new(context: Arc<CudaContext>, reserve_size: usize) -> Self

Create a new builder with the required reserve size.

§Arguments
  • context - CUDA context for the device
  • reserve_size - Number of bytes to pre-allocate to warm the pool
Source

pub fn release_threshold(self, threshold: u64) -> Self

Set the release threshold for the pool.

Memory above this threshold is returned to the system when freed. If not set, no release threshold is configured (CUDA default behavior).

Source

pub fn build(self) -> Result<CudaMemPool>

Build the CUDA memory pool.

This will:

  1. Create the pool
  2. Set the release threshold if configured
  3. Pre-allocate and free memory to warm the pool

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more