Struct GpuMemoryBudget 

pub struct GpuMemoryBudget {
    pub total_mb: u64,
    pub reserved_mb: u64,
    pub available_mb: u64,
}

GPU memory budget tracker for index construction.

Fields

total_mb: u64

Total GPU memory in MB

reserved_mb: u64

Memory reserved for runtime/OS overhead in MB

available_mb: u64

Memory available for index construction in MB

Implementations

impl GpuMemoryBudget

pub fn new(total_mb: u64, reserved_mb: u64) -> Self

Create a new memory budget.

reserved_mb should cover GPU runtime, kernels, and OS overhead.

pub fn can_fit_batch(&self, batch_size: usize, dim: usize) -> bool

Returns true if a batch of batch_size f32 vectors of dimension dim fits within the available memory budget.

pub fn bytes_per_vector(&self, dim: usize) -> u64

Bytes required for a single f32 vector of the given dimension.

Trait Implementations

impl Clone for GpuMemoryBudget

fn clone(&self) -> GpuMemoryBudget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GpuMemoryBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.