pub struct BatchSizeCalculator;Expand description
Calculates optimal batch sizes for GPU index construction based on available GPU memory and vector dimensionality.
Implementations§
Source§impl BatchSizeCalculator
impl BatchSizeCalculator
Sourcepub fn calculate_batch_size(vector_dim: usize, gpu_memory_mb: u64) -> usize
pub fn calculate_batch_size(vector_dim: usize, gpu_memory_mb: u64) -> usize
Calculate optimal batch size given vector dimension and available GPU memory (MB).
Reserves 25% of GPU memory for overhead (distance matrices, working buffers). Returns at least 1.
Sourcepub fn optimal_batch_for_float32(dim: usize, memory_mb: u64) -> usize
pub fn optimal_batch_for_float32(dim: usize, memory_mb: u64) -> usize
Optimal batch size assuming f32 vectors, with overhead for distance matrix.
Accounts for the O(batch²) memory of a pairwise distance matrix.
Trait Implementations§
Source§impl Clone for BatchSizeCalculator
impl Clone for BatchSizeCalculator
Source§fn clone(&self) -> BatchSizeCalculator
fn clone(&self) -> BatchSizeCalculator
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for BatchSizeCalculator
impl RefUnwindSafe for BatchSizeCalculator
impl Send for BatchSizeCalculator
impl Sync for BatchSizeCalculator
impl Unpin for BatchSizeCalculator
impl UnsafeUnpin for BatchSizeCalculator
impl UnwindSafe for BatchSizeCalculator
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.