Struct GpuBatchProcessor 

pub struct GpuBatchProcessor { /* private fields */ }

GPU batch processor for distance calculations.

This processor automatically dispatches to GPU or CPU based on batch size and GPU availability.

Implementations

impl GpuBatchProcessor

pub fn new(config: GpuConfig) -> Result<Self>

Create a new GPU batch processor.

Returns error if GPU is requested but not available.

pub fn is_gpu_available(&self) -> bool

Check if GPU is available and enabled.

pub fn batch_distance( &self, queries: &[Vec<f32>], vectors: &[Vec<f32>], metric: DistanceMetric, ) -> Result<Vec<Vec<f32>>>

Compute batch distances between queries and vectors.

Automatically dispatches to GPU or CPU based on batch size and availability.

Arguments

• queries - Query vectors (N queries x D dimensions)
• vectors - Database vectors (M vectors x D dimensions)
• metric - Distance metric to use

Returns

A 2D matrix of distances (N x M), where result[i][j] is the distance from query i to vector j.