Expand description
Auto-tunes the GPU batch size from available VRAM using the exact buffer layout.
Structs§
- Batch
Sizer - Computes the maximum batch size that fits safely within VRAM.
Constants§
- GPU_
BATCH_ MIN - Minimum number of pairs required to justify the GPU kernel launch overhead.
Below this threshold
DeviceComparatorsilently falls back to the CPU path.