Skip to main content

Module batch_sizer

Module batch_sizer 

Source
Expand description

Auto-tunes the GPU batch size from available VRAM using the exact buffer layout.

Structs§

BatchSizer
Computes the maximum batch size that fits safely within VRAM.

Constants§

GPU_BATCH_MIN
Minimum number of pairs required to justify the GPU kernel launch overhead. Below this threshold DeviceComparator silently falls back to the CPU path.