Skip to main content

Module pool

ferrotensor_backend

Module pool 

Source
Expand description

Size-keyed reuse of GPU buffers.

Structs§

BufferPool
Free lists of GPU buffers keyed by exact byte size.

Constants§

DEFAULT_MAX_POOLED_BYTES
Default cap on the bytes a pool keeps for reuse (512 MiB).