Struct Block 

pub struct Block {
    pub device: usize,
    pub size: usize,
    pub ptr: usize,
    pub stream: StreamId,
    pub stream_uses: HashSet<StreamId>,
    pub allocated: bool,
    pub prev: Option<usize>,
    pub next: Option<usize>,
    pub in_small_pool: bool,
    /* private fields */
}

Metadata for a contiguous region of GPU memory.

Blocks form a doubly-linked list within a segment (a single driver allocation). Splitting a block creates a new block for the remainder and links them. Coalescing merges adjacent free blocks by adjusting the linked list and summing sizes.

CL-323

Fields

device: usize

Device ordinal that owns this memory.

size: usize

Size of this block in bytes.

ptr: usize

Virtual address of the block’s start (byte offset within its segment). Used for ordering during coalescing. For blocks that own real GPU memory, this is derived from the CudaSlice pointer. For sub-blocks created by splitting, this is computed as parent.ptr + parent.size_before_split.

stream: StreamId

The CUDA stream on which this block was originally allocated.

stream_uses: HashSet<StreamId>

Set of streams that have used this block (via record_stream). A block cannot be reused until all recorded stream work is complete.

allocated: bool

Whether this block is currently handed out to a caller.

prev: Option<usize>

Index of the previous block in the segment’s linked list, or None.

next: Option<usize>

Index of the next block in the segment’s linked list, or None.

in_small_pool: bool

Whether this block is in the small pool.

Implementations

impl Block

pub fn new( device: usize, size: usize, ptr: usize, stream: StreamId, in_small_pool: bool, ) -> Self

Create a new block with the given parameters.

pub fn is_split(&self) -> bool

Whether this block was created by splitting (has neighbors).

Trait Implementations

impl Debug for Block

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.