Expand description
Memory management module.
Structs§
- Hardware
Properties - Properties of the device related to the accelerator hardware.
- Memory
Device Properties - Properties of the device related to allocation.
- Memory
Management - Reserves and keeps track of chunks of memory in the storage, and slices upon these chunks.
- Memory
Management Options - The options for creating a new MemoryManagement instance.
- Memory
Pool Options - Options to create a memory pool.
- Memory
Usage - Amount of memory in use by this allocator and statistics on how much memory is reserved and wasted in total.
- Slice
Binding - Binding of a memory handle.
- Slice
Handle - Memory Handle.
- SliceId
- Memory ID.
Enums§
- Memory
Allocation Mode - The mode of allocation used.
- Memory
Configuration - High level configuration of memory management.
- Pool
Type - The type of memory pool to use.
Traits§
- Memory
Handle - The managed tensor buffer handle that points to some memory segment. It should not contain actual data.
Functions§
- offset_
handles - Take a list of sub-slices of a buffer and create a list of offset handles. Sizes must be in bytes and handles will be aligned to the memory alignment.