Skip to main content

Crate dynamo_memory

Crate dynamo_memory 

Source
Expand description

Clean, minimal storage API for v2 block manager.

This module provides a simplified storage abstraction with:

  • Single trait for type erasure (MemoryDescriptor)
  • Concrete storage types (no trait implementations required)
  • Composition-based NIXL registration via NixlRegistered<T> wrapper
  • RAII with proper drop ordering (registration handle drops before memory)

Re-exports§

pub use arena::ArenaAllocator;
pub use arena::ArenaBuffer;
pub use arena::ArenaError;
pub use numa::NumaNode;
pub use numa::is_numa_enabled;
pub use offset::OffsetBuffer;
pub use pool::CudaMemPool;
pub use pool::CudaMemPoolBuilder;

Modules§

actions
Storage actions.
arena
Arena Allocator
nixl
NIXL registration wrapper for storage types.
numa
NUMA-aware memory allocation utilities.
offset
Offset-based buffer views into underlying storage.
pool
CUDA memory pool utilities. Memory pool for efficient device memory allocation in hot paths.
prelude
Common imports for working with memory types.

Structs§

Buffer
Type-erased memory region for use in layouts.
DeviceStorage
CUDA device memory allocated via cudaMalloc.
DiskStorage
Disk-backed storage using memory-mapped files with O_DIRECT support.
ExternalDeviceMemory
Wrapper for externally-allocated device (GPU) memory.
MemoryRegion
An unowned contiguous chunk of memory, not storage specific.
PinnedStorage
CUDA pinned host memory allocated via cudaHostAlloc.
SystemStorage
System memory allocated via malloc.

Enums§

StorageError
Errors that can occur during storage operations.
StorageKind
Storage type classification.

Traits§

MemoryDescriptor
Core trait for memory regions that can be type-erased.
TensorDescriptor
A tensor is memory with shape, stride, and element size metadata.
TensorDescriptorExt
Extension trait providing helper methods for tensor descriptors.

Functions§

create_buffer
Helper function to convert concrete storage to type-erased form.

Type Aliases§

Result
Result type for storage operations.