Skip to main content

Crate dynamo_memory

Crate dynamo_memory 

Source
Expand description

Clean, minimal storage API for v2 block manager.

This module provides a simplified storage abstraction with:

  • Single trait for type erasure (MemoryDescription)
  • Concrete storage types (no trait implementations required)
  • Composition-based NIXL registration via NixlRegistered<T> wrapper
  • RAII with proper drop ordering (registration handle drops before memory)

Re-exports§

pub use arena::ArenaAllocator;
pub use arena::ArenaBuffer;
pub use arena::ArenaError;

Modules§

actions
Storage actions.
arena
Arena Allocator
nixl
NIXL registration wrapper for storage types.
offset
pool
Memory pool for efficient device memory allocation in hot paths.
prelude

Structs§

Buffer
Type-erased memory region for use in layouts.
DeviceStorage
CUDA device memory allocated via cudaMalloc.
DiskStorage
MemoryRegion
An unowned contiguous chunk of memory, not storage specific.
PinnedStorage
CUDA pinned host memory allocated via cudaHostAlloc.
SystemStorage
System memory allocated via malloc.

Enums§

StorageError
Errors that can occur during storage operations.
StorageKind
Storage type classification.
TorchDevice

Traits§

MemoryDescription
Core trait for memory regions that can be type-erased.
TorchTensor

Functions§

create_buffer
Helper function to convert concrete storage to type-erased form.

Type Aliases§

Result
Result type for storage operations.