Expand description
Clean, minimal storage API for v2 block manager.
This module provides a simplified storage abstraction with:
- Single trait for type erasure (
MemoryDescriptor) - Concrete storage types (no trait implementations required)
- Composition-based NIXL registration via
NixlRegistered<T>wrapper - RAII with proper drop ordering (registration handle drops before memory)
Re-exports§
pub use arena::ArenaAllocator;pub use arena::ArenaBuffer;pub use arena::ArenaError;pub use numa::NumaNode;pub use numa::is_numa_enabled;pub use offset::OffsetBuffer;pub use pool::CudaMemPool;pub use pool::CudaMemPoolBuilder;
Modules§
- actions
- Storage actions.
- arena
- Arena Allocator
- nixl
- NIXL registration wrapper for storage types.
- numa
- NUMA-aware memory allocation utilities.
- offset
- Offset-based buffer views into underlying storage.
- pool
- CUDA memory pool utilities. Memory pool for efficient device memory allocation in hot paths.
- prelude
- Common imports for working with memory types.
Structs§
- Buffer
- Type-erased memory region for use in layouts.
- Device
Storage - CUDA device memory allocated via cudaMalloc.
- Disk
Storage - Disk-backed storage using memory-mapped files with O_DIRECT support.
- External
Device Memory - Wrapper for externally-allocated device (GPU) memory.
- Memory
Region - An unowned contiguous chunk of memory, not storage specific.
- Pinned
Storage - CUDA pinned host memory allocated via cudaHostAlloc.
- System
Storage - System memory allocated via malloc.
Enums§
- Storage
Error - Errors that can occur during storage operations.
- Storage
Kind - Storage type classification.
Traits§
- Memory
Descriptor - Core trait for memory regions that can be type-erased.
- Tensor
Descriptor - A tensor is memory with shape, stride, and element size metadata.
- Tensor
Descriptor Ext - Extension trait providing helper methods for tensor descriptors.
Functions§
- create_
buffer - Helper function to convert concrete storage to type-erased form.
Type Aliases§
- Result
- Result type for storage operations.