Expand description
Clean, minimal storage API for v2 block manager.
This module provides a simplified storage abstraction with:
- Single trait for type erasure (
MemoryDescription) - Concrete storage types (no trait implementations required)
- Composition-based NIXL registration via
NixlRegistered<T>wrapper - RAII with proper drop ordering (registration handle drops before memory)
Re-exports§
pub use arena::ArenaAllocator;pub use arena::ArenaBuffer;pub use arena::ArenaError;
Modules§
- actions
- Storage actions.
- arena
- Arena Allocator
- nixl
- NIXL registration wrapper for storage types.
- offset
- pool
- Memory pool for efficient device memory allocation in hot paths.
- prelude
Structs§
- Buffer
- Type-erased memory region for use in layouts.
- Device
Storage - CUDA device memory allocated via cudaMalloc.
- Disk
Storage - Memory
Region - An unowned contiguous chunk of memory, not storage specific.
- Pinned
Storage - CUDA pinned host memory allocated via cudaHostAlloc.
- System
Storage - System memory allocated via malloc.
Enums§
- Storage
Error - Errors that can occur during storage operations.
- Storage
Kind - Storage type classification.
- Torch
Device
Traits§
- Memory
Description - Core trait for memory regions that can be type-erased.
- Torch
Tensor
Functions§
- create_
buffer - Helper function to convert concrete storage to type-erased form.
Type Aliases§
- Result
- Result type for storage operations.