Skip to main content

Module memory

ruvector_core

Module memory 

Source
Expand description

Unified Memory Pool and Paging System (ADR-006)

High-performance paged memory management for LLM inference:

  • 2MB page-granular allocation with best-fit strategy
  • Reference-counted pinning with RAII guards
  • LRU eviction with hysteresis for thrash prevention
  • Multi-tenant isolation with Hot/Warm/Cold residency tiers Memory management utilities for ruvector-core

This module provides memory-efficient data structures and utilities for vector storage operations.

Structsยง

MemoryPool
Memory pool for vector allocations.