Module distribcache 

Helios-DistribCache - Intelligent Distributed Caching Layer

A multi-tier distributed caching system with workload-aware strategies, intelligent prefetching, and AI/Agent optimizations.

Architecture

┌─────────────────────────────────────────────────────────────────┐
│                     WORKLOAD CLASSIFIER                          │
│  ┌─────────┐ ┌─────────┐ ┌─────────┐ ┌─────────┐ ┌─────────┐   │
│  │  OLTP   │ │  OLAP   │ │ Vector  │ │AIAgent  │ │   RAG   │   │
│  └─────────┘ └─────────┘ └─────────┘ └─────────┘ └─────────┘   │
└─────────────────────────────────────────────────────────────────┘
                              │
┌─────────────────────────────────────────────────────────────────┐
│                     MULTI-TIER CACHE                             │
│  ┌───────────────────────────────────────────────────────────┐  │
│  │ L1: Hot Cache (In-Memory, <100μs)                         │  │
│  └───────────────────────────────────────────────────────────┘  │
│                          │ miss                                  │
│  ┌───────────────────────────────────────────────────────────┐  │
│  │ L2: Warm Cache (Local SSD, <1ms)                          │  │
│  └───────────────────────────────────────────────────────────┘  │
│                          │ miss                                  │
│  ┌───────────────────────────────────────────────────────────┐  │
│  │ L3: Distributed Cache (Mesh, <10ms)                       │  │
│  └───────────────────────────────────────────────────────────┘  │
└─────────────────────────────────────────────────────────────────┘

Features

• Multi-Tier Caching: L1 hot (memory), L2 warm (SSD), L3 distributed (mesh)
• Workload Classification: OLTP, OLAP, Vector, AI Agent, RAG pipelines
• Intelligent Prefetching: Pattern-based and temporal prediction
• WAL-Based Invalidation: Real-time cache coherency via WAL streaming
• Heatmap Analytics: Visual cache utilization and recommendations
• AI/Agent Caches: Conversation context, RAG chunks, tool results, semantic queries

Re-exports

pub use tiers::HotCache;

pub use tiers::WarmCache;

pub use tiers::DistributedCache;

pub use tiers::CacheEntry;

pub use tiers::CacheKey;

pub use tiers::CacheTier;

pub use tiers::TierStats;

pub use tiers::EvictionPolicy;

pub use tiers::CompressionType;

pub use ai::ConversationContextCache;

pub use ai::ConversationContext;

pub use ai::Turn;

pub use ai::ConversationCacheStats;

pub use ai::RagChunkCache;

pub use ai::Chunk;

pub use ai::ChunkId;

pub use ai::RagCacheStatsSnapshot;

pub use ai::ToolResultCache;

pub use ai::ToolCallKey;

pub use ai::ToolResult;

pub use ai::ToolCacheStatsSnapshot;

pub use ai::SemanticQueryCache;

pub use ai::SemanticEntry;

pub use ai::SemanticCacheStatsSnapshot;

pub use ai::cosine_similarity;

pub use ai::BranchContext;

pub use ai::BranchId;

pub use ai::AIWorkloadContext;

pub use ai::VectorId;

pub use ai::Embedding;

pub use ai::SemanticIndex;

pub use ai::SemanticIndexConfig;

pub use ai::SimilarityResult;

pub use ai::AIIntegrationCoordinator;

pub use ai::AIIntegrationConfig;

pub use ai::AIIntegrationStatsSnapshot;

pub use ai::AIWorkloadDetection;

pub use ai::SessionTrackingInfo;

pub use ai::CacheRecommendation;

pub use ai::CachePriority;

pub use ai::RecommendedTier;

pub use metrics::DistribCacheMetrics;

pub use metrics::InvalidationSource;

pub use metrics::ErrorType;

pub use config::*;

pub use classifier::*;

pub use prefetcher::*;

pub use invalidator::*;

pub use heatmap::*;

pub use scheduler::*;

Modules

ai

AI/Agent-specific cache optimizations

classifier

Workload classifier for intelligent caching decisions

config

DistribCache configuration types

heatmap

Cache heatmap analytics

invalidator

WAL-based cache invalidator

metrics

DistribCache metrics

prefetcher

Predictive prefetcher for intelligent cache warming

scheduler

Workload scheduler for cache resource allocation

tiers

Multi-tier cache implementations

Structs

DistribCacheStats

Cache statistics snapshot

HeliosDistribCache

Helios-DistribCache - Main distributed cache instance

QueryContext

Query context for cache decisions

QueryFingerprint

Query fingerprint for cache key generation

SessionId

Session identifier for session affinity

Enums

CacheError

Cache errors

Type Aliases

CacheResult