Skip to main content

Module incremental

graphrag_core::graph

Module incremental 

Source
Expand description

Comprehensive incremental updates architecture for GraphRAG-RS

This module provides zero-downtime incremental updates with ACID-like guarantees, intelligent cache invalidation, conflict resolution, and comprehensive monitoring.

§Architecture Goals

  • Zero-downtime updates: System remains available during modifications
  • Consistency guarantees: ACID-like properties for graph operations
  • Performance: Updates should be 10x+ faster than full reconstruction
  • Scalability: Handle thousands of concurrent updates per second
  • Observability: Complete audit trail of all changes

§Key Components

  • IncrementalGraphStore trait for atomic update operations
  • ChangeRecord and ChangeLog for tracking modifications
  • GraphDelta for representing atomic change sets
  • ConflictResolver for handling concurrent modifications
  • SelectiveInvalidation for cache management
  • UpdateMonitor for change tracking and metrics
  • IncrementalPageRank for efficient graph algorithm updates

Structs§

BatchMetrics
Batch metrics for monitoring
CacheRegion
Cache region affected by changes
ChangeEvent
Change event for monitoring and debugging
ChangeRecord
Change record for tracking individual modifications
Conflict
Conflict detected during update
ConflictResolution
Resolution for a conflict
ConflictResolver
Conflict resolver with multiple strategies
ConsistencyReport
Consistency validation report
Document
Document type for incremental updates
GraphDelta
Atomic change set representing a transaction
GraphStatistics
Graph statistics for monitoring
IncrementalConfig
Configuration for incremental operations
IncrementalGraphManager
Incremental graph manager (simplified version without incremental feature)
IncrementalStatistics
Comprehensive statistics for incremental operations
InvalidationStats
Statistics about cache invalidations
OperationLog
Log entry for an operation
PerformanceStats
Performance statistics for monitoring
RollbackData
Data needed for rollback operations
TransactionId
Transaction identifier for atomic operations
UpdateId
Unique identifier for update operations
UpdateMetric
Metric for tracking update operations

Enums§

ChangeData
Data associated with a change
ChangeEventType
Types of change events that can be published
ChangeType
Types of changes that can occur
ConflictStrategy
Conflict resolution strategies
ConflictType
Types of conflicts
DeltaStatus
Status of a delta operation
InvalidationStrategy
Cache invalidation strategies
Operation
Operations that can be performed

Traits§

IncrementalGraphStore
Extended trait for incremental graph operations with production-ready features