Expand description
Monitoring, benchmarking, and performance tracking Monitoring and benchmarking utilities for GraphRAG
This module provides tools for measuring and tracking GraphRAG performance:
- Benchmarking system for quality evaluation
- Performance metrics tracking
- Cost and token usage monitoring
Modules§
- benchmark
- Benchmarking system for quality improvements Benchmarking system for GraphRAG quality improvements
- metrics_
collector - Metrics collection system for monitoring Metrics collection implementation
Structs§
- Benchmark
Config - Configuration for benchmark runs
- Benchmark
Dataset - Dataset for benchmarking
- Benchmark
Query - A single query with ground truth for evaluation
- Benchmark
Runner - Main benchmarking coordinator
- Benchmark
Summary - Aggregate benchmark results across multiple queries
- Histogram
Stats - Statistics for histogram metrics
- Latency
Metrics - Latency breakdown by pipeline stage
- Metrics
Collector - Comprehensive metrics collector for GraphRAG operations
- Quality
Metrics - Quality metrics for answer evaluation
- Query
Benchmark - Benchmark results for a single query
- Token
Metrics - Token usage tracking