Expand description
Advanced Benchmarking Framework for Vector Search Systems
This module provides comprehensive benchmarking capabilities including:
- ANN-Benchmarks integration and compatibility
- Multi-dimensional performance analysis
- Quality metrics (recall, precision, NDCG)
- Scalability and throughput testing
- Statistical significance testing
- Memory and latency profiling
- Automated hyperparameter tuning
- Comparative analysis across algorithms
Structs§
- Advanced
Benchmark Config - Advanced benchmarking configuration with comprehensive options
- Advanced
Benchmark Result - Advanced benchmark result with comprehensive metrics
- Advanced
Benchmark Suite - Comprehensive benchmark suite with advanced analysis
- Algorithm
Parameters - Algorithm-specific parameters
- Benchmark
Algorithm - Algorithm wrapper for benchmarking
- Benchmark
Traces - Detailed benchmark traces
- Build
Time Metrics - Build time analysis
- Cache
Metrics - Cache performance metrics
- Dataset
Quality Metrics - Quality metrics for dataset characterization
- Dataset
Statistics - Comprehensive dataset statistics
- Distance
Statistics - Distance statistics for dataset analysis
- Enhanced
Benchmark Dataset - Enhanced dataset with comprehensive metadata and analysis
- Hyperparameter
Tuner - Hyperparameter tuner for algorithm optimization
- Index
Size Metrics - Index size analysis
- Latency
Metrics - Detailed latency analysis
- Memory
Allocation - Memory allocation tracking
- Memory
Metrics - Memory usage analysis
- Memory
Trace - Memory trace
- Parallel
Benchmark Config - Configuration for parallel benchmark execution
- Parameter
Space - Parameter search space definition
- Performance
Metrics - Comprehensive performance metrics
- Performance
Profiler - Performance profiler for detailed analysis
- Power
Analysis - Power analysis for statistical tests
- Quality
Degradation - Quality degradation under different conditions
- Quality
Metrics - Quality metrics for search accuracy
- Query
Trace - Individual query trace
- Scalability
Metrics - Scalability analysis
- Statistical
Analyzer - Statistical analyzer for benchmark results
- Statistical
Metrics - Statistical analysis of benchmark results
- Statistical
Test - Statistical test results
- System
Trace - System-level trace
- Throughput
Metrics - Throughput analysis
Enums§
- Objective
Function - Objective function for optimization
- Optimization
Strategy - Optimization strategies for hyperparameter tuning
- Parameter
Constraint - Parameter
Type - Parameter
Value - Parameter values with type information