Expand description
quant-eval: Compression and semantic search evaluation benchmark suite.
Structs§
- Admissibility
Test - AdmissibilityTest validates codec behavior across standard test sets.
- Benchmark
Receipt - A benchmark receipt captures the results and context of a single benchmark run.
- Benchmark
Result - A single benchmark result within a receipt.
- Codec
Profile - A codec profile defines compression parameters and behavior.
- Compression
Benchmark - CompressionBenchmark measures accuracy metrics for quantization codecs.
- Compression
Benchmark Config - Configuration for a compression benchmark run.
- Hyper
Quant Eval Config - Configuration for deterministic HyperQuant fixture evaluation.
- Hyper
Quant Eval Result - Full HyperQuant evaluation result.
- Hyper
Quant Profile Eval - Per-lattice profile result.
- Machine
Fingerprint - Machine fingerprint combines machine identity for benchmark receipts.
- RagEval
Result - RagQuery
Fixture - RagRetrieved
Doc - Receipt
Diff - Comparison result between two benchmark receipts.
- Semantic
Memory Benchmark - SemanticMemoryBenchmark measures search quality degradation from compression.
- Semantic
Memory Config - Configuration for semantic memory benchmark.
Enums§
- Quant
Eval Error - Errors that can occur during evaluation operations.
Functions§
- evaluate_
rag_ fixture - run_
hyperquant_ eval - Run deterministic fixture evaluation for HyperQuant Z1 and A2.