Expand description
§rusty-llm-jury
A Rust library for estimating success rates when using LLM judges for evaluation.
This library provides tools to estimate the true success rate of your system by correcting for LLM judge bias using bootstrap confidence intervals.
Re-exports§
pub use bias_correction::*;pub use error::*;pub use synthetic::*;
Modules§
- bias_
correction - Bias correction functionality for LLM judge evaluation.
- cli
- Command-line interface for rusty-llm-jury.
- error
- Error types for the llm-jury library.
- synthetic
- Synthetic data generation utilities for testing LLM judge evaluation.
- utils
- Utility functions for data parsing and I/O.
Constants§
- DEFAULT_
BOOTSTRAP_ ITERATIONS - Default number of bootstrap iterations
- DEFAULT_
CONFIDENCE_ LEVEL - Default confidence level (95%)
- VERSION
- Version of the library