Skip to main content

Crate rskit_bench

Crate rskit_bench 

Source
Expand description

ML benchmarking framework: evaluators, metrics, reports, visualization.

Migrated from sentinel/rs-services/ruskit to use rskit-errors (AppResult/AppError) instead of anyhow, and rskit-provider for the Provider/RequestResponse traits.

Benchmark orchestration accepts injected clocks and storage. Use FixedClock and a test-owned RunStorage implementation for deterministic tests; use SystemClock and FileRunStorage for normal CLI runs.

Re-exports§

pub use evaluator::Evaluator;
pub use evaluator::EvaluatorFunc;
pub use evaluator::FromProvider;
pub use execution::BenchExecutionPlan;
pub use result::BenchRunResult;
pub use result::MetricResult;
pub use run_storage::FileRunStorage;
pub use run_storage::ListOptions;
pub use run_storage::RunStorage;
pub use runner::BenchRunner;
pub use runner::RunOptions;
pub use types::BenchSample;
pub use types::Prediction;
pub use types::ScoredSample;

Modules§

cli
CLI utilities for bench operations.
compare
Run comparison and regression detection.
curves
Curve data types for visualization.
dataset
Dataset loading for accuracy benchmarking.
dataset_loader
Generic dataset loader with pipeline integration.
evaluator
Evaluator trait and adapters for bench.
execution
Benchmark execution planning with worker and observability integration.
metric
Pluggable evaluation metrics for the bench framework.
middleware
Evaluator middleware: timing and caching wrappers.
report_gen
Report generation for bench results.
result
Result types for bench runs.
run_storage
Storage trait and file-based implementation for bench results.
runner
Bench runner — orchestrates the complete benchmark lifecycle.
schema
Schema version constants for bench result serialization.
types
Core data types for the bench framework.
viz
SVG chart rendering for benchmark results.

Structs§

FixedClock
Deterministic clock for tests and reproducible harnesses.
SystemClock
System-backed clock.

Traits§

BenchClock
Clock used for wall-clock timestamps and monotonic elapsed durations.

Functions§

system_clock
Return a shared system-backed clock.

Type Aliases§

SharedClock
Shared clock handle.