Crate llm_test_bench_core

Expand description

§LLM Test Bench Core

This crate provides the core business logic and provider integrations for the LLM Test Bench framework.

config: Configuration management and validation
providers: LLM provider implementations (OpenAI, Anthropic, etc.)
evaluators: Evaluation metrics (perplexity, faithfulness, relevance, coherence)
benchmarks: Benchmarking logic and reporting
orchestration: Multi-model comparison, ranking, and routing
analytics: Statistical analysis and cost optimization
visualization: HTML dashboard generation with interactive charts
multimodal: Multi-modal support for vision, audio, and video
monitoring: Real-time monitoring with Prometheus and WebSocket dashboards
plugins: WASM-based plugin system for extensibility
api: REST, GraphQL, and WebSocket API server
distributed: Coordinator-worker distributed architecture
database: PostgreSQL database backend

analytics: Analytics and optimization for benchmark results.
api: Enterprise API Server
benchmarks: Benchmarking logic and reporting
config: Configuration management for LLM Test Bench
distributed: Distributed Architecture
evaluators: Evaluation metrics for LLM responses
monitoring: Real-time Monitoring System
multimodal: Multi-modal support for vision, audio, and video inputs/outputs.
orchestration: Multi-model orchestration with comparison, ranking, and routing.
plugins: WASM-based Plugin System
prelude: Re-export commonly used types
providers: LLM Provider implementations and abstractions.
visualization: HTML dashboard generation and visualization.