oxibonsai-runtime-0.1.3
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

oxibonsai-runtime 0.1.3

Inference runtime, sampling, tokenizer, and server for OxiBonsai

Crate
Source
Builds
Feature flags

..
adaptive_sampling_tests.rs
admin_tests.rs
api_extensions_tests.rs
auto_tuner_tests.rs
builders_test.rs
circuit_breaker_test.rs
completions_tests.rs
config_tests.rs
constrained_decoding_tests.rs
dedup_tests.rs
distributed_tests.rs
embeddings_tests.rs
generate_pipeline_tests.rs
health_test.rs
hot_reload_tests.rs
json_schema_tests.rs
multi_model_tests.rs
native_tokenizer_tests.rs
nbest_tests.rs
profiler_tests.rs
quality_metrics_tests.rs
rag_server_tests.rs
sampling_advanced_tests.rs
sampling_distribution_tests.rs
sampling_tests.rs
server_tests.rs
stream_metrics_tests.rs
token_budget_tests.rs
web_ui_tests.rs