met-1.0.0-beta-preview

docs.rs

Rust

met 1.0.0-beta-preview

Metrale Engine: pure Rust LLM inference server (HTTP API, scheduler, TUI, CLI).

Crate
Source
Builds
Feature flags

..
batched_mixed.trace
batched_prefill_waves.trace
batched_verify_k4.trace
beam.trace
cancel_mid_stream.trace
chunked_prefill.trace
dflash.trace
dflash_batched.trace
host_logits_paths.trace
lora_rotation_at_quiescence.trace
mixed_prefill.trace
ngram.trace
plain_decode.trace
preempt_requeue.trace
request_timeout.trace
self_spec.trace
slai_policy.trace
spill_swap_out_in.trace
verify_k2.trace
verify_k3.trace
verify_k4.trace
watchdog_rollback.trace