Docs.rs
dynamo-llm-0.5.1
dynamo-llm 0.5.1
Permalink
Docs.rs crate page
Apache-2.0
Links
Homepage
Repository
crates.io
Source
Owners
nv-anants
saturley-hall
dmitry-tokarev-nv
nv-nmailhot
Dependencies
ahash ^0.8.12
normal
aho-corasick ^1.1
normal
akin ^0.4.0
normal
anyhow ^1
normal
async-nats ^0.40
normal
async-stream ^0.3
normal
async-trait ^0.1
normal
async_zmq ^0.4.0
normal
axum ^0.8
normal
axum-server ^0.7
normal
bitflags ^2.4
normal
blake3 ^1.8
normal
bs62 ^0.1
normal
bytemuck ^1.22
normal
bytes ^1
normal
candle-core ^0.9.1
normal
chrono ^0.4
normal
cudarc ^0.17.1
normal
optional
dashmap ^5.5.3
normal
derive-getters ^0.5
normal
derive_builder ^0.20
normal
dialoguer ^0.11
normal
dynamo-async-openai ^0.5.1
normal
dynamo-parsers ^0.5.1
normal
dynamo-runtime ^0.5.1
normal
either ^1.13
normal
erased-serde ^0.4
normal
etcd-client ^0.16
normal
futures ^0.3
normal
futures-util ^0.3.31
normal
galil-seiferas ^0.1
normal
ggus ^0.4.0
normal
hf-hub ^0.4.2
normal
humantime ^2.2.0
normal
itertools ^0.14.0
normal
json-five ^0.3
normal
memmap2 ^0.9.5
normal
minijinja ^2.10.2
normal
minijinja-contrib ^2.10.2
normal
modelexpress-client ^0.2.0
normal
modelexpress-common ^0.2.0
normal
ndarray ^0.16
normal
optional
nix ^0.26
normal
optional
nixl-sys ^0.4.1
normal
optional
offset-allocator ^0.2
normal
oneshot ^0.1.11
normal
parking_lot ^0.12.4
normal
prometheus ^0.14
normal
prost ^0.13.5
normal
rand ^0.9.0
normal
rayon ^1
normal
regex ^1
normal
rmp-serde ^1.3
normal
rustls ^0.23
normal
serde ^1
normal
serde_json ^1
normal
strum ^0.27
normal
tempfile ^3
normal
thiserror ^2.0.11
normal
tmq ^0.5.0
normal
tokenizers ^0.21.4
normal
tokio ^1
normal
tokio-stream ^0.1
normal
tokio-util ^0.7
normal
toktrie ^1.1
normal
toktrie_hf_tokenizers ^1.1
normal
tonic ^0.13.1
normal
tower-http ^0.6
normal
tracing ^0.1
normal
unicode-segmentation ^1.12
normal
url ^2.5
normal
uuid ^1.17
normal
validator ^0.20.0
normal
xxhash-rust ^0.8
normal
zeromq ^0.4.1
normal
aligned-vec ^0.6.4
dev
approx ^0.5
dev
assert_matches ^1.5
dev
criterion ^0.3
dev
hf-hub ^0.4.2
dev
insta ^1.41
dev
lazy_static ^1.4
dev
modelexpress-client ^0.2.0
dev
modelexpress-common ^0.2.0
dev
proptest ^1.5.0
dev
reqwest ^0.12.22
dev
rstest ^0.18.2
dev
rstest_reuse ^0.7.0
dev
serial_test ^3
dev
temp-env ^0.3.6
dev
tempfile ^3.17.1
dev
tonic-build ^0.13.1
build
Versions
61.37%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Module mocker
dynamo_
llm
0.5.1
Module mocker
Module Items
Modules
In crate dynamo_
llm
dynamo_llm
Module
mocker
Copy item path
Source
Modules
ยง
engine
MockSchedulerEngine - AsyncEngine wrapper around the Scheduler
evictor
kv_
manager
KV Manager
protocols
scheduler
Asynchronous Scheduler for LLM Request Management
sequence