dynamo-llm-0.5.1
- dynamo-llm 0.5.1
- Permalink
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- nv-anants
- saturley-hall
- dmitry-tokarev-nv
- nv-nmailhot
- Dependencies
- ahash ^0.8.12 normal
  
  aho-corasick ^1.1 normal
  
  akin ^0.4.0 normal
  
  anyhow ^1 normal
  
  async-nats ^0.40 normal
  
  async-stream ^0.3 normal
  
  async-trait ^0.1 normal
  
  async_zmq ^0.4.0 normal
  
  axum ^0.8 normal
  
  axum-server ^0.7 normal
  
  bitflags ^2.4 normal
  
  blake3 ^1.8 normal
  
  bs62 ^0.1 normal
  
  bytemuck ^1.22 normal
  
  bytes ^1 normal
  
  candle-core ^0.9.1 normal
  
  chrono ^0.4 normal
  
  cudarc ^0.17.1 normal optional
  
  dashmap ^5.5.3 normal
  
  derive-getters ^0.5 normal
  
  derive_builder ^0.20 normal
  
  dialoguer ^0.11 normal
  
  dynamo-async-openai ^0.5.1 normal
  
  dynamo-parsers ^0.5.1 normal
  
  dynamo-runtime ^0.5.1 normal
  
  either ^1.13 normal
  
  erased-serde ^0.4 normal
  
  etcd-client ^0.16 normal
  
  futures ^0.3 normal
  
  futures-util ^0.3.31 normal
  
  galil-seiferas ^0.1 normal
  
  ggus ^0.4.0 normal
  
  hf-hub ^0.4.2 normal
  
  humantime ^2.2.0 normal
  
  itertools ^0.14.0 normal
  
  json-five ^0.3 normal
  
  memmap2 ^0.9.5 normal
  
  minijinja ^2.10.2 normal
  
  minijinja-contrib ^2.10.2 normal
  
  modelexpress-client ^0.2.0 normal
  
  modelexpress-common ^0.2.0 normal
  
  ndarray ^0.16 normal optional
  
  nix ^0.26 normal optional
  
  nixl-sys ^0.4.1 normal optional
  
  offset-allocator ^0.2 normal
  
  oneshot ^0.1.11 normal
  
  parking_lot ^0.12.4 normal
  
  prometheus ^0.14 normal
  
  prost ^0.13.5 normal
  
  rand ^0.9.0 normal
  
  rayon ^1 normal
  
  regex ^1 normal
  
  rmp-serde ^1.3 normal
  
  rustls ^0.23 normal
  
  serde ^1 normal
  
  serde_json ^1 normal
  
  strum ^0.27 normal
  
  tempfile ^3 normal
  
  thiserror ^2.0.11 normal
  
  tmq ^0.5.0 normal
  
  tokenizers ^0.21.4 normal
  
  tokio ^1 normal
  
  tokio-stream ^0.1 normal
  
  tokio-util ^0.7 normal
  
  toktrie ^1.1 normal
  
  toktrie_hf_tokenizers ^1.1 normal
  
  tonic ^0.13.1 normal
  
  tower-http ^0.6 normal
  
  tracing ^0.1 normal
  
  unicode-segmentation ^1.12 normal
  
  url ^2.5 normal
  
  uuid ^1.17 normal
  
  validator ^0.20.0 normal
  
  xxhash-rust ^0.8 normal
  
  zeromq ^0.4.1 normal
  
  aligned-vec ^0.6.4 dev
  
  approx ^0.5 dev
  
  assert_matches ^1.5 dev
  
  criterion ^0.3 dev
  
  hf-hub ^0.4.2 dev
  
  insta ^1.41 dev
  
  lazy_static ^1.4 dev
  
  modelexpress-client ^0.2.0 dev
  
  modelexpress-common ^0.2.0 dev
  
  proptest ^1.5.0 dev
  
  reqwest ^0.12.22 dev
  
  rstest ^0.18.2 dev
  
  rstest_reuse ^0.7.0 dev
  
  serial_test ^3 dev
  
  temp-env ^0.3.6 dev
  
  tempfile ^3.17.1 dev
  
  tonic-build ^0.13.1 build
- Versions
- 61.37% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Module http

dynamo_llm0.5.1

Module http

Module Items

Modules

In crate dynamo_llm

Module http

Modules§

client: HTTP clients for streaming LLM responses with performance recording
service: HTTP Service for Dynamo LLM