vllm-cpp-0.0.1
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

vllm-cpp 0.0.1

Safe model inference, streaming, chat, and concurrent requests for vllm.cpp

Crate
Source
Builds
Feature flags

..
common
chat.rs
complete.rs
concurrent.rs
README.md
setup_test_model.rs
stream.rs
structured.rs