onde-mistralrs-0.8.2

docs.rs

Rust

onde-mistralrs 0.8.2

Fast, flexible LLM inference.

Crate
Source
Builds
Feature flags

..
agent.rs
anymoe.rs
auto_model.rs
blocking.rs
builder_macros.rs
core.rs
diffusion_model.rs
embedding_model.rs
error.rs
gguf.rs
gguf_lora_model.rs
gguf_xlora_model.rs
isq_setting.rs
lib.rs
lora_model.rs
messages.rs
model.rs
model_builder_trait.rs
multimodal_model.rs
speculative.rs
speech_model.rs
text_model.rs
xlora_model.rs