ferrum-cli 0.8.3

CLI for Ferrum — a Rust-native LLM inference engine
Documentation

ferrum-cli

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 15 feature flags, 0 of them enabled by default.

default

This feature flag does not enable additional features.

accelerate

benchmark

This feature flag does not enable additional features.

candle-cuda-compat

cuda

dev-tools

This feature flag does not enable additional features.

fa2-source

interactive

This feature flag does not enable additional features.

marlin

metal

native-op-artifact

tensor-parallel

triton-kernels

vllm-marlin

vllm-moe-marlin

vllm-paged-attn-v2