llama-rs

This version has 17 feature flags, 6 of them enabled by default.

default

• cli (default)
• client (default)
• cpu (default)
• huggingface (default)
• onnx (default)
• server (default)

cli (default)

• dep:clap (default)
• dep:clap_mangen (default)

client (default)

• dep:reqwest (default)

cpu (default)

This feature flag does not enable additional features.

huggingface (default)

• dep:directories (default)
• dep:indicatif (default)
• dep:reqwest (default)

onnx (default)

• dep:prost (default)

server (default)

• dep:axum (default)
• dep:futures (default)
• dep:tokio (default)
• dep:tower-http (default)

council

• client (default)
• dep:bytes
• distributed
• huggingface (default)
• server (default)

council-e2e

• council

cuda

• dep:cudarc

distributed

• dep:futures (default)
• dep:prost (default)
• dep:tokio (default)
• dep:tonic
• dep:tonic-prost

dx12

• dep:windows

hailo

• dep:directories (default)
• dep:hailort-sys

metal

• dep:metal
• dep:objc

rag

• dep:deadpool-postgres
• dep:glob
• dep:pgvector
• dep:tokio (default)
• dep:tokio-postgres
• dep:url

rag-sqlite

• dep:glob
• dep:rusqlite

vulkan

• dep:ash
• dep:gpu-allocator

vulkan-shaders

This feature flag does not enable additional features.