alice-llm 2.0.0

Pure Rust LLM inference engine — GGUF v3 parser, K-quants, hybrid CPU/GPU DeltaNet+Attention, wgpu compute shaders, speculative decoding, OpenAI-compatible HTTP server.
Documentation

alice-llm

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 12 feature flags, 1 of them enabled by default.

default

std (default)

This feature flag does not enable additional features.

dspark

This feature flag does not enable additional features.

dspark-serde

gguf

gpu

grammar

This feature flag does not enable additional features.

hf-config

imatrix

parallel

quant

This feature flag does not enable additional features.

server

simd