oxibonsai-cli 0.2.3

Pure Rust 1-bit LLM inference engine for PrismML Bonsai models — CLI

oxibonsai-cli

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 12 feature flags, 1 of them enabled by default.

default

server (default)

cuda

eval

gpu

metal

native-cuda

native-tokenizer

rag

simd-avx2

simd-avx512

simd-neon

wasm