oxibonsai 0.1.3

Pure Rust 1-bit LLM inference engine for PrismML Bonsai models — umbrella crate
Documentation

oxibonsai

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 10 feature flags, 0 of them enabled by default.

default

This feature flag does not enable additional features.

eval

full

native-tokenizer

oxibonsai-serve

rag

server

simd-avx2

simd-avx512

simd-neon

wasm