oxinfer 0.0.5

Local LLM inference in pure Rust (Gemma 4, Qwen 3.5/3.8): SIMD CPU kernels everywhere, GPUs detected at run time, and a WebAssembly + WebGPU browser build.
Documentation
1
2
3
4
5
6
7
8
9
10
models/
target/
*.safetensors
web/node_modules/
web/dist/
web/public/oxinfer.wasm
ios/build/
ios/OxinferTest/build/
xcuserdata/
__pycache__/