lattice-inference 0.2.4

Pure Rust transformer inference engine — safetensors loading, SIMD matmul, BGE/Qwen3 embeddings
Documentation

lattice-inference

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 8 feature flags, 2 of them enabled by default.

default

download (default)

std (default)

This feature flag does not enable additional features.

backfill

bench-internals

This feature flag does not enable additional features.

bench-ort

f16

This feature flag does not enable additional features.

metal-gpu

wgpu-gpu