lattice-inference-0.1.0
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

lattice-inference 0.1.0

Pure Rust transformer inference engine — safetensors loading, SIMD matmul, BGE/Qwen3 embeddings

Crate
Source
Builds
Feature flags

..
bench_concurrent.rs
bench_dispatch.rs
bench_dispatch2.rs
bench_embed_quality.rs
bench_embedding.rs
bench_gdn.rs
bench_gdn_decode.rs
bench_gemm_variants.rs
bench_gpu.rs
bench_kernels.rs
bench_kernels2.rs
bench_metal.rs
bench_mps_gemm.rs
bench_persistent_state.rs
bench_profile.rs
bench_pruning.rs
bench_q4_prefill.rs
bench_quality.rs
bench_simdgroup.rs
bench_stability.rs
bench_suite.rs
layer_sweep.rs
profile_metal.rs
profile_metal_decode.rs