hf2q 0.1.1

Pure Rust CLI for converting HuggingFace models to hardware-optimized formats and serving them over an OpenAI-compatible API on Apple Silicon
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

//! Per-architecture model implementations.
//!
//! Each sub-module owns its own config parser, tensor-name table,
//! forward-pass graph builder, and KV-cache management. Modules do NOT
//! depend on each other in their composers; primitives in
//! `bert::bert_gpu` are arch-agnostic GPU kernels reused by `nomic_bert`
//! to avoid duplication of the linear / layer-norm / attention building
//! blocks.

pub mod bert;
pub mod deepseek4;
pub mod gemma4;
pub mod nomic_bert;
pub mod qwen35;
pub mod qwen3vl_text;