hf2q 0.1.10

Pure Rust CLI for converting HuggingFace models to hardware-optimized formats and serving them over an OpenAI-compatible API on Apple Silicon
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33

//! GBNF (GGML Grammar BNF) grammar stack for grammar-constrained decoding.
//!
//! Preserves the exact grammar-element encoding so a peer `.gbnf` file
//! produces the same rule set under hf2q's parser.
//!
//! Decision #6 (ADR-005 Phase 2 refinement, 2026-04-23): grammar-constrained
//! decoding obviates post-hoc tool-call parsing. `response_format:
//! {type: "json_object"}` and `{type: "json_schema", ...}` ride this same
//! infrastructure via json-schema → GBNF translation.
//!
//! # Deliberate omissions vs. the peer's parser
//!
//! - **`TOKEN` / `TOKEN_NOT` elements** (`<token>` / `!<[id]>` syntax):
//!   require a vocab at parse time. hf2q's first use case (OpenAI
//!   `response_format`) does not need token-level grammars; we add these
//!   when a concrete use case arises (e.g. tool-choice=required forcing a
//!   specific EOS).
//! - **Trigger patterns / lazy grammars**: a runtime-sampler feature, not
//!   a parser concern. Belongs with the sampler iter.

pub mod json_schema;
pub mod mask;
pub mod parser;
pub mod regex_gbnf;
pub mod sampler;
pub mod serialize;

#[allow(unused_imports)]
pub use parser::{parse, Grammar, GretElement, GretType, ParseError};
#[allow(unused_imports)]
pub use sampler::{GrammarRuntime, PartialUtf8, Pos, Stack, Stacks};
#[allow(unused_imports)]
pub use serialize::{rename_rules, serialize};