Skip to main content

Module capability

Module capability 

Source
Expand description

Explicit architecture capability registry for the generic GGUF path.

Mirrors the pinned llama.cpp llm_arch / LLM_ARCH_NAMES inventory (.scratch/llama.cpp/src/llama-arch.{h,cpp}) with Ferrox-side classification into decoder families, memory kinds, and scope. Unknown strings and detected-but-unimplemented features fail closed (LoadError) instead of silently defaulting into fluent-but-wrong logits.

Architecture names are registry keys only. Hot-path kernels never branch on them; load-time resolution produces an ArchProfile whose fields the decoder reads as plain data.

Structs§

ArchProfile
Load-time resolved profile for one GGUF general.architecture string.

Enums§

ArchPath
How the generic Decoder / ModelConfig::from_gguf path treats a GGUF architecture string.
ArchScope
How far this architecture is in Ferrox’s delivery scope (plan: text-generation parity; encoder/multimodal/diffusion/audio deferred).
DecoderFamily
Shared execution family (maps many GGUF strings onto one engine path).
MemoryKind
Memory / KV backend selected once at load (llama.cpp create_memory).
QkNormStyle
How attn_q_norm / attn_k_norm weights are applied (when present).

Functions§

architecture_catalog
Full inventory keyed by GGUF general.architecture string. Kept in sync with .scratch/llama.cpp/src/llama-arch.cpp LLM_ARCH_NAMES.
coverage_report_markdown
Markdown coverage table for docs / CI drift checks.
default_swa_pattern
The alternating sliding-window period an architecture uses when its GGUF carries {arch}.attention.sliding_window but not {arch}.attention.sliding_window_pattern.
resolve_architecture
Resolve a GGUF general.architecture value. None means the string is not in the registry — callers must fail closed rather than guess.
resolve_profile
Resolve a GGUF general.architecture value to its profile.
swa_rope_base_follows_model
True when this architecture’s SWA layers use the model’s own RoPE base rather than llama.cpp’s rope_freq_base_train_swa default of 10000.
unsupported_feature_keys
Metadata keys that, when present with a nonzero value, require math ferrox’s generic decoder does not implement unless the architecture profile opts into those features (Gemma family).
unsupported_scaling_keys
Scalar multipliers a checkpoint can declare in metadata that the generic decoder does not apply, with the value that means “no-op”.