Skip to main content

Crate rlx_omnicoder

Crate rlx_omnicoder 

Source
Expand description

OmniCoder family runner.

Tesslate/OmniCoder-9B and siblings are Qwen3-coder-shaped and ship as general.architecture = qwen3 in their GGUF converters. This crate is a thin wrapper over rlx_qwen3::Qwen3Runner with arch validation so users get a discoverable per-family entry point and misrouted weights fail loudly at build().

Structs§

OmniCoderRunner
OmniCoderRunnerBuilder
Qwen3Runner
Resolved Qwen3 runner — call Qwen3Runner::generate for streaming decode (F32 path), or Qwen3Runner::predict_logits for a single forward pass (works in both F32 and packed modes).
Qwen3RunnerBuilder
Builder for Qwen3Runner. See the module docs for usage.

Enums§

Qwen3ConfigSource
Source for the qwen3 config. The builder picks one automatically (GGUF embedded vs. sibling config.json) but the caller can override.

Constants§

FAMILY
PLAN_MILESTONE

Functions§

cli_run