Skip to main content

Crate rlx_omnicoder

Crate rlx_omnicoder 

Source
Expand description

OmniCoder family runner.

Tesslate/OmniCoder-9B and siblings are Qwen3-coder-shaped and ship as general.architecture = qwen3 in their GGUF converters. This crate is a thin wrapper over rlx_qwen3::Qwen3Runner with arch validation so users get a discoverable per-family entry point and misrouted weights fail loudly at build().

Structs§

OmniCoderRunner
OmniCoderRunnerBuilder
Qwen3Runner
Resolved Qwen3 runner — call Qwen3Runner::generate for streaming decode (F32 path), or Qwen3Runner::predict_logits for a single forward pass (works in both F32 and packed modes).
Qwen3RunnerBuilder
Builder for Qwen3Runner. See the module docs for usage.

Constants§

FAMILY
PLAN_MILESTONE

Functions§

cli_run

Type Aliases§

Qwen3ConfigSource
Source for the qwen3 config. Alias of the shared rlx_runtime::ConfigSource<T>: