rlx-text 0.2.18

RLX text — tokenizer wrappers, chat templates, sampling. Public surface for downstream LM apps.
docs.rs failed to build rlx-text-0.2.18
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Visit the last successful build: rlx-text-0.2.17

rlx-text

Public surface for downstream LM apps:

  • Chat templates — Jinja-rendered chat templates loaded inline or from GGUF metadata (tokenizer.chat_template, tokenizer.ggml.bos_token_id, …).
  • Tokenizer wrapper — thin façade over the tokenizers crate so model crates don't all rebuild the same encode/decode glue.
  • Sampling — re-exports rlx_runtime::SampleOpts plus helpers (argmax, top-k, top-p, repetition penalty).

Replaces the chat/sampling/tokenizer pieces that used to live in rlx-models/rlx-cli, breaking the "runners depend on the CLI helper crate" coupling.

License

MIT OR Apache-2.0.