Expand description
Bridge a generic OpenAI-compatible inference API into a Jev-style decision scoring service. Jev-style decisions are not a model format; they are a readout. This crate implements that readout on top of any runtime that can return next-token log probabilities:
- render the
direct-options-v1prompt through the serving runtime’s own chat template, with thinking disabled; - read the log probabilities of the fixed uppercase answer letters at the final position;
- softmax only over the declared options, so no other vocabulary can leak into the distribution;
- answer in the System One wire format with
choice,noulandscorequestions.
No model weights are copied and no answer text is generated: a decision costs one prompt evaluation and zero output tokens.
§Layout
strategyprobes the upstream service and parses the response shapes different runtimes use for the same distribution.promptowns the prompt contract, the single-token answer-slot check and the softmax.serverholdsserver::Bridgeand the HTTP surface.wirevalidates System One requests and builds their responses.
The jev-bridge binary is a thin CLI over server::Bridge.
§Documentation
Every public item is documented, and the crate builds with
#![warn(missing_docs)] so that stays true.
Modules§
- prompt
- The direct decision prompt contract and the single-token answer-slot check.
- render
- Local chat-template rendering.
- server
- The bridge: one resident upstream model behind a Jev-style scoring API.
- strategy
- Runtime probing of a generic OpenAI-compatible inference service.
- tokenizer
- Local tokenization through the Hugging Face
tokenizerscrate. - wire
- System One wire format: request validation and response construction.