llm-token-visualizer 0.2.0

Flag low-confidence spans in LLM output from token logprobs, and render per-token confidence as terminal, HTML or Markdown
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34

# Contributing


Thanks for helping. Small, focused PRs are easiest to review.

## Setup


You need a stable Rust toolchain.

```bash
git clone https://github.com/Mattbusel/LLM-Hallucination-Detection-Script
cd LLM-Hallucination-Detection-Script
cargo test
cargo run -- --logprobs-file examples/logprobs/cuyp.json --threshold 0.6
```

## Before you open a PR


CI runs these; run them locally first:

```bash
cargo fmt --all -- --check
cargo clippy --all-targets -- -D warnings
cargo clippy --all-targets --no-default-features -- -D warnings
cargo test
cargo run --example detect
```

## Good places to start


- Detection logic lives in `src/detect.rs`, with unit tests at the bottom of the file. New heuristics should come with a test and, ideally, a real sample response in `examples/logprobs/`.
- Sample responses must be real API output (say which model and provider in the PR). Do not hand-edit logprobs.
- `rust_mvps/` is design sketches that are not built. Turning one into a working crate is welcome, but open an issue first.

Issues labelled `good first issue` are sized for a first PR.