logprobe 0.1.0

Detect normalization errors, entropy bias, and truncation artifacts in LLM logprob data
Documentation 
1
2
3
4
5
6
7

{"token":"Once","logprob":-1.2}
{"token":" upon","logprob":-0.3}
{"token":" a","logprob":-0.1}
{"token":" time","logprob":-0.5}
{"token":",","logprob":-0.8}
{"token":" there","logprob":-1.5}
{"token":" was","logprob":-0.4}