Expand description
Compaction probe: validates summary quality before committing it to the context.
Generates factual questions from the messages being compacted, then answers them
using only the summary text, and scores the answers against expected values.
Returns a CompactionProbeResult that the caller uses to decide whether to
commit or reject the summary.
Structs§
- Compaction
Probe Config - Configuration for the compaction probe.
- Compaction
Probe Result - Full result of a compaction probe run.
- Probe
Question - A single factual question with the expected answer.
Enums§
- Probe
Verdict - Three-tier verdict for compaction probe quality.
Functions§
- answer_
probe_ questions - Answer probe questions using only the compaction summary as context.
- generate_
probe_ questions - Generate factual probe questions from the messages being compacted.
- score_
answers - Score answers against expected values using token-set-ratio similarity.
- validate_
compaction - Run the compaction probe: generate questions, answer them from the summary, score results.