Struct RecallQueryShape 

pub struct RecallQueryShape {
    pub original_tokens: usize,
    pub sent_tokens: usize,
    pub sent_tokens_max: usize,
    pub budget_tokens: usize,
    pub envelope_stripped: bool,
    pub units_dropped: usize,
}

What shaping did to the recall query before it was embedded (#4972).

Why: the query used to go to the embedder whole and come back cut at the 512-token window with “no warning, no metric, and no signal to the caller” — the defect as filed. This struct is the metric. It rides the enriched- prompt log line, which is the same corpus the 52%-over-window rate was measured from, so the rate after the fix is two jq filters away: select(.recall_query.units_dropped > 0) for queries this module reduced, and select(.recall_query.sent_tokens_max > .recall_query.budget_tokens) for sends whose fit inside the window could not be proven. What: token estimates before and after shaping, the ceiling on what was sent, the budget in force, and what was removed. Absent from the JSON when no palace was resolved and no recall was attempted. Test: single_event_roundtrip covers serialisation; prompt_context::tests::over_window_query_is_reduced_to_whole_units covers the values.

Fields

original_tokens: usize

Estimated tokens in the raw prompt, before any shaping.

sent_tokens: usize

Estimated tokens actually sent to /recall.

sent_tokens_max: usize

Upper bound on the true tokens sent (#4972).

Why: sent_tokens charges ASCII-letter runs by a calibrated divisor, which no divisor above 1 token per character can make a bound. Without this field a shape reporting sent_tokens: 490, units_dropped: 0 asserts a clean pass on a query the embedder may have cut — the metric reading healthy while the loss happens. What: prompt_context::query::max_tokens of the sent text. #[serde(default)] so log lines written before this field parse back.

budget_tokens: usize

Token budget in force for this firing.

envelope_stripped: bool

Whether a task-notification envelope was reduced to its payload.

units_dropped: usize

Whole units (lines, or words) dropped to fit the budget. On the last-resort character path the unit is the character.

Implementations

impl RecallQueryShape

pub fn reshaped(&self) -> bool

True when shaping changed the query the embedder saw.

Why: the pass-through case is the common one and must stay quiet — a warn on every firing is a warn nobody reads. What: envelope_stripped || units_dropped > 0. Test: prompt_context::tests::short_query_passes_through_untouched.

pub fn may_exceed_window(&self) -> bool

True when the sent query is not provably inside the embedder window.

Why (#4972, round-3 review): sent_tokens <= budget_tokens is an estimate clearing a budget, not a proof, and treating it as one is what let a reshaped query still overrun the window while the log reported the reduction as a success. This is the honest complement — false means the send fits, full stop; true means it may have been cut and the shape declines to claim otherwise. What: sent_tokens_max > budget_tokens. Test: prompt_context::tests::shape_flags_a_send_it_cannot_prove_fits.

Trait Implementations

impl Clone for RecallQueryShape

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RecallQueryShape

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RecallQueryShape

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for RecallQueryShape

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for RecallQueryShape

impl PartialEq for RecallQueryShape

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for RecallQueryShape

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for RecallQueryShape