Module tokens 

Compatibility path for native runtime token budgeting.

Constants

CONTEXT_RESPONSE_RESERVE_TOKENS

PARITY-18 — headroom reserved for the model’s own completion, folded into the context-guard boundary alongside with_guard_margin. Neither estimate_view_tokens nor estimate_request_tokens counts anything for the reply the model is about to generate — this is a flat token budget carved out of the model’s context window for it, since the completion shares the same window as the request on every provider this crate targets.

Functions

context_guard

PARITY-18 D1/D2/D4 — the single context-guard decision, shared by every call site that must decide whether a request is safe to send: the CLI’s resume_cmd preflight check AND Agent::run_loop’s per-send check (D4 — the guard is a session invariant, not a one-shot preflight, so turn 2+ and /expand all are covered too). Because both call through this one function, a request can never pass one gate and fail the other — there is only one formula.

estimate_deferred_schema_tokens

Schema-token estimate for the B6 “tools” banner line: the estimate over the serialized full ToolSchema list minus the estimate over the serialized advertised list — i.e. the token cost of what’s currently deferred (hidden behind tool_search) rather than eagerly advertised. Saturates to 0 rather than underflow if advertised somehow estimates larger than full (e.g. formatting differences), since “negative deferred tokens” has no meaning for the banner.

estimate_request_tokens

PARITY-18 D1 — the full wire-request token estimate: every message in messages (including the system prompt at index 0) plus the serialized tools schema array, which is a real part of the provider request but — before PARITY-18’s re-fix — was never counted by the preflight guard at all. A session whose messages alone fit comfortably could still carry a fat builtin/MCP tool-schema array that blows the real wire request; this is the fix.

estimate_tokens

Deterministic token estimate: ceil(utf8_bytes / 4).

estimate_view_tokens

Estimate the serialized wire size of canonical messages.

fmt_approx_tokens

Render an estimated token count in the shared UX style: ~21,904 tok (tilde prefix + comma-grouped thousands, matching the stub-line comma style in reduce.rs). Every figure that flows through estimate_tokens/estimate_view_tokens/estimate_deferred_schema_tokens should be rendered through this helper so the ~ discipline (D11) is applied uniformly rather than ad hoc at each call site.

with_guard_margin

Apply the runtime’s 5/4 context-guard safety margin to a raw token estimate. Rounds up (div_ceil), never down — the margin only ever pushes the boundary check to be more cautious.