Struct TokenLimitScanner 

pub struct TokenLimitScanner { /* private fields */ }

Rejects input exceeding max_tokens approximate tokens.

Implementations

impl TokenLimitScanner

pub const ID: ScannerId

This scanner’s id.

pub fn new(max_tokens: usize) -> Self

A scanner that rejects input over max_tokens approximate tokens.

pub fn max_tokens(&self) -> usize

The configured maximum.

Trait Implementations

impl Clone for TokenLimitScanner

fn clone(&self) -> TokenLimitScanner

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenLimitScanner

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Scanner for TokenLimitScanner

fn id(&self) -> ScannerId

Stable identifier (e.g. native:pii).

fn direction(&self) -> Direction

Which path this scanner runs on.

fn disposition(&self) -> Disposition

Whether this scanner may block, or only transforms.

fn scan<'a>(&self, text: &'a str, _ctx: &mut ScanCtx) -> ScanResult<'a>

Inspect/transform text. The borrowed Verdict::text lets a pure detector return the input with zero allocation.

fn hold_back(&self) -> HoldBack

How much trailing text a streaming OUTPUT runner must hold back for this scanner. Default HoldBack::TokenBoundary — most patterns are token-bounded. A full-text scanner overrides to HoldBack::WholeStream.

fn max_input_inflation_ratio(&self) -> f64

Token-inflation bound for an admission estimate (sentinels grow the request). Default 1.0.

fn stream_patterns(&self) -> Vec<String>

The regex patterns this scanner redacts (or blocks on) when it runs on the OUTPUT path — the shapes the streaming runner’s hold-back DFA must recognise so a match forming across a chunk boundary is never half- emitted. Default empty: a scanner that never redacts streamed output (a pure restore scanner, an input-only scanner) contributes nothing; the runner still holds back live vault sentinels for restore independently.