sim-codec-robots 0.1.0

Bounded RFC 9309 robots.txt parser and matcher for SIM.
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
# sim-codec-robots

In one line: Bounded RFC 9309 robots.txt parser and matcher for SIM.

## What it gives you

Make deterministic RFC 9309 allow decisions with grouped agents, percent-aware case-sensitive paths, longest-match precedence, wildcards, end anchors, and allow-on-equal rules. The contract keeps inputs, outputs, limits, and refusal cases explicit, so callers can compose the capability without acquiring unrelated host, transport, or product authority. Stable records make the result suitable for tests, inspection, and deterministic integration.

## Why you will be glad

- The public contract makes supported behavior, limits, and typed failures visible before integration.
- One owning crate prevents neighboring libraries from growing competing copies of the same policy.
- Deterministic records and checked tests keep adapters reviewable when implementations evolve.

## Where it fits

Within SIM, sim-codec-robots owns only the focused contract described above. Adjacent runtime libraries, platform adapters, codecs, and user surfaces can build around it while retaining their own policy. That boundary keeps the kernel small, avoids competing implementations, and lets this capability evolve without forcing unrelated components to change.