scrape-le 0.1.2

Check whether a page is scrapeable before the scraper is written, and say when it cannot tell
1
2
3
4
5
6
7
8
9
10
11
12
13
14

//! The pure decision layer: signatures, detectors, verdict, report.
//! No I/O, no browser — evidence in, findings out — so everything here
//! tests from the fixture corpus at `../fixtures/`. `fetch.rs` (and
//! later `render.rs`) gather the evidence; both surfaces call
//! `check()` and nothing else.

pub(crate) mod antibot;
pub(crate) mod auth;
pub(crate) mod check;
pub(crate) mod ratelimit;
pub(crate) mod report;
pub(crate) mod robots;
pub(crate) mod signatures;
pub(crate) mod url;