rust_scrapling 0.4.1

Modern web scraping: spiders, CSS selectors, robots.txt/AutoThrottle politeness, and LLM/RAG-ready Markdown extraction - a Rust port of Scrapling
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12

//! Async HTTP fetching: a reqwest-backed client ([`client::Fetcher`]) with
//! stealth headers, retries, proxy support (single, per-protocol, and
//! rotating), charset-aware body decoding, and response wrappers that plug
//! straight into the parser.

pub mod client;
pub mod config;
pub mod constants;
pub mod encoding;
pub mod proxy;
pub mod response;
pub mod search;