Qrawl

Composable web crawling tools for Rust

Install

cargo add qrawl

Tools

• batch: Batch operations concurrently
• clean: Clean raw data
• extract: Extract structured data
• fetch: Fetch with auto or fast strategy
• map: Map URLs
• scrape: Scrape raw data

Templates

• qrawl_children: Get children from parent URLs
• qrawl_emails: Get emails from given URLs

License

MIT