Module crawler 

Structs

Crawler

The central orchestrator for the web scraping process, handling requests, responses, items, concurrency, checkpointing, and statistics collection.