Expand description
Internal engine pieces used by crate::Crawler.
Most users will not work with this module directly. It holds the task-level implementation details that connect scheduling, downloading, parsing, middleware, and item processing into one running crawler.
Structs§
- Crawler
- The running crawler instance.
- Crawler
Context - Cheaply cloneable wrapper around the engine’s shared context payload.