List of all items

Structs

• prelude::ConsoleWriterPipeline
• prelude::Crawler
• prelude::CrawlerBuilder
• prelude::CrawlerState
• prelude::DeduplicationPipeline
• prelude::ParseOutput
• prelude::RateLimitMiddleware
• prelude::RefererMiddleware
• prelude::Request
• prelude::ReqwestClientDownloader
• prelude::Response
• prelude::RetryMiddleware
• prelude::Scheduler
• prelude::StatCollector
• prelude::StreamResponse

Enums

• prelude::MiddlewareAction
• prelude::PipelineError
• prelude::ResponseType
• prelude::SpiderError

Traits

• prelude::Downloader
• prelude::Middleware
• prelude::Pipeline
• prelude::ScrapedItem
• prelude::Spider
• prelude::ToSelector

Attribute Macros

• prelude::async_trait
• prelude::scraped_item

Functions

• prelude::create_dir
• prelude::is_same_site
• prelude::normalize_origin
• prelude::validate_output_dir