List of all items

Structs

• prelude::ConcurrentMap
• prelude::ConcurrentVec
• prelude::ConsolePipeline
• prelude::Counter
• prelude::Counter64
• prelude::Crawler
• prelude::CrawlerBuilder
• prelude::CrawlerState
• prelude::DeduplicationPipeline
• prelude::Flag
• prelude::ParseOutput
• prelude::RateLimitMiddleware
• prelude::RefererMiddleware
• prelude::Request
• prelude::ReqwestClientDownloader
• prelude::Response
• prelude::RetryMiddleware
• prelude::Scheduler
• prelude::StatCollector
• prelude::StateAccessMetrics
• prelude::TransformPipeline
• prelude::ValidationPipeline
• prelude::VisitedUrls

Enums

• prelude::JsonType
• prelude::MiddlewareAction
• prelude::PipelineError
• prelude::SpiderError
• prelude::TransformOperation
• prelude::ValidationRule

Traits

• prelude::Downloader
• prelude::Middleware
• prelude::Pipeline
• prelude::ScrapedItem
• prelude::Spider
• prelude::ToSelector

Attribute Macros

• prelude::async_trait
• prelude::scraped_item
• scraped_item

Functions

• prelude::create_dir
• prelude::is_same_site
• prelude::normalize_origin
• prelude::validate_output_dir