List of all items

Structs

• DashMap
• ReqwestClientDownloader
• builder::CrawlerBuilder
• config::CheckpointConfig
• config::CheckpointConfigBuilder
• config::CrawlerConfig
• config::DiscoveryConfig
• config::DiscoveryRule
• config::DownloaderConfig
• config::ItemProcessorConfig
• config::ParserConfig
• discovery::DiscoveryOutcome
• engine::Crawler
• engine::CrawlerContext
• prelude::Link
• prelude::LinkExtractOptions
• prelude::LinkSource
• prelude::PageMetadata
• prelude::Request
• prelude::Response
• scheduler::Scheduler
• state::ConcurrentMap
• state::ConcurrentVec
• state::Counter
• state::Counter64
• state::CrawlerState
• state::Flag
• state::StateAccessMetrics
• state::VisitedUrls
• stats::StatCollector

Enums

• config::CrawlShapePreset
• config::DiscoveryMode
• prelude::LinkType
• prelude::MiddlewareAction
• prelude::PipelineError
• prelude::SpiderError
• spider::StartRequests

Traits

• Downloader
• HttpClient
• prelude::Downloader
• prelude::Middleware
• spider::Spider

Macros

• route_by_rule

Attribute Macros

• async_trait
• prelude::async_trait
• prelude::scraped_item
• scraped_item

Functions

• discovery::attach_page_metadata
• discovery::discover_response
• discovery::discovery_rule_meta_key
• discovery::page_metadata_meta_key

Type Aliases

• spider::StartRequestIter