List of all items

Structs

• tools::clean::CanonicalUrl
• tools::extract::types::ExtractPreviewResult
• tools::fetch::types::FetchResult
• types::Context

Enums

• tools::fetch::profile::FetchProfile
• types::FetchStrategy

Macros

• chain
• dedupe
• merge
• run

Functions

• cli::fetch_url
• cli::print_json
• cli::read_input
• cli::run
• runtime::block_on
• templates::qrawl_children
• templates::qrawl_children_stream
• templates::qrawl_discover_children
• templates::qrawl_emails
• templates::qrawl_fetch_stream
• tools::batch::batch
• tools::clean::clean_emails
• tools::clean::clean_html
• tools::clean::clean_phones
• tools::clean::clean_text
• tools::clean::clean_urls
• tools::clean::utils::canonicalize_domain
• tools::clean::utils::canonicalize_url
• tools::extract::extract_emails
• tools::extract::extract_og_preview
• tools::extract::extract_phones
• tools::extract::extract_schema_types
• tools::fetch::fetch_auto
• tools::fetch::fetch_auto_with_result
• tools::fetch::fetch_bytes
• tools::fetch::fetch_fast
• tools::fetch::fetch_strategy
• tools::map::map_children
• tools::map::map_page
• tools::scrape::scrape_all
• tools::scrape::scrape_body
• tools::scrape::scrape_jsonld
• tools::scrape::scrape_metadata
• types::fetch_cache_get
• types::fetch_cache_new
• types::fetch_cache_put
• types::get_fetch_strategy
• types::get_fetch_timeout

Type Aliases

• types::Jsonld
• types::Metadata

Statics

• selectors::BODY_SELECTOR
• selectors::HTML_LANG_SELECTOR
• selectors::JSONLD_SELECTOR
• selectors::LINK_SELECTOR
• selectors::META_SELECTOR
• selectors::TITLE_SELECTOR
• types::CTX
• types::FETCH_CACHE

Constants

• tools::fetch::strategies::PER_HOST_CONCURRENCY
• types::DEFAULT_CONCURRENCY
• types::DEFAULT_FETCH_TIMEOUT