Docs.rs
  • spider-1.49.12
    • spider 1.49.12
    • Docs.rs crate page
    • MIT
    • Links
    • Repository
    • crates.io
    • Source
    • Owners
    • madeindjs
    • j-mendez
    • Dependencies
      • ahash ^0.8.6 normal
      • bytes ^1.5.0 normal
      • case_insensitive_string ^0.1.7 normal
      • chromiumoxide ^0.5.6 normal
      • compact_str ^0.7.1 normal
      • cssparser ^0.31.2 normal
      • ego-tree ^0.6.2 normal
      • fast_html5ever ^0.26.1 normal
      • flexbuffers ^2.0.0 normal
      • hashbrown ^0.14.2 normal
      • itertools ^0.10.5 normal
      • jsdom ^0.0.11-alpha.1 normal
      • lazy_static ^1.4.0 normal
      • log ^0.4.20 normal
      • num_cpus ^1.16.0 normal
      • percent-encoding ^2.3.1 normal
      • regex ^1.10.2 normal
      • reqwest ^0.11.22 normal
      • selectors ^0.25.0 normal
      • serde ^1.0.167 normal
      • sitemap ^0.4.1 normal
      • smallvec ^1.11.2 normal
      • string_concat ^0.0.1 normal
      • tendril ^0.4.3 normal
      • tokio ^1.34.0 normal
      • tokio-stream ^0.1.14 normal
      • ua_generator ^0.3.5 normal
      • url ^2.4.0 normal
      • tikv-jemallocator ^0.5.0 normal
    • Versions
    • 100% of the crate is documented
  • Go to latest version
  • Platform
    • i686-pc-windows-msvc
    • x86_64-apple-darwin
    • x86_64-pc-windows-msvc
    • x86_64-unknown-linux-gnu
  • Feature flags
  • docs.rs
    • About docs.rs
    • Badges
    • Builds
    • Metadata
    • Shorthand URLs
    • Download
    • Rustdoc JSON
    • Build queue
    • Privacy policy
  • Rust
    • Rust website
    • The Book
    • Standard Library API Reference
    • Rust by Example
    • The Cargo Guide
    • Clippy Documentation

spider1.49.12

  • Structs
  • Enums
  • Traits
  • Functions
  • Type Aliases
?
Change settings

List of all items

Structs

  • CaseInsensitiveString
  • configuration::Configuration
  • packages::robotparser::parser::RequestRate
  • packages::robotparser::parser::RobotFileParser
  • packages::scraper::element_ref::ElementRef
  • packages::scraper::element_ref::Select
  • packages::scraper::element_ref::Text
  • packages::scraper::html::Html
  • packages::scraper::html::Select
  • packages::scraper::node::Attrs
  • packages::scraper::node::Classes
  • packages::scraper::node::Comment
  • packages::scraper::node::Doctype
  • packages::scraper::node::Element
  • packages::scraper::node::ProcessingInstruction
  • packages::scraper::node::Text
  • packages::scraper::selector::CssLocalName
  • packages::scraper::selector::CssString
  • packages::scraper::selector::Selector
  • packages::scraper::selector::Simple
  • page::Page
  • utils::PageResponse
  • website::Website

Enums

  • packages::scraper::error::SelectorErrorKind
  • packages::scraper::node::Node
  • packages::scraper::selector::NonTSPseudoClass
  • packages::scraper::selector::PseudoElement
  • website::CrawlStatus

Traits

  • packages::scraper::Element

Functions

  • black_list::contains
  • configuration::get_ua
  • page::build
  • page::convert_abs_path
  • page::domain_name
  • page::get_page_selectors
  • utils::fetch_page_html
  • utils::fetch_page_html_raw
  • utils::log

Type Aliases

  • packages::scraper::node::AtomicStrTendril
  • packages::scraper::node::Attributes
  • packages::scraper::node::AttributesIter