Docs.rs
  • spider-1.7.9
    • spider 1.7.9
    • Docs.rs crate page
    • MIT
    • Links
    • Repository
    • crates.io
    • Source
    • Owners
    • madeindjs
    • j-mendez
    • Dependencies
      • hashbrown ^0.12 normal
      • log ^0.4.16 normal
      • num_cpus ^1.13.1 normal
      • rayon ^1.5.2 normal
      • regex ^1.5.0 normal
      • reqwest ^0.11.10 normal
      • robotparser-fork ^0.10.5 normal
      • scraper ^0.13 normal
      • tokio ^1.17.0 normal
      • url ^2.2.2 normal
    • Versions
    • 87.88% of the crate is documented
  • Go to latest version
  • Platform
    • i686-pc-windows-msvc
    • x86_64-apple-darwin
    • x86_64-pc-windows-msvc
    • x86_64-unknown-linux-gnu
  • Feature flags
  • docs.rs
    • About docs.rs
    • Badges
    • Builds
    • Metadata
    • Shorthand URLs
    • Download
    • Rustdoc JSON
    • Build queue
    • Privacy policy
  • Rust
    • Rust website
    • The Book
    • Standard Library API Reference
    • Rust by Example
    • The Cargo Guide
    • Clippy Documentation
logo

logo

Crate spider

logo
Change settings

List of all items

Structs

  • configuration::Configuration
  • page::Page
  • utils::Client
  • website::Website

Functions

  • utils::fetch_page_html
  • utils::log