spider-1.2.1
- spider 1.2.1
- Docs.rs crate page
- MIT
- Links
- Documentation
- Repository
- Crates.io
- Source
- Owners
- madeindjs
- j-mendez
- Dependencies
- reqwest ^0.11 normal
  robotparser ^0.10 normal
  scraper ^0.12 normal
  url ^2.2 normal
- Versions
- 83.33% of the crate is documented
Go to latest version
Platform
Feature flags

Rust

☰

Module website

Structs

Module spider::website[−][src]

A website to crawl

Structs

Represent a website to scrawl. To start crawling, instanciate a new struct using