robotparser-fork-0.11.0
- robotparser-fork 0.11.0
- Permalink
- Docs.rs crate page
- MIT
- Links
- Homepage
- Documentation
- Repository
- crates.io
- Source
- Owners
- j-mendez
- Dependencies
- futures ^0.3 normal optional
  
  percent-encoding ^2.1 normal
  
  reqwest ^0.10.1 normal optional
  
  url ^2 normal
  
  tokio ^0.2.11 dev
- Versions
- 80% of the crate is documented
Platform
Feature flags

docs.rs

Rust

Module reqwest

robotparser_fork0.11.0

Module reqwest

Module Items

Structs

In robotparser_fork::http

robotparser_fork::http

Module reqwest

Expand description

Support for reqwest library.

Structs§

RobotsTxtResponse: Future for fetching robots.txt result.