Docs.rs
spider-2.38.116
spider 2.38.116
Permalink
Docs.rs crate page
MIT
Links
Repository
crates.io
Source
Owners
madeindjs
j-mendez
Dependencies
ahash ^0.8
normal
aho-corasick ^1
normal
async-openai ^0.29
normal
optional
async-trait ^0.1
normal
optional
async_job ^0.1
normal
optional
auto_encoder ^0.1
normal
base64 ^0.22
normal
optional
bytes ^1
normal
case_insensitive_string ^0.2
normal
chromey ^2
normal
optional
chrono ^0.4
normal
optional
const_format ^0.2
normal
optional
cookie ^0
normal
optional
cron ^0.15
normal
optional
fastrand ^2
normal
optional
flexbuffers ^2
normal
optional
gemini-rust ^1.6
normal
optional
h2 ^0.4
normal
hashbrown ^0.15
normal
home ^0.5
normal
optional
http ^1
normal
optional
http-cache ^0.20
normal
optional
http-cache-reqwest ^0.15
normal
optional
http-cache-semantics ^2
normal
optional
http-global-cache ^0.1.0
normal
optional
httpdate ^1
normal
optional
itertools ^0.14
normal
optional
lazy_static ^1
normal
log ^0.4
normal
lol_html ^2
normal
moka ^0.12
normal
optional
num_cpus ^1
normal
percent-encoding ^2
normal
phf ^0.11
normal
pin-project-lite ^0.2
normal
quick-xml ^0.38
normal
rand ^0.9
normal
optional
regex ^1
normal
reqwest-middleware ^0.4
normal
optional
serde ^1
normal
optional
serde_json ^1
normal
optional
serde_regex ^1
normal
optional
sitemap ^0.4
normal
optional
smallvec ^1
normal
sonic-rs ^0.5
normal
optional
spider_fingerprint ^2
normal
spider_firewall ^2
normal
optional
sqlx ^0.8
normal
optional
statrs ^0.18
normal
optional
string-interner ^0.19
normal
optional
string_concat ^0.0.1
normal
strum ^0.26
normal
sysinfo ^0.35
normal
optional
tiktoken-rs ^0.7
normal
optional
tokio-stream ^0.1
normal
tower ^0.5
normal
tracing ^0.1
normal
optional
ua_generator ^0.5
normal
optional
url ^2
normal
which ^6.0
normal
optional
wreq ^5
normal
optional
wreq-util ^2
normal
optional
fastrand ^2
normal
optional
reqwest ^0.12
normal
tokio ^1
normal
fastrand ^2
normal
optional
reqwest ^0.12
normal
tokio ^1
normal
libc ^0.2
normal
tokio-uring ^0.4
normal
optional
Versions
100%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Module packages
spider
2.38.116
Module packages
Module Items
Modules
In crate spider
spider
Module
packages
Copy item path
Source
Expand description
Internal packages customized.
Modules
ยง
robotparser
robot parser