Docs.rs
spider-lib-0.2.1
spider-lib 0.2.1
Docs.rs crate page
MIT
Links
Homepage
Repository
crates.io
Source
Owners
mzyui
Dependencies
anyhow ^1.0
normal
async-trait ^0.1
normal
bincode ^1.3
normal
bytes ^1.0
normal
csv ^1.1
normal
dashmap ^5.4
normal
dirs ^5.0
normal
futures-util ^0.3
normal
governor ^0.3
normal
hex ^0.4
normal
http ^1.4.0
normal
kanal ^0.1
normal
linkify ^0.10.0
normal
moka ^0.12
normal
num_cpus ^1.16
normal
psl ^2.1.183
normal
rand ^0.8
normal
reqwest ^0.12
normal
rmp-serde ^1.3.1
normal
robotstxt ^0.3.0
normal
rusqlite ^0.31
normal
optional
scraper ^0.19
normal
seahash ^4.1.0
normal
serde ^1.0
normal
serde_json ^1.0
normal
serde_with ^3.8.3
normal
sha2 ^0.10
normal
spider-macro ^0.1.0
normal
thiserror ^1.0
normal
tokio ^1.0
normal
tracing ^0.1
normal
tracing-subscriber ^0.3
normal
url ^2.0
normal
Versions
71.48%
of the crate is documented
Go to latest version
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Skip to main content
Module checkpoint
spider_
lib
0.2.1
Module checkpoint
Module Items
Structs
In crate spider_
lib
spider_lib
Module
checkpoint
Copy item path
Source
Structs
§
Checkpoint
A complete checkpoint of the crawler’s state.
Scheduler
Checkpoint
A snapshot of the scheduler’s state.