spider_worker-1.23.0 is not a library.
Spider Worker
A spider worker to decentralize the crawl lifting.
Dependencies
This project depends on the spider crate.
Usage
cargo run
WIP
request handling io load- parse links per domain