Crate docrawl 

docrawl library API: programmatic crawling for documentation sites.

Basic usage:

• Build a CrawlConfig and Config
• Call crawl(cfg).await

This crate also ships a CLI (bin: docrawl) which wraps the library.

Re-exports

pub use crate::config::Config;

pub use crate::crawler::crawl;

pub use crate::crawler::CrawlConfig;

pub use crate::sink::FileSink;

pub use crate::sink::Sink;

pub use crate::sink::Stats;

Modules

cache

config

crawler

extract

manifest

robots

save

security

sink

sitemap

util