crawlex 1.0.4

Stealth crawler with Chrome-perfect TLS/H2 fingerprint, render pool, hooks, persistent queue
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

//! `crawlex-mini` — HTTP-only worker.
//!
//! Built with `--no-default-features --features cli,sqlite`: no
//! `CDP client` dependency, no bundled Chromium download. Same CLI
//! surface as `crawlex` full: browser-dependent subcommands/flags parse
//! normally but return `Error::RenderDisabled` at runtime with a stable
//! message operators can match on.

#[cfg(feature = "cli")]
#[tokio::main]
async fn main() -> anyhow::Result<()> {
    crawlex::cli::run().await
}

#[cfg(not(feature = "cli"))]
fn main() {
    eprintln!("crawlex-mini requires the `cli` feature");
    std::process::exit(2);
}