spider 2.6.17

The fastest web crawler written in Rust.
Documentation

spider

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 54 feature flags, 5 of them enabled by default.

default

cookies (default)

encoding (default)

reqwest_native_tls_native_roots (default)

sync (default)

ua_generator (default)

adblock

cache

cache_chrome_hybrid

cache_mem

cache_openai

chrome

chrome_cpu

chrome_headed

chrome_headless_new

chrome_intercept

chrome_screenshot

chrome_stealth

chrome_store_page

control

This feature flag does not enable additional features.

cowboy

This feature flag does not enable additional features.

cron

decentralized

decentralized_headers

flexbuffers

fs

full_resources

This feature flag does not enable additional features.

glob

headers

This feature flag does not enable additional features.

inline-more

This feature flag does not enable additional features.

jemalloc

openai

openai_slim_fit

This feature flag does not enable additional features.

real_browser

This feature flag does not enable additional features.

regex

reqwest_hickory_dns

reqwest_json

reqwest_multipart

reqwest_native_tls

reqwest_native_tls_alpn

reqwest_native_tls_manual_roots

reqwest_native_tls_vendored

reqwest_native_tls_webpki_roots

reqwest_rustls_tls

serde

sitemap

smart

socks

spoof

string_interner_bucket_backend

This feature flag does not enable additional features.

string_interner_buffer_backend

This feature flag does not enable additional features.

string_interner_string_backend

This feature flag does not enable additional features.

tikv-jemallocator

time

This feature flag does not enable additional features.

tokio_io_std