crawlrs 0.2.0

crawlrs - Enterprise-grade web scraping and crawling platform built with Rust
Documentation

crawlrs

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 33 feature flags, 11 of them enabled by default.

default

db-postgres (default)

platform (default)

auth (default)

content (default)

http (default)

metrics (default)

rate-limit (default)

This feature flag does not enable additional features.

sitemap (default)

teams (default)

webhook (default)

This feature flag does not enable additional features.

alchemize (default)

agent-lib

cache-redis

db-mysql

db-sqlite

dom-smoothie

engine-flaresolverr

This feature flag does not enable additional features.

engine-mllm

engine-moli

engine-playwright

engine-tls-fingerprint

extractors

forge-full

full

gateway

llm

This feature flag does not enable additional features.

openapi

rag

rag-local

standard

test-mocks

This feature flag does not enable additional features.

trafilatura

web-axum