Crate crw_core 

Core types, configuration, and error handling for the CRW web scraper.

This crate provides the foundational building blocks shared across all CRW crates:

• config — Layered TOML configuration with environment variable overrides
• error — Unified error types (CrwError) and result alias (CrwResult)
• types — Shared data structures (ScrapeData, FetchResult, OutputFormat, etc.)
• url_safety — SSRF protection (blocks private IPs, cloud metadata, non-HTTP schemes)

Example

use crw_core::{AppConfig, CrwError, CrwResult};

let config = AppConfig::load().unwrap();
assert!(config.server.port > 0);

Re-exports

pub use config::AppConfig;

pub use error::CrwError;

pub use error::CrwResult;

Modules

config

error

mcp

Shared MCP (Model Context Protocol) JSON-RPC types and tool definitions.

types

url_safety