Skip to main content

Crate kreuzcrawl_bypass

Crate kreuzcrawl_bypass 

Source
Expand description

Configurable HTTP-based BypassProvider implementations for kreuzcrawl.

This crate lets you drive any HTTP-based bypass vendor through a YAML config file without writing Rust code. Drop a config in configs/, set the env vars it references, and wire up a SimpleHttpProvider.

§Quick start

use std::path::Path;
use kreuzcrawl_bypass::{SimpleHttpProvider, load_with_process_env};

let config = load_with_process_env(Path::new("configs/bright_data.yaml"))?;
let provider = SimpleHttpProvider::new(config)?;

Re-exports§

pub use config::ProviderConfig;
pub use error::ConfigError;
pub use error::ProviderError;
pub use loader::load_with_env;
pub use loader::load_with_process_env;
pub use provider::SimpleHttpProvider;

Modules§

config
Provider configuration types.
error
Error types for the kreuzcrawl-bypass crate.
extract
Cost extraction helpers.
loader
YAML-driven configuration loader.
provider
SimpleHttpProvider — a YAML-config-driven BypassProvider implementation.