Struct Fetcher 

pub struct Fetcher { /* private fields */ }

Stateless async HTTP fetcher that creates a new wreq client per request.

Because a fresh client is built for each request, there is no shared state between calls – no cookie jar, no persistent connections. This is the right choice for simple scraping tasks, parallel crawling from different IP addresses, or when you want maximum isolation between requests.

For login flows or multi-step interactions that need cookies, use FetcherSession.

Implementations

impl Fetcher

pub fn new() -> Self

Creates a new fetcher with default configuration (Chrome impersonation, 30s timeout, 3 retries, stealth headers enabled).

pub fn with_config(config: FetcherConfig) -> Self

Creates a new fetcher with the given configuration. Use this when you want full control over the config without going through the builder.

pub fn builder() -> FetcherConfigBuilder

Returns a new FetcherConfigBuilder for constructing a validated config. This is a convenience shortcut for FetcherConfigBuilder::new().

pub fn from_builder(builder: FetcherConfigBuilder) -> Result<Self>

Constructs a fetcher from a completed builder. The builder is consumed and validated. Returns an error if the builder configuration is invalid (e.g., both a static proxy and a proxy rotator are set).

pub fn set_proxy_rotator(&mut self, rotator: ProxyRotator)

Sets the proxy rotator for distributing requests across proxies. Each request will use the next proxy from the rotator according to its rotation strategy.

pub fn set_parser_config(&mut self, parser_config: ParserConfig)

Sets the parser configuration for HTML processing. This controls adaptive parsing behavior on the Response objects returned by this fetcher.

pub fn config(&self) -> &FetcherConfig

Returns a reference to the current fetcher configuration. Useful for inspecting defaults or logging the active settings.

pub async fn get( &self, url: &str, req: Option<RequestConfig>, ) -> Result<Response>

Sends an HTTP GET request to the given URL. Pass None for req to use the fetcher’s default configuration, or pass a RequestConfig to override specific settings for this request.

pub async fn post( &self, url: &str, req: Option<RequestConfig>, ) -> Result<Response>

Sends an HTTP POST request to the given URL. Use RequestConfig::json or RequestConfig::data to attach a request body.

pub async fn put( &self, url: &str, req: Option<RequestConfig>, ) -> Result<Response>

Sends an HTTP PUT request to the given URL. Use RequestConfig::json or RequestConfig::data to attach a request body.

pub async fn delete( &self, url: &str, req: Option<RequestConfig>, ) -> Result<Response>

Sends an HTTP DELETE request to the given URL. Some APIs accept a body with DELETE requests – use RequestConfig::data or RequestConfig::json if needed.

Trait Implementations

impl Default for Fetcher

fn default() -> Self

Returns the “default value” for a type.