Struct HttpClient 

pub struct HttpClient { /* private fields */ }

HTTP client for the acquisition engine.

Implementations

impl HttpClient

pub fn new(timeout_ms: u64) -> Self

Create a new HTTP client with standard Chrome user-agent.

pub async fn get(&self, url: &str, timeout_ms: u64) -> Result<HttpResponse>

Perform a single GET request with retry on 5xx and backoff on 429.

Falls back to HTTP/1.1 on protocol errors (some CDNs reject HTTP/2).

pub async fn post_form( &self, url: &str, form_fields: &[(String, String)], extra_headers: &[(String, String)], timeout_ms: u64, ) -> Result<HttpResponse>

POST form data (url-encoded) and return a response with all headers.

Unlike get(), this captures all response headers (not a filtered subset), because callers like the auth module need set-cookie headers.

pub async fn get_many( &self, urls: &[String], concurrency: usize, timeout_ms: u64, ) -> Vec<Result<HttpResponse>>

Perform parallel GET requests with bounded concurrency.

pub async fn head_many( &self, urls: &[String], concurrency: usize, ) -> Vec<Result<HeadResponse>>

Perform parallel HEAD requests with bounded concurrency.

Trait Implementations

impl Clone for HttpClient

fn clone(&self) -> HttpClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.