Struct HttpClient 

pub struct HttpClient {}

Component responsible for handling HTTP requests and URL processing.

HttpClient encapsulates all HTTP-related functionality including URL extraction, URL cleaning, and content fetching. This component reuses the original functions

Implementations

impl HttpClient

pub fn new() -> Self

Creates a new HttpClient instance.

pub fn fetch_content_from_text( &self, text: &str, http_config: HttpConfig, ) -> Vec<(String, String)>

Extracts URLs from text and fetches their content with custom HTTP configuration.

Arguments

• text - Input text that may contain URLs
• http_config - HTTP configuration including timeout, retries, and other settings

Returns

A vector of tuples containing (URL, HTML content)

pub async fn fetch_content_from_text_async<F, Fut>( &self, text: &str, http_config: HttpConfig, future: F, ) -> Result<(), Box<dyn Error>>

where F: Fn(Option<String>, Option<String>) -> Fut + Clone, Fut: Future<Output = ()>,

Trait Implementations

impl Default for HttpClient

fn default() -> HttpClient

Returns the “default value” for a type.