Struct WebSource

pub struct WebSource { /* private fields */ }

Responsible for sourcing data from the web.

Implementations

impl WebSource

Construction

pub fn new(headers: HeaderMap, cache: Option<WebCache>) -> Self

Creates a new web source.

impl WebSource

Scrape

pub fn scrape<F, T>(&self, url: &WebUrl, scrape: F) -> Result<T, Error>

where F: Fn(Scraper<'_>) -> Result<T, Error>,

Scrapes the content from the url with the scrape function.

impl WebSource

Get

pub fn get(&self, url: &WebUrl) -> Result<String, Error>

Gets the text from the url.

pub fn get_data(&self, url: &WebUrl) -> Result<Vec<u8>, Error>

Gets the data from the url.

Trait Implementations

impl Clone for WebSource

fn clone(&self) -> WebSource

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for WebSource

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.