Struct UrlScraper

pub struct UrlScraper { /* private fields */ }

UrlScraper stores the HTML document in memory.

Implementations

impl UrlScraper

pub async fn new(url: &str) -> Result<Self, Error>

Constructs a new scraper from a given URL.

pub async fn new_with_client(url: &str, client: &Client) -> Result<Self, Error>

Use an existing reqwest::Client to make a request.

pub fn new_with_html(url: &str, html: &str) -> Result<Self, Error>

In case the HTML has already been fetched in advance, new_with_html can be used to parse from it directly.

pub fn into_iter(&self) -> UrlIter<'_, '_>

Fetch the URLs using an iterator.